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THifi  EDUCATIONAL  TESTING  ACT  OF  1981 

j  'TUESDAY,  JULY  21,  1981 

H^usE  or  Representatives;  Subcommixeei:  on  Elemen- 
,^  TARY,  Secondary,  and  Vocational  Education  Joint- 
ly With  the  Slhcommittek  on  Postsecondarv  Educa- 
tion, Committee  on  Education  and  Labor, 

Washington,  D.C^ 
The  subcommittees  met,  pursuant  to  call,  at  9:30  a.m.,  in  room 
2175  of  the  Rayburn  House  Office  Building,  Hon.  Carl  Perkins 
(chairman  of  the  full  committee)  presiding. 

Members  present:  Representatives  Perkir\s,  Simon,  Peyser, 
Weiss,  Erdahl,*and  Craig. 

Staff  present:  John  F.  Jennings,  counsel;  and  William  JBlakey, 
counsel;  Nanpy  L.  Kober,  legislative  specialist.^ 

Chairman  Perkins.  The  Subcommittee  on'Elementary,  Second- 
ary, and  Vocational  Education  and  the  Subcommittee  on  Postsecon- 
dary  Education  are  conducting  a  joint  hearing  this  morning  on 
H.R.  1662; 
IText  of  H.R.  1662  follows:] 

(U 
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97TII  CONGKESS 
1st  Session 


H.R.1662 


To  rcquirt  cetuiir  infor/n&tion  be  prtlvidcd  to  individuals  who  take  standardized 
educational  admissions  tests,  and  for  other  purposes. 


-  '  •.  February  4,  1981 

Mr  Wbiss  (for  himself,  Mrs.  Cjiisholm,  Mr.  Miller  of  California,  Mr.  Gib- 
bons, Mr.  MOFFETT,  Mr.  Richmond,  Mrs.  Sciirokder,  Air,  Waloren, 
and  Mr.  Dixon)  introdueed  the  folloN^nng  bill;  whieh  was  referred  to  the 
Committee  on  Education  and  Labor 


/V 


A  BILL 

.To  require-  certain  information  be  provided  to  individuals  who 
take  standardized  educational  admissions  tests,  and  for  other 
purposes.  '  ^  .  ^  \ 

1  Be  it  enacted  by  the  Senate  and  House  of  Represcnta- 

2  tives  of  the  United  States  of  America  in  Congress  assembled, 

3  SHORT  TITLE 

14  Section  1.  This  Act  may  be  cijed  as-fche  "Educational 

5  - 

15  Testing  Act  of  1981".  *  ^  ' 


3 


.1  \  '         '  finding]^  ^VND  PURPOSK^ 

2-        Sec.  2.jaVTIie  Congress  .of  the  United tStates  finds 

3,  . 


4^   '  ^    "  (1)  pdueation  is  fundamental  to  the  development 

•  5  '    of  individual  citizens  and  the  progress  of  the  Nation  as 

6  a  whole; 

7"  (2)  there  is  a  eoptinuous^  need  to  ensure  equal 

^8  *    aceess. for  all  Americans  to  edueational  opportunities  of 

9  a  high  quality;     ^      ,    -  '       *        '  ^ 

10.  '   w     (3)  stAndhrdized  tests  ar^  a  major  faetor'in  the  ad- 

11  mission  and  placement  of  students  in  post$econdary 

12  edueation  and  also  play  an  important  role  in  individ- 

13  uals'  professional  lives;  .  o 
^4  (4)  there  is  inereasing  concern  among  citizens, 

15  .     educators,  and  public  officials  regarding  the  appropriate 

16  uses  of  standardized  tests  in  the  admissions  decision  of 

17  postseeondary  education  institutions; 

18  (5)  the  rights  of  individuals  and  the  public  interest 

19  can  be  assured  without  endangering  the  proprietary 

20  rights  of  the  testing  agencies;  and  - 

21  ,      (6)  standardized  tests  are  developed' and  adminis- 

22  ,Y   tcred  without  regard  to  State  boundaries  and  are  uti- 
,23  .\jized  dn  a  national  basis. 

24  {hyii  is  tlfc  purpose  of  this  Act — 
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1  ^  .   "      (1)  to  ensure  that  test  subjects  dnd  persons  who 

2  use  test  results  arc  fully  aware  of  the  elmraeteristics,  , 
3^'     uses,  and  limitations  of  standardized  tests  in  post- 

4  secondary  edueation  admissions; 

5  (2)  to  make  available  to  the  publie  appropriate  in- 

6  formation  regarding  the  procedures,  development,  and 

7  administration  of  standardized  tests; 

8  (3)  to  protect  the  publie  interest  by  promoting 

9  '  more  "knowledge  about  appropriate  use  of  standardized 

10  test  'results  and  by  promoting  greater  accuracy,  valid- 
/  ity^  and  Hiabijity^n  the  development,  administration, 

12      '  and  jnterpretatiop  of  standardized  tests;  aiid 

IS  -  ,(4)  to  eneourage  use^of  multiple  eritt^ria  in  the" 

14  grant  or  denial  of  an>  signifieant  educational  benefit. 

15  INFORM ATfON  TO  TEST  SUBJECTS  AND  POSTSECONDARY 

16  '  EDUCATIONAL  INSTITUTIONS 

17  Sec.  3.  (a)  Each  test  agency  shall  provide  to  any  test 

18  subject  in  clear  and  easily  understandable  language,  along^ 

19  with   the   registration   form  for  a  test,   the  following 

20  information:  ■  ^  . 

21  (1)  The  purposes  for  which  the  test  is  constructed 

1 

22L        and  is  intended  to  be -used.'        .  ^ 

23  •  (2)  The  subject  matters  included  on  such  test  and 

24  the  knowledge  and  skills  which  the  test  purports  to 


25  measure. 
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(3)  Statements  designed  to  provide  information  for 
interpreting  the  test  results,  including  explanations  of 
the  test,  and  the  eorrelation  between  test  scores?*  and 
future  success  in  schools  and,  in  the  case  of  tests  used 
for  pt)stbaccalaureate  admissions,  the  standard  error  of 
measurement  and  the  correlation  between  test  scores 
and  success  in  the  career  for  which  admission  is 
sought. 

(4)  Statements  concerning  the  effects  on  and  uses 
of  tes^  scores,  including: — 

(A)  if  the  test  score  is  used  by  jtself  or  with 
other  information  to  predict  future  grade  point 
average,  the  extent,  expressed  as  a  percentage,  to 
which  the  use  of  this  test  score  improves  the  ac- 
curacy of  predicting  future  grade  point  average, 
over  and  above  all  other  information  used;  and 

(B)  a  comj^irison  of  the  average  score  and 
percentiles  of  test  subjects  by  major  income^ 
groups;  and  ; 

.(0)  the  extent  to  which  test  .preparation 
courses  improve  test  subjects'  scores  on  average, 
expressed  as  a  percentage,  I 
(5)  A  deSerfption  of  ^the  form  in  which  test  scores 
will  be  reported,  whether  the  raw  test  scores  will  be 
altered  in  any  way  before  being  reported  to  the  test 


5  . 

subject,  and 'the  manner,  if  any,  the  test  agency  will 
use  the  test  score  (in  raw  or  transformed  form)  by  itself 
or  together  with  any  other  information  about  the  test 
subject  to  predict  in  any  way  the  subject's  future  aca- 
demic performance  for  any  postsecondary  educational 
institution. 

(6)  A  complete  description  of  any  promises  or 
covenants  that  the  test  agency  makes  to  the  test  sub- 
ject ^vith  regard  to  accuracy  of  scoring,  timely  forward- 
ing or  score  reporting,  and  privacy  of  information  (in- 
cluding test  scores  and  other  information),  relating  to 
the  test  subjects. 

(7)  The  property  interests  of  the  test  subject  m 
the  test  results,  if  any,  the  duration  for  which  such  re- 
sults will  be  retained  by  the  test  agency,  and  policies 

-.regarding- -storage,  disposal,»-and^iuturjB_use  of  test 
scores. 

(8)  The  time  period  within  which  the  test  sub- 
ject's test  score  will  Ue  completed  and  mailed  to  the 
.test  subject  and  the  time  period  within  which  such 

scores  will  be  mailed  to  test  score  recipients  designated 
by  the  test  subject. 

"  (9)  A  description  of  special  services  to  accommo- 
date handicapped  test  subjects. 
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1  (10)  Notice  of  (A)  the  information  which  i§  availa- 

2  ble  to  the  test  subject  under  section  o(a)(2),  (B)  the 

3  rights  of  the  test  subject  under  section  6,  and  (C)  the 

4  procedure  for  appeal  or  review  of  a  test  score  by  the 

5  '  test  agency. 

6  (b)  Any  institution  which  is  a  test  score  recipient  shall 

7  be  provided  with  the  information  required  by  subsection  (a). 

8  The  test  agency  shall  provide  such  information  with  respect 

9  to  any  test  prior  to  or  coincident  with  the  first  reporting  of  a 

10  test  score  j)r  scores  for  that  test  to  a  recipient  institution. 

11  (c)  The  test  agency  shall  immediately  notify  the  test 

12  subject  and  the  institutions  designated  as  test  score  recipients 

13  by  the  test  subject  if  the  test  subject's  score  is  delayed  ten 

14  calendar  days  beyond  the  time  period  stated  under  subsection 

15  (a)(8)  of  this  section. 

 ^16  ~  REPORTS  ^VND"5TATIBTICA1:  DifTA  XND^OTHER  ~  ~' 

17  INFORMATION 

18  Sec.  4.  (a)(1)  In  order  to  further  the  purposes  of  this 

19  Act,  the  following  information  shall  be  provided  to  the  Secre- 

20  tary  by  the  test  agency: 

21  (A)  Any  study,  evaluation,  or  statistical  report 

22  pertaining  to  a  test,  which  a  test  agency  prepares  or 

23  causes  to  be  prepared,  or  for  which  it  provides  data. 

24  Nothing  in  this  paragraph  shall  require  submission  of 

25  any  reports  or  documents  containing  information  identi- 
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1  fiable  with  any  individual  test  subject.  Such  informa- 

2  tion  shall  be  deleted  or  obliterated  prior  to  submission 

3  ''to  the  Secretary. 

4  (B)  If  one  test  agency  develops  or  produces  a  test 

5  and  another  test  agency  sponsors  or  administers  the 

6  •      same  test,  a  copy  of  their  contract  for  services  shall  be 

7  -    submitted  to  the  Secretary. 

8  '       (2)  All  data,  reports,  or  other  documents  submitted  pur- 

9  suant  to  this  section  will  be  considered  to  be  records  for  pur- 

10  poses  of  section  552(a)(3)  of  title  5,  United  States  Code. 

11  (b)  Within  one  year  of  the  effective  date  of  this  Act,  the 

12  Secretary  shall  report  to  Congress  concerning  the  relation- 

13  ship  between  the  test  scores  of  test  subjects  and  income, 

14  race,  sex,  ethnic,  and  handicapped  status.  Such  report  shall 

15  include  an  evaluation  of  available  data  concerning  the  rela- 

16  tionshrp  between  Test  scores  airdrtheneompletion  of  test  prepa-^ 

17  ration  courses. 

18  PROMOTING  A  BETTER  UNDERSTANDING  OF  TE3TS 

19  Sec.  5.  (a)  In  order  to  promote  a  better  understanding 

20  of  standardized  tests  and  stimulate  independent  research  on 

21  such  tests,  each  test  agency— 

22  (1)  shall,  within  thirty  days  after  'the  results  of 

23  any  standardized  test  are  released,  file  or  cause  to  be 
■2'4'    "    filedin  theroffice  of-tbe-Secretary—  - 


lb' 
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8  ^  . 

1  •      (A)  a  copy  of  all  test  questions  used  in  calcu- 

.2  lating  the  test  subject's  raw  seore; 

3  (B)  the  eorresponding  aeeeptable  answers  to 

4  .        those  questions;  and 

5  (C)  all  rules  for  transferring  raw  scores  into 

6  those  scores  reported  to  the  test  subject  and  post- 

7  secondary  educational,  institutions  together_with„. 

8  an  explanation  of  such  rules;  and 

9  ^      (2)  shall,  after  the  test  has  been  filed  with  the 

10  Secretary  and  upon  request  of  the  test  subject,  send 

11  Fhe  test  subject — 

12  '(A)  a  copy  of  the  test  questions  used  in  dc- 

13  termining  the  subject's  raw  score;  , 

14  (B)  the  test  subject's  individual  answer  sheet 

15  together  with  a  copy  of  the  correct  answer  sheet 
  to  "the  same  test  with  questions  caontiiig'  toward 

17  the  test  subject's  raw  score  so  marked;  and 

18.  (C)  a  statement  of  the  raw  score  used  to  cal- 

19  culate  the  scores  already  sent  to  the  test  subject  if 

20  such  request  has  been  made  within  ninety  days  of 

21  the  release  of  the  test  score  to  the  test  subject. 

22  The  test  agency  may  charge  a  nominal  fee  for  sending  out 

23  such  information  requested  under  paragraph  (2)  not  to  exceed 

24  tlie  marginal  cost  of  providing  the  information. 
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1  (b)  This  section  shall  not  apply  to  any  standardized  test 

2  for  which  it  can  be  anticipated,  on  the  basis  of  past  experi- 

3  ence  (as  reported  under  section  7(2)  of  this  Act),  will  be  ad- 

4  ministered  to  fewer  than  five  thousand  test  subjects  national- 

5  ly  over  a  testing  year. 

6  (c)  Documents  submitted  to  the  Secretary  pursuant  to^ 
l7_illi^^sj^t|QIL.shall  be  considered  to  be  records  for  purfioses  of 

8  section  552(a)(3)  of  title  5,  United  States  Code. 

9  PRIVACY  OF  TEST  SCORES 

10  Sec.  6.  The  score  of  any  test  subject,  or  any  altered  or 

11  transferred  version  of  the  score  identifiable  with  any  test.sub- 

12  ject,  shall  not  be  released  or  disclosed  by  the  test  agency  to 

13  any'  person,  organization,  association,  corporation,  post- 
14  secondary  educational  institution,  or  governmental  agency  or 
15  subdivision  unless  specifically  authorized  by  the  test  subject 
IF  -ss^^or^ecipient^A-tcst-agenajunay^however,  release  all 

17  previous  scores  received  by  a  test  subject  to  any  currently 

18  designated  test  score  recipient.  This  section  shall  not  be  con- 
AO  strued  to  prohibit  release  of  scores  and  other  information  in  a- 

20  form  which  does  not  identify  the  test  subject  for  purposes  of 

21  research  leading  to  studies' and  reports  primarily  concerning 

22  the  tests  themselves. 


18 
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h  TESTING  COSTS  AND  FEES  TO  STUDENTS 

2  Sec.  7.  In  order  to  ensure  that  tests  are  being  offereji  at 

3  a  reasonable  cost  to  test  subjects,  each  test  agency  shall 

4  report  the  following  information  to  the  Secretary: 

ft 

5  (1)  Before  March  31,  1983,  or  within  ninety  days 

6  after  it  first  becomes  a  test  agency,  whichever  is  later, 
.  7  the  test  agency  shall  report  the  closing  date  of  its  test- 

8  ing  year.  Bach  test  agency  sh'all  report  any  change  in 

9  the  closing  date  of  its  testing  year  within  ninety  days 

10  after  the  ehange  is  made. 

11  (2)  For  each  test  program,  within  one  hundred 

12  and  twenty  days  after  the  close  of  the  testing  year  the" 

13  test  agency  shall  report — 

14  (A)  the  total  number  of  times  the  test  was 

15  taken  during  the  testing  year; 

J6  ^   (B)  the  number  of  test  subjects  who  have 

17  taken  the  test  once,  who  have  taken  it  twice,  and 

18  who  have  taken  it  more  than  twice  during  the 

19  testing  year; 

20  (0)  the  number  of  refunds  given  to  individ- 

21  uals  who  have  registered  for,  but  did  noji  take,  the 

22  test; 

23  .  (D)  the  number  of  test  subjects  for  whom  the 

24  test  fee  was  waived  or  reduced^ 
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(E)  the  total  amount  of  fees  received  from 

2  the  test  subjects  by  the  test  agency  for  each  test 

3  '  program  for  that  tost  year; 

4  (F)  the  total  amount  of  revenue  received 

5  from  each  test  program;  and 

6  (G)  the  expenses  to  the,  test  agency  of  the 

7  tests,  including — 

3  '  (i)  expenses  incurred  by  the  test  agency 

9  for  each  test  program; 

IQ  (ii)  expenses  incurred  for  test  develop- 

Ij.  ment  j)y  the  test  agency  for  each  test  pro- 

12  gram;  and 

13  (iii)  all  expenses  which  are  fixed  or  can 

14  be  regarded  as  overhead  , expenses  and  not- 

15  •  associated  with  any  test  program  or  with 

16  ■  test  developmentr  , 


17 
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(3)  If  a  separate  fee  is  charged  test  subjects  for 

18  admissions  data  assem^y  services  or  score  reporting 

19  services,  within  one  hundred  and  twenty  days  after  the 

20  close  of  the  testing  year,  the  test  agency  shall  report— 

.(A)  the  number  of  individuals  registering  for 

22  caeh  admissions  data  assembly  service  during  the 

23  testing  year; 
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1  (B)  the  number  of  individuals  registering  for 

2  each  score  reporting  service  during  the  testing 

3  year; 

4  (G)  the  total  amount  of  revenue  received 

5  from  the  individuals  by  the  test  agency  for  each 
.  6  admissions  data  assembly  service  or  score  report- 

7  ing  service  during  the  testing  year;  and 

8  (D)  the  expenses  to  the  test  agency  for  each 

9  admissions  data  assembly  service  or  score  report- 

10  'ing  service  during  the  testing  year. 

1 1  REGULATIONS  AND  ENFORCEMENT 

12  Sec.  8.  (a)  The  Secretary  shall  promulgate  regulations 


13  to  implement  the  provisions  of  this  Act  within  one  hjindred 

14  and  twenty  days  after  the  effective  date  of  this  Act.  The 

15  failure  of  the  Secretary  to  promulgate  regulations  shall  not 

16  prevent  the  provisions  of  this  Act  from  taking  effect. 

17  (b)  Any  test  agency  that  violates  any  clause  of  any  pro- 

18  vision  of  this  Act  shall  be  liable  for  a  civil  penalty  not  to 

19  exceed  $2,000  for  each  violation. 

20  (c)  If  any  provision  of  this  Act  shall  be  declared  uncon- 

21  ^stitutional,  invalid,  or  inapplicable,  the  other  provisions  shall 

22  remain  in  effect. 

23  DEFINITIONS 

"x24  ~~ Skc.  9. Tor  purposes^ oRKis  Act — 
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1  .   (1)  the  term  '^admissions  data  assembly  service" 

2  means  any  summary  or  report  of  grades,  grade  point 

3  averages,  standardized  test  scores,  or  any  combination 

4  of  grades  and  test  scores,  o(  an  applicant  used  by  any 

5  postsecondary  educational  institution  in  its  admissions 

6  process; 

7  (2)  the  term  "Secretary"  means  the  Secretary  of 

8  Education; 

9  (3)  the  term  "postsecondary  educational  institu- 
10 .       tion*'  means  any  institution  providing  a  course  of  study 

11  beyond  the  secondary  school  level  and  which  uses 

12  standardized  tests  as  a  factor  in  its  admissions  process; 

13  (4)  the  term  "score  reporting  service"  means  the 

14  '  reporting  of  a  test  subject's  standardized  test  score  to  a 

15  test  score  recipient  by  a  testing  agency; 

IQ  (5)  the  term  "standardized  test'^  or  "test" 
•1-7— means —       __v  .   _ 
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(A)  any  test  that  is  used,  or  is  required,  'for 

19  the  process  of  selection  for  admission  to  postsec- 

20  .  ondary  educational  institutions  or  their  programs, 

21  or 

22  (B)  any  test  used  for  preliminary  preparation 

23  for  any  test  that  is  used,  or  is  required,  for  the 

24  -  process  of  -selection  for  admission   to  post- 


id 

ERIC 


22 


15 
14 

secondary  education&l  institutions  or  their  pro-* 
grams, 

which  affects  or  is  conducted  or  distributed  through, 
any  medium  of  interstate  commerce,  but  such  term 
^Qes  not  include  any  test  designed  solely  for  nonadmis- 
sion  placement  or  credit-by-examination  or  any  test  de- 
veloped and  administered  by  an  individual  school  or  in-^ 
stitution  for  its  own  purposes  only; 

(6)  the  term  "test  agency"  means  any  person,  or- 
ganization, association,  corporation,  partnership,  or  in- 
dividual which  develops,  sponsors,  or  administers  a 
standardized  test;    *  »  : 

(7)  the  term  "test  preparation  course"  means  any 
curriclilum,  course  of  «tudy,  plan  of  instruction,  or 
method  of  preparation  given  /?fr  a  fee  which  is  specifi- 
cally  designed  or  constructed  to  prepare  a  test  subject 
for,  or  to  improve  a  test  subject's  score  on,  a  standard- 
^m^e^;^  

(8)  the  term  "test  program"  means  all  the  admin- 
istrations of  a  test  of  the  same  name  during  a  testing 
year; 

(9)  the  term  "test'  score"  means  the  value  given 
to  the  test  subject's  performance  by  the  test  agency  on 
any  test,  whether  reported  in  numerical,  percentile,  or 
any  other  form; 
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(10)  the  term  "test  score  recipient"  means  any 
person,  organization,  association,  corporation,  postsec- 
ondary  educational  institution,  or  governmental  agency 
or  subdivision  to  .which  the  tost  subject .  requests  or 
designates  that  a  test  igency  reports  his  or  her  score; 

(11)  the  term  "test  subject"  means  an  individual 
to  whom  a  test  is  admiiustered;  and 

(12)  the  term  'Ue|ting  year''  means  the  twelve 
calendar  months  which  ^he  test  agency  considers  either 
its  operational  cycle  or  its  fiscal  year. 

.4  EFFECTIVE  DATE 

I 

Sec.  10.  This  Act  shall  take  effect  one  hundred  and 


13  eighty  days  after  the  date  of  it?  enactm^ent. 
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Chairman  Perkins.  The  Bill,  which  was  introduced  by  our  col- 
league, Mr.  Weiss,  requires  that  certain  information  be  made  avail- 
ablei:o-students  that  take  standardized  admission  tests. 

The  Subcommittee  on  Elementary,  Secondary,  and  Vocational 
Education  conducted  many  hearings  on  thi^  bill  last  Congress.  We 
are  delighted  to  welcome  as  our  first  witnesses  a  panel  who  will 
give  us  an  overview  of  testing:  Dr.  Sylvia  Johnson,  professor  of  re- 
search methodology,  school  of  education.  Department  of  Psycho- 
Educational  Studies,  Howard  University;  Dr.  William  Mehrens, 
professor  of  measurement  and  statistics.  School  of  Education, 
Michigan  State  University;  George  Hanford,  president,  the  College 
Board;  and  Bruce  Zimmer,  executive  director.  Law  School  Admis- 
sion Council. 

All  of  you  come  around  as  a  panel.  We  will  hear  from  Dr.  Sylvia 
Johnson  first.  Mr.  Weiss,  do  you  have  a  statement  to  make? 

Mr.  Weiss.  Thank  you,  Mr.  Chairman.  I  first  want  to  express  my 
appreciation  to  both  the  Subcommittee  on  Postsecondary  Education 
and  the  Subcommittee  on  Elementary,  Secondary,  and  Vocational 
Education  for  holding^  this  round  of  hearings  on  the  Educational 
Testing  Act  of  1981.  As  you  know,  previous  hearings  in  the  96th 
Cqngress  yielded  a  wealth  of  new  information  and  insight  into  the 
standardized  testing  process.  And  yet  those  hearings  were  success- 
ful at  really  just  beginliing  to  make  the  far-reaching  consequences 
of  the  standardized  testing  process  known  to  the  American  public. 

Since  hearings  last  w*re  held  a  little  more  than  1  year  ago,  sev- 
eral events  have  significantly  altered  the  testing  industry.  Scoring 
errors  were  uncovered  as  a  direct  result  of  disclosure  provisions 
similar  to  those  contained  in  H.R.  1662— affecting  the  scores  of 
more  than  300,000  students;  prominent  test-producing  and  adminis- 
tering agencies— including  those  we  will  hear  from— have  under- 
gone major  changes  in  disclosure  policies;  and,  perhaps  most  impor- 
tant, public  concern  over  the  accuracy  and  justness  of  standardized 
tests  and  Xor  the  glaring  accduntability  gap  permitted  testing  agen- 
cies has  multiplied  among  the  more  than  2^2  million  students  who 
take  these  tests  every  year. 

In  addition,  at  least  21  States  now  are  considering  Truth-in-fest- 
ing  legislation  which  could  create  a  complex  regulatory  web  for 
test-givers.  I  am  concerned,  as  I  believe  all  members  of  both  sub- 
committees here  today  must  be,  that  the  likelihood  of  a  prolifera- 
tion of  State-level  disclosure  laws  may  well  interfere  with  standard- 
ized testing  and  thus  obstruct  our  educational  process.  Federal  leg- 
islation would  improve  the  testing  process  by  streamlining  regula- 
tory demands  on  test-givers,  an  issue  the  testing  agencies  rightly 
are  concerned  about.-  * 

Several  participants  in  previous  hearings  on  this  issue  proposed 
that  we»  wait  and  see  how  successfully  the  New  Yorlc  State  law 
worked  and  whether  public  concern  decreased.  We  have  been  pa- 
tient, Mr.  Chairman,  jand  today  I  believe  that  the  fundamental 
issue  addressed  by  my  legislation— making  the  testing  agencies  ac- 
countable to  millions  of  test-takers  every  year— is  far  from  re- 
solved. 

,It  is  my  hope  that  these  hearings  will  lead  to  enactment  of  the 
Educational  Testing  Act  of  1981.  If  tl  is  legislation  is  not  enacted,-. 
we  will  be  continuing  to  allow  testing  agencies  to  operate  without 
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making  them  appropriately  accountable  to  the  students  they  are 
serving. 

'Thank  you,  Mr.  Chairman.  ~  „ 

Chair m'an  Perkins.  Mr.  Peyser,  do  you  have  a  statement.' 
Mr  PEYSEft.  No,  I  do  not,  Mr.  Chairman'       ^  •  ^ 

Chairman  Perkins.  I  understand  that*  our  first  witness  is  not 
here  but  Dr":  William  Mehrens  is  here.  Come  around,  'Dr  Mehrens 
take  a  seat,  and  go  ahead  and  proceed  with  your  statement.  Is 
George  Hanford  here?  You  come  around  and  you  be  the  second  wit. 
ness.  ■  •  ^  ■ 

STATEMENT  OF  WILLIAM  MEHRENS,  PROFESSOR  OF>RASURE-  ^ 
MFNT  AND  STATISTICS,  SCHOOL  OF  EDUCATION.  DEPARTMENT 
Sf  f!i)UCAtK^^^  MICHIGAN -state  UNIVER- 

SITY 

Mr  Mehrens'.  Mr.  Chairman,  members  of  the  two  subcomniit- 
tees,  I  Tpleasedao  have  the,  opportunity  io  testify  today  on  the 
Educational  Testing  Act  of  1981,  H.R.  1662. 

Let Ve  give  you  a  brief  overview  of  my  background.  I  have  been 
a  DrofSsor  of  measurement  and  evaluation  at"Michigan  State  Uni- 
Sy  ince  1965.  I  have  published  widely  in  the  field  including 
•  numerous  textbooks  and  articles.  I  have  been  active  and  ha^^e  held 
in  several  professional  organizations.  For  example,  I  have 
beeri  president  of  the  Association  for  Measurement  and  Guidance 
SeG)  which  is  a  division  of  the  Amivrican  Personnel  and  Guid- 
ance Association  (APGA).  I  am  current.'y  a  senator  to  APGA  a.nd 
Sain  on  the4ecutive  council  i)f  AMEG.  I  am  currently  on  the 
BoS  of  DirectorTof  the  Natio'Hal  Council  ^f  Measurement  in  Edu- 

''''Mv"D^SSnI'l  activities  that  are  most  directly  related  to  my 
aualifiKfS  to  testify  on  H.R.  1662  include:  One,  working  as  an 
Swd  member 'on  their  published  f  atement  on  E^^^^^^^^ 
ArimiQcmn*;  Testing  two,  help  ng  author  the  AMh.ij  statemeni  on 
feSatio^a^SiSftSng  fo'r  sllection  in  educadona  and  occup^^^ 
tional  nroerams,  three;  authoring  a  critical  analysis  ot  the  iNaaer 
report-  "The  R^^^  ET^:  The  Corporation  That  Makes  Up 

Mfnds"  and  four  working  as  a  committee  member  on  the  Ameri- 
can P^chologS  Association's  standards  for  educational  and  psy- 
chSlogTcaUesfand  manuals.  I  have  attached,  as  appendices  to  this 
"~  testimony,  the  NCME  statement  and  m-y  critical  analysis  of  ttie 

'^ithould  m'ake  clear  that  my  testimony  today  is  -^"e  alone  I  am 
not  soeak'ne  in  any  official  capacity  for  AMEG,  NCME  nor  any 
Sther^rofessiiSal  measurement  organization  However.  Bob  Linn, 
cur%nt  DresS  of  NCME,  Has  approved  that  I  submit  the  at- 
tached NCME  statement,  r  perhaps  should  also  state  that  I  have 

.never  been  employed  by  a  commercial  test  PuHi^^^^^^^^ 
have,  on  very  .rare  occasions,  served  as  a  consultant  td  a  tew  ot 

^^When  asked  if  I  would  testify  today  I  was  asked  if  I  would  ad- 
dress four  questions:  One,^how  are  tests  developed?  two,  what  do 
thev  measure'  three  how  are  test  results  used?  and  four  what  are 
and  negative  aspects  of  test  use?  ^o  answ.er  these  ques-. 


tions  fully  in.  ll^  to  15  minutes  is  clearly  impossible.  The  questions 
perhaps  could  be  adequately  addressed  in  a  graduate  level  seminar 
in  measurement.  Nevertheless,  I  do  admire  your  willingness  to 
become  more  expert  in  measurement  and*!  will  try  togive  brief  an- 
swers to  these  questions  as  they  relate  to  the  particular  type  of  test 
referenced  in  H.R.  1662;  that  is,  any  test  used  for  the  process  of  se- 
lection for  admission  to  pqstsecondary  education. 
How  are  tests  developed  and  what  do  they  measure? 
*T*est  deyelopment  must  actually  start  by  answering  the  ^question 
of  how  the  results  are  to  be  used.  Since  we  are  discussing  tests  to 
be  used  as  selection  devices  to  educational  programs,  the  purpose  is 
to  build  a  test  which  will  assist  in  .the  selection  decision  process. 
Usually,  this  means  the  developers  try  to  develop  a  test  which  will 
predict  success  in  the  .program.  As  an  aside  this  is  not  success  on 
the  job.  Tnat  is  a  different  issue.  It  is  not  what  the  tests  ought  to 
be  doing  but  rather  to  predict  success  in  the  program.  The  test  de- 
velopers determine,  through  content  specialists  and  reviews  of  re- 

'  search,  what  general  areas  should, b^  tested.  These  vary  from  test 
to  test,  as  they  should.  For  example,  the  new  medical  college  ad- 
missions test  covers  biology,  chemistry,  arid  physics  and  the  con- 
tent is  restricted  to  areas  particularly  relevant  to  medical  educa- 
tion. The  schojastic  aptitude  test  covers  reading  comprehension,  vo- 
cabulary, mathematics,  and  English,  al!  of  which  have  been  proven 
to  relate  to  success  in  undergraduate  education.  We  might  think  of 

.  theSe  as  ac*hievement  tests;  for  example,  the  New  MCAT,  or  as 
measures  of  scholastic  aptitude.  The  specific  terms  used  are  not  im- 
portant as  long  as  we  realize  that  the  tests  measure  developed 
abilities  of  ihe  typje  important  for  subsequent  education  success  in 
the  program  for  which  the  test  was  developed. 

To  insure  that  the  tests  do  this,*  extensive  statistical  analyses  are 
done  on  a  large  set^ef  developed  items  and  only  those  which  are 
shown  to^  be  useful  for  the  purpose  of  predicting  success  are  placed 
in  the  test.  This /item/test  development  process  is  costly  and  tim^ 
consuming.  All  this  is  further  complicated  by  the  fact  that  most  of 
the  tests  of  the  kind^we^  are  speaking  of  have  alternate  forms.  This 
requires  that  the  form§.  be  equated  so  that  a  person  do^s  not  have 

'an  advantajge  based  on  the  particular  form  taken.  Further,  all  test 
items  are  looked  at  carefully  and  analya^  statistically  for  poten- 
tial bias.  '  * 

^This^  short  .overview  does  not  do  justice  to  the  question  of  test  de- 
velopment. It  is  a  complicated  and  costly  business.  It  would  surely 
be  unfortunate  to  have  to  build  a  test  which  could  be  used  only 
onceybecause  the  items  became  public  information  following  a  test 
administration  as  is  required  by  the,  bill.  This  would  result  in 
poorer  tests,  complicate  the  equating  process,  and  increase  costs. 

How  are  the  test  results  used?  They  are  used  both  to  help  indi-  i 
viduals  select  colleges  and  colleges  to  select  individual  students.  If 
students  know  their  own  results  and  the  general  distributional 
characteristics  9f  studehts  enrolled  in  various  schools,  they  can 
apply  to- the  schools  which  are  most  appropriate  for  them.  The  abil- 
ity of  students— along  with  their  counselors— to  use  this  informa-  * 
tion  wisely  accounts  for  the  fact  that  the  majority  of  students  are 
admitted  to  the  college  of  their  first  choice. 
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Various  colleges  use  these  sconis  in  quite  different  fashions  At 
the  undergraduate  level  many  colleges  do  not  require  admission 
exams.  Of  those  that  require  students  to  take  an  exam,  some  only 
use  it  for  descriptive  purposes  to  help  guide  studen  s  in  their  deci- 
sfon  Other  colleges  use  the  examinatioit  results  along  w'th  other 
data  as  a  basis  for  admission  decisions.  I  do  not  know  of  a  single 
college  that  bases  admission  decisions  only  on  tests  results 

What  are  the  positive  and  negative  aspects  of  tes^  use?  If  one 
uses  test  data  wisely,  better  educational  decisions  will  be  made,  bo 
mSh  data  have  been  gathered  to  show  ^he  validity  of  college  en^ 
trance  exams  for  predicting  success  in  allege  that  the  finding 
simply  cannot  be  legitimately  disputed. 

Tests,  because  they  are  objective,  are  especially  useful  for  those 
members  of  society  who  may  be  discriminated  against  if  pnly  the 
more  subjective  data  such 'as  interviews  or  letters  of  recommenda- 

^'^There^reaUy  are  no  negative  aspects  of  the  wise  use' of  test  data. 
Of  course  it  is  possible  to  overemphasize  test  data  in  making  a  ae- 
cision  but  college  admissions  officers,  as  a  group,  do  not  do  this. 
The  error  usually  goes  the  other  way.  Given  their  proven  validity, 
tests  are  typically  not  emphasized  enough.  . 

To  present  more  detail  in  answering  the  four  questidns  seems  not 
to  be  th3  best  use  of  my  time.  While  I  cannot  make  you  test  ex- 
pertl-in  10  m  nutes,  I  can  give  you  the  beliefs  to  test  experts  with 
Set  to  the  proposed  legislation.  As  mentioned  earlier,  I  am- here 
[Safto  represent  my  views,  I  do  not  formally  speak  for  any  orga- 

"ISugh  speaking  for  myself  I  would  like  to  emphasize  tha^^^^ 
believe  my  views  are  quite  similar  to  the  views  of  the  majority  of 
the  experts  in  measurement  and  eva  uation.  Evidence  for  this 
belief  can  be  seen  by  some  brief  quotes  from  the  ^atements  of  pro- 
fessional measurement  associations.  For  example,  the  official 
NCMF,  statenent  referred  to  earlier  states  the  toUowing.  . 

"£ing  an  test  questions  and  answers  public  poses  problems  for 
the  tS  developer  that  may  result  in .  increased-^costs  and  dimin- 

quires  disclosure  of  items  fallowing  testing..  The  statemen  o^ 
American  Psychological  Association's  Division  of  Evaluation  and 
Suremeht  on  thi  1979  Truth  in  Testing  Act  says  "Disclosure  of 
Es  usS  on  standardized  tests  has  many  disadvantages.  Later  , 
he  statement  says,  "We  believe  that,  students  themse  ves  would 
be  the  principal  losers  if  the  provisions  of  Section  5  of  H.R.  4J49 
were  to  become  law."  That  was  a  reference  to  the  disclosure  of 

^TtVtSly°agte ■  with'L  statements  quoted  from  three  major 
measrement^rganizations.  I  admit  that  the  assertions  made  re^ 
eardine'  the  likely  harmful  effects  of  a  bill  such  as  H.R.  1662 
faS  be  proven  beyond  a  shadow  of  a  doubt  but  these  assertions 
■are  maSe  by  the  Seers  of  the  three  m^or  professional  associ- 
atfons  in  the  area  of  educational  and  psychological  measurement. 
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They  are  seriously  thought  out,  informed  opinions  by  the  leading 
experts  in  the  field.  You  would  not  take  their  views  lightly. 

The  stated  purpose  of  the  Act—section  2.(b).— are  surely  not  de-  • 
batable  as  reasonable  goals.  However,  the  bill  is  not  needed  for 
those  purposes  to  be  fulfilled  and  the  bill  is  not  likely  to  facilitate 
the  accomplishment  of  those  purposes,  but  in  iact,  is  likely  to  seri- 
ously hamper  efforts  to  achieve  some  of  them,  for  example,  greater 
accuracy,  validity,  arid  reliability  in  testing. 

The  legislation  being  proposed  is  in  fact  consistent  with  the.  ef- 
forts by  some  to  do  away  with,  or' at  least  seriously  weaken,  stand- 
ardized testing.  There  is  abundant  research  evidence  showjjig  that 
should  these  efforts  succeed,  the  result  would  be  poorer  educational 
decisionmaking.  In  fact^it  should  be  obvious  to  anyone  that  better 
decisions  are  made  with  (lata  than  without  data. 

Why  do  some  people  in  our  Nation  wish  to  weaken  testing— and 
therefore  the  quality  of  our  educational  decisions— and  why  would 
the  proposed  legislation  have  that  effect?  Some  clues  to  the  first 
part  of  the  question  are  found  in  the  Nader  report  referred  to  earli- 
er. Often  the  implication  is  that  somehow  fewer  rejection  decisions 
would  be  made  if  tests  were  hot  used  in  selection  decisions.  Critics 
of  testing  appear  to  believe  that  if  the  reason  for  rejection  is -low 
test  scores  it  will  be  more  painful  and  less  understood  than  if  the 
reasons. are  low  interview  ratings,  low  high  school  grades,  or  insuf- 
ficiently glowing  letters  of  recommendation.  Some  people  even  sug- 
gest that  a  positive  correlation  between  income  and  test  score  re- 
sults show  the  test  is  unfair. 

None  of  this  stands,  up  to  a  logical  analysis.  First  of  all,. no  col- 
lege is  forced  to  use  ^'selection  test.  The  testing  enterprise  is  sub- 
ject to  the  open  market.  It  is  a  competitive  business.  The  exception 
would  be  the  tests  produced  by  the  U.S.  Government  through  the 
Civil  Service  Commission  and  the  Department  of  Labor  and  De- 
fense. Further,  the  evidence  suggests  that  the  majority  of  students 
are  admitted  to  the  college  of  their  first  choice.  Tests  simply  are 
not  ruling  lives.  Certainly  there  is  no  reason  at  all  to  believe  that, 
if  tests  were  not  used,  there  would  somehow  mysteriously  be  more 
slots  available  in  college  and  that  therefore  one  could  decrease  the 
number  of  reject  decisions— this  number  is  already  quite  small  for 
most  colleges.  The  implication  that  rejection  for  reasons  of  low  test 
scores  is  more  painful  and  less  cfnderstood  than  to  be  rejected  for 
low  scores  in  an  interview  is  simply  absurd.  Hardly  anyone  ever 
understands  why  he/she  received  a  low  score  on  an  interview. 

The  notion  that  a  positive  correlation  between  income  and  scores 
on  a  test  of  developed  ability  indicates  the  test  is  unfair  is  particu- 
larly illogical.  The  whole  notion  of  compensatory  education  for  the 
disadvantagQ.d  is  based  on  the  very  reasonable  notion  that  parental 
iiCicome  is  related  to  education  opportunities  which  are,  in  turn,  re- 
lated to  developed  abilities.  In  fact,  the  -correlation  that  exists  be- 
tween income  and  scores  such  as  on  the  SAT  indicates  some  con- 
struct validity  for  the  test.  It  is  supportiye  evidence  for  the  notion 
that  the  test  is  measuring  developed  abilities. 

I  could  dwell  at  length  on  the  mistaken  notions  of  the  critics  of 
measurement.  They  voice  many  illogical  criticisms.  They  do  wish  to 
^    weaken  the  testing  enterprise  and  that  would  lessen  the  quality  of 
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our  educational  'decisionmaking.  How  would  this  bill,  if  passed, 
serve  such  an  ill-advised  purpose?  ,  ^.„if  ;„ 

n  brief,  it  is  likely,  that  the  bill  of 
test  of  inferior  quality„(2)  increase  the  costs  of  tes  "ig  (3)  decrease 
se"rvices  to  the  students,  (4)  increase  coaching  effects-and  differen- 

tiaUy  mo?e  so  for  the  wealthy-and  f  Z^^"!*, -blfH^LToftl" 
callv  constructed  instruments  exempt  from  the  bill  in  lieu  ol  cne 
tetter  con  tructed  nationally  used  tests.  These  points  are  ones  I  an. 
sSe  you  have  heard  before.  They  are  not  points  which  can  be 
oroVeS  advance  but  they  are  ones  with  which  I  anri  sure  the  ma- 
jTily  of^isutement  ekperts  would  agree.  Let  me  briefly  expand 

'''''^^:\foSS^^r^?Stmch  requires  releasing  test  questions 
after  use  will  obviously  lower  Ihe-  quality  of  subsequent  tests  More 
te  t  qSestrons  will  need  to  be  written^and  used  There  will  be  less 
rSearch  on  items  before  use.  The  companies^wdl  hot  be  able  to  be 
so  selective  in  cho'osing  items  to  put  into  a  test  I  recognize  ihat  the 
IrgumS  his' been  made  that  if  there  is  a  sufficient^  large-pool,  a 
smalSset  of  the  released  items  could  be  reused.  However,  most 
tSts  do  not  have  a  large  pool  of  available  backup  items  of  as  high 
?q5aHty  as  the  ones  that  are  placed  in  the  tests  and  even  if  a 
L^^fsubsS  were  reused,  there  would  still  be  an  increased  demand 

%he  ?ncSse  in  cost  would  ensue  from  the  greater  number  of 
items  needed  as  welKas  various  oth.er  requirements  of  the -bill.  No 
on^wouTd  possibly  urge  otherwise.  The  amount  of  the  cost  increase 
?s  orc^rse  ipen  to  debate.  I  do  not  think  it  would  be  trivial. 
Those  who  understand  item  development  costs  agree  witii  me 

t£  decrease  in  service  would  be  an  obvious  concomitant  to  the 
necessity  of  releasing  items.  Fewer  exam  dates  would  be  offered. 
The  result  of  the  LaValle  bill  in  New  York  documents  this  . 

The  relea  e  o?  questions  may  not,  indeed  have  too  much  impac 
on  the  effects  of'coaching.  However,  if  there  were  an  .mpact  t 
wnnlH  pprtainlv  have  to  be  to  increase  those  ettects.  inis  wouia 
Turdy  resS"n  a  disadvantage  to  those  who  could  not  afford  coach- 

'"I'lnally  I  have  suggest^ed  that  passage  of  this  bill  would  result  in 
2reS  use  of  the  lolal  y  developed  test  of  inferior  quality.  This 
-^out  be  'ruJ  if  the  iJuty  of  the  national  test  -^^^^^^^ 
orovided  went  down  v^hile  cost  went  up.  This  would  be  extremely 
Unfortunate  for  both  tlie  individual  students  and  society  in  general. 

As  an  expe?t  in  measurement,  I  uYge  you  not  to  consider  any  so- 
caUed  fruSTn  {estingl  legislation.  It  would  be  a  disservice  to  your 

constituents..  I  „ 

Thank  you  very  muc)i  for  your  attention. 
[Material- submitted  by  William  Mehrens  follows:]  ^ 
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NCME  STATEMENT  ON 
EDUCATIONAL  ADMISSIONS  TESTING 


What  U  NCME? 

^  The  Nattunal  Council  on  Meaaurement  in  Education 
^  ^NCMB)  IS  an  organization  of  testing  practitionen. 
Kh6Ian.  and  speciaJitti  having.a«  itapnmary  goal  the 
improvVmeni  of  (ducational  measurement  practices 
and  t^^-hniques,  lu  members  include  college  pro- 
feisors  who  teach  and  cany  on  research  in  the  testing 
field,  p^T^ons  responsible  for  the  conduct  of  testing 
programs  in  state  and  local  educational  agencies, 
irujividuals  in  lest  development  and  research  organ iza* 
lions,  and  test  users.  Together,  the  me.mben  con- 
stitute  a  group  with  well  informed  opinions  on 
matters  of  educational  measurement  and  testing. 


What  Doen  .N'CME  Stand  For? 

NCME  re«axds  it  as  axiomatic  that  the  knowledges, 
SKills,  and  abilities  of  people  are  important  and 
relevant  to  individual,  in&titutionaJ,  and  societal  ({oals, 
and  thai  many  of  these  charsctenstics  arc  measure 
able  As  corol lanes,  NCME  endorses  the  following 
positions 

•  Many  educational  decisions  can  be  improved 
by  objective  ar.d  equitable  assessments  of  the 
aciiievements  ajui  characteristics  of  individ 

,  uals.  ^ 

•  Tesu  can  provide  $uch  ass^ssmenU  which,  jn 
many  insUnces,  axe  more  objective  and  raore 
equitable  than  other  forms  of  evaluation. 

•  rollcite,  graduate,  and  professional  school 
admissions  decuions  are  among  the  cduca* 
tional  dccisiOtis  that  can  be  improved  by 
objective  and  equitable  assessment  of  individ- 
u^  avhievements  and  characteristics  to  the 
benefit  of  the  individuals,  the  institutions, 
and  society. 

•  The  evtent  to  whirh  tests  can  contribute  to 
sound  educational  decuions  depends  on  (he 
intnnstc  quality  of  the  tests  and  on  proper 
interpretation  jj^^d  us^  of  test  scores. 

A  major  obj(.>ctive  of  the  measurement  profession 
condrvies  to  tx;  the* assurance  of  high  quality  tests 
and  proper  test  use  Much  has  been  done  by  the 
profession  to  achieve  the  present  high  level  «f  t*?st 
quality  and  use,  and  ther*  u  every  expectation  of 


continuing  Improvtment.  This  statement,  and  the 
proposal  which  concludes  it,  is  in  the  spirit  of 
fostenng  that  improvement  through  the  professionals 
who  have  the  knowledge  and  expertiae  about. tests 
and  testing,  rather  than  through  governmental 
involvement. 


What  Does  NCME  Advocate  to  Help  Test  Taken? 

Test  takers  should  be  provided  with  informa- 
tion on  the  range  of,  knowledge  and  skills  to 
be  tested,  the  conditions  under  which  a  test  is 
to  be  taken,  the  types  of  test  questions  to  be 
included,  and  the  way  a  test  is  to  be  scored. 

This  information  shouid  be  easily  available  for-each 
test  and  include,  at  a  minimuhfi,  a  description  of  the 
test,  sample  questions,  a  description  of  the  testing 
conditions,  and  the  Konng  procedures  to  be  used.  It 
IS  desirable  to  make  a  complete  form  of  a  test  or  its 
equivalent  available  to  all  test  takers.  However,  to 
meet  this  objective  it  is  not  necessary  to  make  public 
all  test  questions  and  answen  after  a  tesL's 
administration. 

Test  Uken  should  know  that  the  test 
questions  which  they  are  called  on  to 
answer  have  not  been  made  public  pnor  to 
test  administration. 

If  tesU  were  released  after  admin utration,  and 
some  or  all  of  their  contents  used  again,  some  test 
takers  would  enjoy  the  opportunity  of  becoming 
familiar  with  the  questions  and  answen.  Thus,  testing 
conditions  in  the  future  would  not  be  equitable  for 
all  examinees,  for  It  is  clearly  not  fair  that  some,  but 
not  «n,  examinees  have  opportunity  to  become 
familiar  in  advance  with  the  test  content  ^ 

Making  all  test  questions  and  answen  public  poses 
problems  for  the  test  developer  that,  may  result  in 
increased  costs  and  diminished  services  for  the  test 
takers.  Two  such  problems  are  the  maintenance  of 
(est  quality  and  score  equating.  ^ 

Test  taken  shou!d  have  assurance  that  their 
tesU  have  been  scored  accurately. 

Scoring  mon  are  possible,  and  consequently  pro 
ceduret  to  protect  test  taken  f^om  such  insLSDces  are 
desirtble.  Releasing  a  scored  test  to  the  test  taker 
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after  Ihe  irttmR  U  only  one  of  «^eral  po»t»hle  w»y« 
to  provJde  this  protection  but  w  undcwnble  for  the 
nuoM  sut«d  above  Alt*m»U/e  procedures  to  insure 
correct  iconng.  such  as  opUontl  h«nd  scoring  services 
confirm  Kores.  provide  «  lest  disrupUve  way  of 
•ccomphshinj  the  objective  of  wsunng  •  test  Uker  of 
fair  Konnf  than  tot*l  disclosure  of  the  test  and 
an»w>.i  key 

Test  tiker*.  and  test  users,  should  have 
aaur«nce  Ihit  the  tesU  Ihcy  are  Ukm«.  or 
using,  meet  professional  critena  of  good 
question  wnling.  validity,  and  reliability 
„    Measurement  experU  have  developed  «tf  n«;v«  and 
^ngorous  pr<^edure«  for  constructing  and  validating 
trtU  These  procedures  are  detailed  m  the  Standards 
TorEduccUorxal  and  Psychological  Tests,  developed 
joinUy    by   NCME  And   two   other  professional 
Uan.rations  and  relied  on  in  several  court  cases 
Typically,  admission   l*$t  >t*mi  are   wntten  in 
accordance  with  deUiled  cjnlent  specifications,  they 
are  tried  out  in  field  Jtudies.  and  they  are  reviewetl 
with  respect  to  conKnt.  correctness  of  answers. 
Jot^ntial  bias,  and  empincal  properties  Reliabili  y 
and  validity  studies  are  conducted  and  reported  In 
addition     measurement    experts    support  an 
iwh^mdenl  and  extensive  r«v,ew 
example  the  J*^er»l  volumes  of  the  Buros  A!enwr 
Sitaturttn^nt    Yearbook$    alone    conUm  m^ny 
'thousands  of  pages  of  cntical  t«t  reviews 

Although  NCMK  generally  believes  that  the  most 
widely  used  admi«ion  tests  axe  of  high  <iy*l'ty;  ' 
reco«>»m  it*  continuing  obligation  to  monitor  tests 
«dTt  use  NCMK  also  recognize,  that  in  the  typ.c^ 
profesiional  review. 'ihe-point  of  view-of  the  test 
Uker  -hai  not  always  been  adequitely- repre^nted. 
the  conclusion  to  this  ^Utement  provides  a  f  /oposal 
for  monitoring  atlmission  testing  that  emphasiws  the 
right*  and  concerns  of  test  takers. 


in  the  Adm 
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Testing 


What  Ar»  Some  U«iei 
Context? 

Testing  has  become  enUngledf  with  •  variety  of 
social  and  personal  ideologies,  tome  of  which  prompt 
people  to  argue  for  changes  in  educational  admisnons 
Suing.  Fmt.  some  people  object  to  any  evaluation  of 
an  individual  and.  since  tesU  product  some  judg- 
ZnZTurtt  that  tesu  be  banned.  NCME  believes  tha 
value  of  accurate  a.«essmenu  of  relevant 
characteristics  of  Individuals  to  the  individuals  them- 
selves,  to  society.  an<)  to  iu  institutions  more  than 
iuitifies  the  continued  use  of  test*. 
^  SeJond.  some  tesU  have  been  viewe<l  as  sexually 
racially,  ethnically,  or  socio^conomically  oiasctl 
because  «>me  groups  perform  lesi  well  on  th.'  tests 
than  others  AllhouRh  some  '"^'P''*^.  f^^^ 
differences  in  performance  a.s  bias  m  a  test,  it  is  now 
commonly  undentood  among  measurement  expt'rU 


ihit  the  mere'exiatence  of  such  group  differences  in 
^ir fomia^ie  u  not  evi^lence  of  bias.  These  Ui' 
mavTflect  indivWualiUe.  of  health,  growth  and 
Thievement.  some  of  which  can 
through  incrtaaed  services        opporlumties  Few 
peopl!  suggest  that  differentials  m  achoolreUted 
Urformances  woi  id  disappear  if  there  "° 
Since  achievement  U  desirable  for  our  citizens  NCME 
Wieve*  It  «  socially  conslniclive  to  atUck  the  cause 
of    the    unequal    performances    that  measunng 
instrumenU  help  discover 

Third,  some  people  feel  that  ability  and  pas 
achieverient  should  not  be  •  basia  fo  school 
admuiion.  and.  thus,  admiuion  tesU  «e  not  needed^ 
Tha  issue  is  whether  colleges  and  universities  are  to 
provide  universal  higher  eduoKion.  or  whether  some 
may   choose   the   role  of  educating  the  more 
acidemically  prepared  at  a  more 
advanced  level.  Both  roles  seem  to  NCME  to  be 
>o^iX  desirable,  and  NCME  wouldjiolwish-lo  rule- 
out  either  Where  ment  is  considered  in  selection 
decisions,  resulu  from  admiaioni  test*  can  provide 
objective  informaUon  about  the  achievemenU  of 
individuals  in  the  areas  tested. 

Fourth,  admissions  test  informatjon  has 
occasionally  been  misused  by  individuals  in  spite  of 
warnings  in  many  lest  manuals.  Misuse  includes 
making  admission  decisions  solely  on  the  basis  of  test 
score  dau.  over-interpreting  insignificant  differences 
in  lest  performances,  and  evaluating  teachers  and 
schools  inappropriately  using  the  adniissions  lest 
score  daU.  Through  lU  publicaUons  and  conferences. 
NCME  has  committed  much  of  lU  resources  to  the 
effort  to  reduce  to  a  minimum  such  improper  uies 

What  U  Needed? 

NCME  proposes. the  establUhment  of  a  broadly 
representative 

Commission  on  the  Conduct  of  Educational 
Admissions  Testing  Programs. 

The  Committion's  meiT\ber»hip  should 
'  inleresu  of  test  takers.  lilmiMlons  and  other  instltu. 

tional  officers.  putnU,  teachers.  tesUng  agencies,  and 

ih»  measurement  profeuion. 
Thle  Commisaion  ahould  be  charged  with  a  single. 

long-term  goal: 

Monitoring  and  Improving  the  conduct  of 
testing  programs  whose  resulu  are  designed 
to  be  used  in  the  selection  and  admissions 
procett  in  American  higher  educaion. 

Specific  activiues  likely  to  lead  to  the  realiralion  of 

this  goal  are: 


1.  Developing  a  clear,  workable  set  of  principles 
that  address  the  concerns  of- 
(a)  educarors  for  rejiahle  and  valid  informa- 
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STATEMENT  ON 
EDUCATIONAL  ADMISSIONS  TESTING,  continued 

tion  for  use  in  the  admissions/counseiing/ 
advisory  processes, 

(b)  test  takers  for  informttion  about  tests  and 
tho~^testing  process  and  for  an  equitable, 
accurate^  and  relevant  assessment  of  their 
knowledge,  skills,  and  abilities,  and 

(c)  society  for  selection  procedures  that 
result  in  an  allocation  of  educational 
opportunities  to  a  broad  spectrum  of 
qualified  youth  and  adults  in  the  popula- 
tion. 

2.  Seeking  voluntary  concurrence  with  these 
principles  by  test  sponsors  and  developers  and 
by  officials  of  higher  education  institutions  in 
the  conduct  of  testing  and  admissions  pro- 
grams. 

3.  Establishing  a,  mechanism  by  which  each 
testing  program  can  be  evaluated  with  respect 
to  the  way  in  which  the  principles  are 
reflected  in  its  procedures  and.  publications. 

4.  Reporting  the  results  of  these  evaluations  to 
the  various  concerned  publics  and,*  if 
necessary,  issuing  public  censures  when 
instances  are  detected  of  repeated  divergence 
from  the  principles. 

NCME  Board  of  Qirecton 
April  1980 

This  statement  has  been  adopted  by  the  NCME  Board 
of  Directom,  and  can  be  reproduced  and  distributed. 
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EDITOR'S  NOTE: 

The  following  artu  le  is  repnnlrd  m  entirety  from  the  April  198!  MEG.  'f^^^^-^ 
should  use  this  2nd  printing,  which  corrects  production  errors  contained  in  the 
April  article,  as  the  definitive  version.  We  regret  any  inconvenience  caused  by  this 
inadvertence, 

Criiicisms  of  pracuces  in  educational  and  psychological  measurement  and  evaluation 
arc  certainly  not  anything  new.  Indeed  the  history  of  these  practices  shows  that  .such 
criticisms  have  been  present  from  the  onset  of  the  profession.  Professionals  and  lay 
persons  alike  have  raised  innumerable  concerns  and  issues,  in  manners  ranging  from 
simple  questioning  \o  blanket  condemnation.  In  the  niain.  professionals  favoring 
-lestine"  have  accepted  these  criticisms  as  challenges  and  have  sought  to  continue  to 
improve  practices  so  as  to  assuage  criticisms.  And  so  it  went,  loud  attacks  and  quiet 

responses.  , 

It  now  seems  that  quiet  responses  are  no  longer  the  best  tact.  Opponents  o  testing 
capitalize  on  modern  technology,  easily  swayed  public  sentiment,  and  media 
prominence  to  make  their  criticisms  more  pungent  than  ever  before.  A  case  in  point  is 
the  Nairn/ Nader  report  on  the  practices  and  policies  of  Educational  Tesung  bervicc. 
Clearly  this  report  demands  that  alternative  perspectives  be  provided.  To  ignore  this 
report  is  to  do  a  grave  injustice  to  those  who  strive  to  provide  effective  educational  and 
psychological  measurement  and  evaluation  practices. 

For  these  reasons,  I  asked  William  Mehrens  to  provide  an  evaluation  of  the 
Nairn/  Nader  report.  Bill  is  well  qualified  for  the  task;  He  has  served  as  president  and 
editor  of  this'journal  for  AMEG  and  has  authoried  numerous  books  and  ariicles  on 
educational  and  psychological  measurement  and  evaluation.  It  should  be  noted  that 
neither  he  nor  I  nor  AMEG  feels  any  great  need  todefend  ETS;  they  can  do  that  on  their 
own  Vyc  do,  however  feel  obligated  to  provide  an  alternative  professional  perspective, 
h  IS  in  that  vein  that  I  commend  Bill's  artic^le  to  you.  U  is  important  and  vital  reading.  I 
hope  you  enjoy  it  and  are  stimulated  to  thought  and  action.  ^  Loesch 

ETS  Versus  Nairn/Nader:  Who  Reigns? 

WILLIAM  MEHRENS 

As  most  MEG  readers  are  probably  Testing  Service  (ETS)  has  responded  (o 

-awart  the  SS-I-pagc  Ralph  Nader  report  portions  of  this  document  with  two  briel 

on  the  Educational  Testing  Service  vepovts:  Thl  Scores  and  Family  Income 

authored  by'Na.rn  has  been  published  (1980a)  and  Test  Use  and  Validity 

under  the  title  The  Reign  of  ETS:  The  (1980b).Inthisarticle,Iexaminesomeof 

Corporation  That  Makes  Up  Mmds  the  issues,  charges,  and  countercharges 

(1980)  (hereinafter  referred  to  as  the  in  those  documents. 

Nairn/Nader  report).  The  Educatipnal  If  you  dislike  testing  and  ETS  and 

ETSVS.  NAIRWNAOER 
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enjoy  one-sided  reponing,  you  will  like 
ihe  Nairn,'Nader  report.  If  you  are  a  fair- 
minded  scholar  who  feels  positively  to- 
ward testingand  ETS,  you  will  surely  be 
dismayed,  as  I  am,  at  its  biased  treatment. 
Other  combinations  of  characteristics 
may  place  you  at  different  ;tlaces  on  the 
pro-con  Nairn/Nader  report  continu- 
um. For  example^  if  you  generally  be- 
lieve organizations  that  are  large  and 
successful  are  also  evil»  you  will  view  the 
report  differently  than  if  you  think 
largeness  and  success  are  characteristics 
to  be  admired. 

Even  if  you  had  fieard  none  of  the  hype 
concerning  the  report  and  did  ngt  pick 
up  a  bit  of  the  flavor  from  the  title,  the 
first  two  sentences  in  ihc  preface  of  the 
Nairn/Nadtr  report  (written  by  Nader} 
would  provide  early  insight  into  the 
direction  the  report  takes.  'The  concep- 
tion for  this  TCpon  on  the  Educational 
TesiingService  began  with  ihcvictims  of 
standardized  testing.  Some  of  these  stu- 
dents would  come  up  to  me  at  colleges 
and  universities  around  the  country  to 
express  a  feeling  that  they  had  been 
unfustly  judged  by  a  three  hour  exam" 
(italics  added)  (p.  ix). 

The  sentences  remind  me  of  a  quote 
by  Barclay  (1968).  He  dida  delightful  job 
in  {X}inting  out^  that  many  popular  is* 
sues  are  frequently  discussed  by  inap- 
propriate generalizing.  He  told,  for  ex- 
ample, of  an  article  written  by  a  Mr. 
Pulling: 

Mr.  Pulling  rambled  on  abpu nesting  being  Sim 
il^r  to  phrenology  He  said  that  this  article  wiis 
occasioned  by  a  desultory  contact  with  some 
child  who  fookiom^  test  injom^  place  and  was 
not  rated  too  bright  in  mathematics.  Neverthe- 
less, this  particular  individual  went  toiom^ col* 
lege  somewhere  ind  somehow  succeeded*  all  of 
which  prove  beyond  the  shadow  of  a  doubt  in 
Mr  Pulling's  logic  that  all  testing  m  all  places 
and  on  all  leveUin  similar  to  the  cephalic  index 
of  the  phrenologists.  (Barclay,  1966.  p^  4) 


The  Nairn.  Nader  report  is  divided 
into  nine  chapters  (398  pages),  1 10  pages 
of  footnotes,  and  "15  pages  of  appendixes. 
It  gives  the  appearance  of  being  a  schol- 
arly.document,  but  the  title,  the  preface, 
the  chapter  titles,  and  the  one-sided  set  of 
references  soon  dispel  any  such  notion. 
The  sections  that  follow  (except  for  the 
last  two)  are  responses  to  the  major 
themes  of  the  n:ne  chapters  of  the  report. 
In  the  last  two  sections  I  comment  on  the 
ETS  responses  and  provide  a  summary, 

PAINFUL  UPHEAVALS? 

Chapter  1,  "Hope  .  .  .  Will  Be  Kept 
Within  Reasonable  Bounds,'*  starts  out 
with  five  case  studies  of  students  who 
supposedly  suffered  'painful  up- 
heavals" caused  by  ETS.  But,  the  narnes 
and  identifying  information  have  been 
changed.  Even  after  changing  the  identi- 
fying information,  however,  the  argu 
ments  include  some  contradictions.  For 
example,  on  page  5.  we  read  that  Gary 
Vladnik  "knew  that  theSAT  score  meant 
the  end  of  hisxollege  hopes."  Then,  on 
page  8,  we  read  that  Gary  "was  Iticky 
enough  to  live  near  i.  good,  affordable 
college  which  did  not  require  an  ETS 
test."  He  went  there  for  two  years,  trans* 
ferred  to  the  school  that  had  rejected 
him,  and  graduated.  It  is  certainly  hard 
to  see  how  this  "painful  upheaval"  re- 
sulted in  any  great  harm  to  Gary,  and 
clearly  his  ETS  score  did  not  mean  "thifi, 
end  of.his  college  hopes.'* 

This  example  illustrates  two  of  the 
underlying  themes  of  the  rep>ort  that  dis- 
turb me.  First,  there  is  a  basic  theme  that 
ETS  has  more  control  over  college  ad* 
missions  than  it,  in  fact,  has.  ETS  does 

.  not  have  any  power  over  the  selection 
decisions  made  by  the  colleges.  Colleges 
do  not  neechto  uic  ETS  tests.  Many  do 
not.  For  those  that  do,  ETS  does  not  sug 

'  gest  minimum  cutting  scores.  ETS  does 
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not  icll  colleges  how  much  lo  weigh  tlie 
SAT  scores  in  the  dccision'making  pro- 
cess .md  expressly  warns  ihem  against 
placing  loo  much  emphasis  on  the  SAT 
or  any  other  single  indicator.  ETS  sim- 
ply serves  as  the  contractor  of  tlic  Col  lege 
Boards  to  build,  score,  and  report  Uie 
scores  on  a  set  of  tests.  For  example,  a 
1978-79  College  Board  survey  (see  Ler- 
ner,  1980,  p.  128)  reported  that  only  30% 
of  2,600  colleges  surveyed  who  used  the 
SAT  set  minimum  cut-off  scores  on  the 
SAT  As  mentioned,  many  other  colleges 
do  not  even  require  tlie  SAT.  As  Lerner 
pointsout,  "The  inevitableoverall  result 
IS  that  V  irtually  all  literateand  numerate 
students  and  many  semi-literate  or  even 
illiterate  ones  can  find  some  college 
which  will  accept  them,  if  ihcy  can 
somehow  arrange  to  pay  the  fees"  (1980, 
p.  128).  Certainly,  the  evidence  suggests 
thai  the  majority  of  students  are  admit- 
ted lo  the  college  of  their  first  choice 
(This  would  not  be  quite  as  true  of  cer- 
tain professional  schools,  such  as  law 
schoqls.) 

Second,  there  is  an  underlying  theme 
in  the  report  that  if  students  do  not  get 
into  college,  it  is  unfair  and  a  detriment, 
both  to  the  individual  and  to  society.  At 
the  undergraduate  level  it  is  particularly 
doubtful  that  Aot  admitting  a  student  to 
a  selective  college  is  of  any  long-range, 
harm  to  the  individual  or  society.  There 
are  plenty  of  colleges  that  will  admit 
anyone  with  a  high  school  diploma— 
<^ven  if  the  student  is  functionally  illiter- 
ate. If  thedecision  made  by  a  college  with 
admission  standards  to  reject  the  student 
is  wrong  and  the  student  is  capable  and 
motivated,  he  or  she  will  Ukely  do  just 
what  Gary  Vladnik  did.  be  an  academic 
success.  If  the  decision  is  correct  (and 
even  Nairn/Nader  admit  the  chances  are 
better  than  50-50  that  it  is),  the  student 
likely  will  be  better  off  at  a  less  competi- 


tive college, 


At  the  professional  school  level,  such 
as  in  law  sfehools,  it  may  be  true  that 
qualified  candidates  get  turned  awgy; 
but  with  the  current  surplus  of  lawyers, 
that  does  not  harm  society.  Whether  or 
not  it  harms  the  individual  is  more 
debatable.  If  there  is  a  surplus  of  attor- 
neys, would  it  be  good  for  an  individual 
to  be  admitted  and  graduate  from  law 
school  if  he  or  she  has  less  aptitude  for 
law  than  most  other  lawyers?  As  Brown 
(1980)  points  out: 

To  really  gauge  ihe  importance  of  the  lesi,  it 
might  ...  be  useful  lo  ask  what  happens  to 
people  who  apply  to  professional  schools  and 
arc  turned  down  . . .  turned  down  by  the  law 
schools,  docs  the  candidate  go  on  to  pursue  a 
Ph.D.  in  history?  What  percenisfge  of  the 
rejected  applicants  continue  to  apply  until 
they  are  finally  Selected?  What  happens  to  the 
rest?  When  all  is  said  and  done,  how  signifi- 
cantly did  the  test  affect  the  life-chances  of 
individuals  who  already  hayc  bachelor's  de- 
grees and  are  motivated  enough  to  want  to  go 
further?  (Brown,  1980, pp.  50-51) 

A  third  underlying  theme  of  the  report 
that  comes  through  in  tlie  first  chapter 
(although  not  perhaps  illustrated  in  the 
Gary  Vladnik  example)  is  that  somehow 
rejection  for  reasons  of  test  scores  causes 
a  more  painful  upheaval  than  rejection 
for  reasons  of  low  interview  ratings,  low 
high  school  grades,  insufficient  letters  of 
recommendation  from  influential  advi- 
sors, or  poor  letter-writing  skills  of  the 
student's  high  school  counselor.  The 
point  is,  if  rejection  decisions  are  made, 
soine  individuals  will  be  disappointed. 
Decisions  based  on  test  scores  should  be 
no  more  painful  than  decisions  based  on 
other  reasons. 

ETS  LARGE  AND  EFFICIENT 

Chapter  2  of  the  report,  ''Rosedale- 
Pow  er  and  Privilege  at  ETS,*'  is  devoted 
to  condemning  ETS  for  its  size,  effi- 
ciency, and  concerrt^or  quality. 
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From  around  ihc  vorld,  \uswvt  shu  ts  .11 1 
rciurnrd  10  hiMdquaricrs  in  Priiucton.  New 
Jersey.  Propfllcd  by  jcis  of  conipirsscd  .nr. 
ihfsf  nrc  passed  singlr-file  through  Ihc  entry 
chute  of  an  electronic  scoring  ni.ichinr— the 
cusiom-bdilt  Wcsiinghousr  MRC  inaik'scn- 
sitivc  scanner.  Scanning  at  the  rate  of  over 
three  sheets  per  second— 21.000  answer  sheets 
per  hour— the  MRC  scores  }>eiKiI  marks  rep- 
resenting the  answers  to  milhous  of  inutiipli 
choice  questions  each  year.  Jhe  scores  are 
printed  out  and  forwarded  to  the  mail  room 
where  230.000  letters  are  processed  in  an  a^er 
.  age  day.  (Nairn.  1980.  pp  32-33) 

Taken  out  of  context,  wtTrnighi  think  ilic 
above  quote  an  accoiadc,  but  in  tomexi. 
it  is  obvious  Nairn  says  all  this  with 
disapproval. 

At  another  |x>int  itfihc  chapter.  ETS  is 
criticized  for  requiring  all  cai^didaies  for 
the  LSAT  *'io  present  a  photo  ID  at  the 
lest  center,  give  a  handwritin^r  sample, 
sign  a  pledge  that  they  wcre»  indeed,  who 
they  said  they  wcre»  and  submit  to 
thumbprints''  (Nairn,  I980»  p.  31).  Why 
did  ETS  do  this  terrible  thing?  It  was  a 
response  "to  reports  that  candidates  were 
hiripg  impersonators  to  boost  their 
LSAT  scores"  (p.  31).  Again,  tt  seems 
most  people  would  praise  ETS -for  this 
response  to  curtail  cheating.  Nairn/ 
Nader  condemn  them  for  iti 

PRRDICTIVE  VALIDITY 
In  Chapter  3,  "Five  Percent  of  Nothing. 
Aptitude  TcsiTng,  The  Respectable 
Fraud"  ^and  in  the  accompanying  foot 
notes  a^^  the  end  of  the  book).  Nairn 
makes  some  obvious  statistical  mistakes. 
The  most  obvious  one  is  the  averaging  of 
the  separate  validities  of  the  i\vo  parts  of 
theSAT,  rather  than  using  the  validity  of 
the  whole  test  (see  footnote  15  to  Chapter 
3,  p.  417).  Thus»  he  averages  37»a  valid- 
ity coefficient  for  theSAT-V  and  .32  for 
the  SAT-M  and^squares  tl^s  number  to 
get  an  incorrect  coefficient  of  determma 
lion  of  1 1.9.  He  then  incorrectly  inter- 
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preis  this  as  a  percentage  of  perfect  pre- 
diction and  suggests  that  the  SA  T  pre- 
dicts grades  only  ll.9?'o  better  than  ran- 
dom* prediction  with  a  pair  of  dice  (p. 
*59).  / 

Later  in  the  c^iapier.  Nairn  repoiis 
that  "inclusion  ofSA  T  scenes  in  the  pie- 
die  live  process  impro\es  the  predict  ion 
of  college  grades  by  .aii  a\erage  of  only' 
five  percent  or  less  *  (p.  66).  He  arrives  at 
this  figure  by  computing  the  coefficient 
of  forcasting  efficiency  (I  ->/l  -  ).  For 
example,  for  1971,  the  index  for  high 
school  grades  al(5ne  was  13,4.  and  for 
tests  and. grades  conibined  was  18.5.  The 
difference  is.  of  course,  5.1.  but  as  the 
ETS  response  points  out.  this  is  a  pment 
improvement  of  38%  (5.1  I3.U'(ET.S. 
M980b.p.  19)  Yet.  Nairn  has  made  much 
of  his  "5%  of  nothing"  claim.  Further,  as 
the  ETS  response  points  out.  in  quoting 
Cronbach  and  Gleser  (1965),  the  index  of 
forecasting  efficiency  is  not  an  index  that 
should  be  used  in  e\aluating  tests  for 
selection  purposes. 

Elsewhere  in  chapter  3  Nairn  suggests 
that  extreme  degiees  of  anxiety  are  likely 
lo  iiiterfercwiih  test  performance  (p.  86). 
that  the  multiple-choice  format  could  , 
livor  certain  kinds  of  personalities  (p. 
88);  that  paid  coaching  may  improve  a 
person's  score  and  that  this  raises  the 
question  of  equity  (p,  97),  that  if  a  cut-off 
score  IS  used,  a  single  point  can  hi  the 
difference  between  acceptance  and  rejec- 
tion (p.  156).  and  that  such  large  deci- 
sions about  a  person's  future  shouhl  not 
be  based  on  such  small  samples  of  per- 
formance (p.  159). 

Why  all  these  points  are  made  about 
tests  but  not  interMew^  or  previous 
grades  is  puz/ling.  Certainly,  extreme 
anxiety  is  likely  to  interfere  with  inter- 
view performance,  an  interview  may 
favor  certain  kinds  of  personalities,  peo- 
ple can  be  coached  to  do  well  on  inter- 
view s,  if  a  cut-off  score  is  used  from  any 
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type  of  diijli.  a  single  ix)int  could  make  ii 
diffcreiicy  Ixiwcfii  aacpiancc  and  rejec- 
tion; an<i(  an  interview  is  a  smaller  sam- 
ple of  performance  (in  the  sense  of  time) 
than  a  lest.  But.  Nairn  prefers  not  to 
make  diese  points.  Basically,  the  whole 
report  ignores  the  limitations  of  other 
sources  of  data  for  decision-making  as 
well  as  the  extent  to  which  these  other 
measures  arc  currently  bcihg  used. 

HISTORY  OF  TESTING 

Chapter  t,  "The  Worih  of  Other  Men 
The  Science  of  Mental  Mcasurcmeni  and 
the  Test  of  'l  ime/'  is  a  somewhat  biased 
review  of  the  history  of  testing  in  ihe 
Ufiited  Slates.  Much  is  made,  for  exam- 
pie,  of  the  eugenics  [X)sition  ascribed  to 
Calton  and  rermay.  and  the  use  of  test 
data  in  immigration  decisions,  quoting 
K,inun  (1971)  as  follows  about  the  192-1 
Immigration  An: 

The  law,  for  which  the  science  of  mrmal  i«i- 
ing  may  claim  subsiantial  credit,  rcsultid  in 
Ihc  dt-ailis  of  Iiurally  hundreds  of  ihouwnds 
of  vitiims  of  Ihe  Nan  biological  thcorisis.  (p. 
27) 

One  searches  in  vain  for  any  evidence 
that  tVairn  has  read  any  of  the  more  bal- 
anced views  of  the  history  of  measure- 
ment such  as  that  written  by  Cronbach 
(1975),  who  points  out  that  "proponents 
of  testing,  from  Thomas  Jefferson  on- 
ward, have  wanted  to  open  doors  for  ihe 
talcnicd  poor,  in  a  system  in  which  doors 
often  dre  oi>cned  by  parental  wealth  and 
status"  (1975,  p.  1). 

Nairn  quotes  Thorndike  in  a  disap- 
proving manner  when  Thorndike  sug- 
gested that  "the  able  and  good  should 
acquire  power.  In  order  to  support  the 
truth,  defend  justice  and  restrain  folly, 
snperior  men  should  acquire  power" 
(Nairn,  p.  193),  The  writing  does  not 
make  it  totally  clear  whelhcr  Nairn  is 
opposed  to  the  able  and  good  acqnirhig 


power  or  op|X)sed  to  the  use  of  test  data 
to  help  determine  the  able  and  good.  I 
rather  hope  the  latier.  If  the  former,  then 
would  we  want  ihe  incompetent  artd  evil 
to  acquire  power?  I  would  not.  In  fact,  I 
would  abhor  such  an  occurrence  so 
much  that  I  would  want  to  use  as  much 
data  as  are  available(including  test  data)  • 
to  decrease  the  odds  of  such  an  occur- 
rence. 

CLASS  VERSUS  MERIT? 

Chapter  5,  "Class  In  the  Guise  of 
Merit."  presents  the  argument  that  be- 
cause Sj\T  scores  are  related  to  income, 
they  must  not  be  related  to  merit— a 
strange  argument.  Evidently,  Nairn  has 
not  heard  of  sociological  studies  such  as 
those  reported  by  Havighurst  and  Ncu- 
garten  (J975),  uhich  show  considerable 
within  lifetime  and  cross-generation 
changes  in  social  class.  Waller  (1971) 
found,  for  example,  that  sons  who  rise 
above  the  parent's  socioeconomic  status 
(SES)  score,  on  average,  better  on  intelli- 
gence tests  than  sons  whose  SES  is  lower 
than  that  of  their  parents.  The  United 
States  does  have  a  somewhat  pcrrneable 
social  class  system  where  financial  ad- 
vancement is  based,  at  least  in  part,  on 
merit.  Thus,  one  would  expect  that  if  the 
SAT  measures  merit,  and  if  merit  Is 
related  to  social  class,  then  a  correlation 
between  SAT  and  income  should  exist. 
Such  a  correlation  is  another  bit  of  data 
in^the  network  lhat  would  support  the 
construct  validity  of  thcSAT.  To  find  no 
correlation  between  the  SAT  and  family 
mcoitie  would  be  evidence  against  the 
con^tnirf  validitv  of  the  SAT 

Another  incorrect  implication  of  the 
Nairn/Nader  report  is  that  tests  are  per- 
petuating social  c?asses  by  keeping  poor 
people  out  of  college.  This  is  simply  not 
true.  Fricke(1975.  p.  1 10)  demonstrated, 
for  example,  that  if  admission  to  the 
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(rcshmjn  class  jt  the  l«  nivcrsiiy  of  Mich- 
igan had  been  dcicrmined  oitirdy  by 
academic  aptitude  lesi  scores,  a  majority 
of  freshmen  wou!d  have  come  from  low 
SES  backgrounds  raiher  than  ihe  lyjiical 
10.%  to  15%  actually  admitted.  Using  only 
the  incorrectly^  presumed  "biased"  test 
scores  would  not  decrease  but  increase  by' 
a  factor  of  4  or  5  the  number  of  loW'SES 
students  auending  the  University  of 
Michigan.  Of  course,  no  one  advocates 
using  only  test  scores  to  make  decisions.  I 
am  only  pointing  out  that  it  is  not  low 
test  scores  that  are  keeping  low-SES  siii- 
dents  (in  general)  out  of  college. 
The  ETS  response.  Test  Scores  and 
-  Family  /ncomt  (ETS,  1980a;,  makei  the 
folio wmg  responses  to  three  major  asser- 
tions made  by  the  Naim/Nader  repoit. 

I.  Assertion.  That  ETS  ha » rUiempied  to  sup- 
press information  on  the  rdatioRship  of  icu 
scores  to  students'  fumily  incomes- 

Fact.T^Cij^ia  from  which  Nairn  worked  is 
drawn  frpm  a  scries  of  reporis  piibhshcd  by 
the  College  Board  since  1971-72  and  distril> 
utcd  to  aver  15,000  institutions  and  iiidjwdu 
"als  annilally.  ^ 
2  Assemon.  That  the  relationship  uf  SAT 
scores  (o  income  is -inordinately  htgh^that 
SAT  scores  and  Jfami'Iy  income  '"ank  itildents 
in  nea/ly  the  same  way.  | 

Facl.  While  average  scores  >ire  higher  f^: 
studeiits  from  families  with  higher  incomes^ 
students  from  each  income  level  obtain  the 
full  ringe  of  SAT  scores.  Nearly  one-third  of 
the  jvtudcnts  with  family  incpmes  bciow 
I6.00H)  rank  in  the  top  half  of  the  total  group 
in  tgirms  of  SAT  scores.  Other  measures  of 
educlitional  achievement  show*  a  siinilai  reKi- 
tionjhip  to  income. 

y  Alseriion:  That  tests  are  a  major  inslrti- 
mer/t  in  preserving  a  social  status  quo.  in 
denying  opportiuiity  to  students  from  poor 
and|  working  class  families. 

Fact:  The  admissions  anu  financial  aid 
policies  and  practices  of  colleges  are  dcsign'/u 
to  expand  opportunities  of  low-imomc  stu- 
dents. Vsc  of  admissions  tests  has  also  con 
tnbutcd  lo  increased  access  of  disadvantaged 


:itudcnts  lu  higlur  education.  (ETS.  1980a.  p. 

6)  ^ 

Another  response  to  the  Nairn/Nader 
report  by  ETS  is  the  following  state- 
^  ment: 

At  one  pom  t  Nairn  gives  a  figure  of  10  for  the 
SAT  income  correlation,  which  ht  states (in- 
toriectlv)  'is  higher  than  the  correlation 
which  ETS  claims  to  have  found  U'lwmi 
scores  and  the  first  year  grades  the  SAT  is 
supposed  to  predict'  (p  203).  He  d(H's  not 
indicate  that  this  estimate,  which  he*  attril. 
utes  to  Doerni«inn  (»968j.  was  Iwscd  on  re- 
search using  other  tests,  not  the  SA  I".  Nor 
docs  Nairn  quote  the  following  from  Doer- 
man  n  tp.  152)  in  the  present  study  an  initial 
selection  of  0  4  was  made  from  among  the 
plausible  range  of  chojces  suggested  by  the 
literature  previously  noted.  While  chosen  as  a 
best  estimate,  it  also  seemed  to  be  a  coiiserva* 
tivc  (hoiee  for  the  purposes  of  tins  study,  that 
IS.  of  the  mosi  plausible  choices  it  wa%  the 
highfst  one . . .'  (italics  added) 

The  typical  correlation  of  SA  I"  scores  with 
4-ollcge  grades  (CPA)  within  colleges  con- 
dueling  \alidtty  studies  is  A\.  This  correla- 
liun  IS  not  direetl,y  euinparable  to  the  SA  I 
income  correlation  of  .29  ciced  abo\e.  since 
the  SA  T  CPA  correlations  are  computed  on 
selecied  gioupsof  adiiiit(ed'ai]denroIle<*  stu- 
dents. T'he  typical  (.orrehitiun  of  SAT  scores 
and  income  for  these  restricted  groups  is 
mu,ch  smaller  than  the  value  of  .29  found  for 
aii  unrcstrutcd  sample  of  SAT  takers.  (E  TS, 
1980a.  p.  8) 

This  last  quote  serves  as  another  illustra- 
tion of  the  bias  in  the  Nairn /Nader 
Report. 

BARRIER  TO  THE  BAR? 

Chapter  6,  *'ETS:  Barrier  to  ihc  Bar," 
states  that  the  number  of  applicants  to 
U.S.  law  schools  exceeds  the  number  of 
available  places  by  a  ratio  of  2  to  1,  that 
by  1979  all  of  the  ABA  accrcdited  law 
schools  used  the  LSAT  to  screen  their 
applicants,  and  that  the  ETS  Multistate 
.Bar  Examination  (MBE)  has  decreased 
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ihe  iinix>riancf  of  ihc  siaie-prt'parcd 
essay  gucsitons  on  ihc  bai^'^^tam;  The 
rcpon  quotes  Lerncr:  "Most  American 
lawyers  and 'Judges  praciicing  today 
•  would  never  have  gpficn  nuo  law  school 
ai  all  if  ihey  had  had  to  compete  against 
the  inflated  standards  whichjiow  govern 
admission"  (Lerncr,  1977,  p.  6). 

If  all  this  is  true  (and  I  assume  it  is), 
what  it  means  is  that  we  should  be  able  to 
raise  standards  in  our  law  schools.  Per- 
haps tnis  is  bad,ibut  it  seems  like  a  good 
thing  to  me. The  news  reports  in  Michi- 
gan concerning  the  number  of  appli- 
cants who  have  failed  the  bar  exams  in 
the  past  two  years  do  not  indicate  that- 
our  law  school  graduates  are  overquali- 
fied  for  their  profession.  (Incidentally, 
one  report  charged  that  the  essay  portion 
6f  the  LSAT  was  graded  too  harshly  by 
Traders  who  wanted  ^o  limit  competi- 
tion. An  attorney  who  was  a  reader  for 
the  exams  responded  in  pari  by  assorting 
that  he  believed  it  reasonable  to  expect  a 
law  school  graduate  to  be  able  to  spell 
defendant—which  many  could  not  'io' 
Whether  or  not  you  agree  that  is  a  reason- 
able expectation,  this  example  should 
indicate  that  increasing  the  weight  of  tlie 
essay  portions  would  ftot  be  likely  to 
decrease  the  complaints  from  those  who  * 
fail,  nor  would  it  be  likely  to  result  in 
'  fairer,  more  reliable  and  valid  data.) 
Lerner,  by  the  way,  objects  to  the  way 
she  is  referenced  and  quoted  in  the  Nairn/ 
Nader  report. 

There  are  ux  references  to  my  work  m  the  test 
of  the  Report ...  and  all  make  it  appear  as  if 
my  analysis  of  the  worth  of  lest  scores  m  selec- 
tion systems  is  or  was  congruent  with  that  of 
the  Naderiies.  In  fact,  it  is  not  and  never  was. 
The  Naderiies  argue  against  all  uses  of  stand- 
ardized test  scores  in  all  selection  situations; 
what  1  argui-d  against  was  an  excessive  re- 
liance on  test  scores  to  make  h^irspiii  distinc- 
tions between  high-scoring  individuals  in 


hyperselectivity  situations,  a  very  different 
m'ltter. 

This  is  hardly  an  argument  against  any  use 
of  the  LSAT  i  n  (aw  school  selection,  let  alone 
an  argument  against  the  use  of  standardized 
tests  in  selection  siiuaiions^generally.  And  it  ^ 
i<  most  fmphaiicaHy,noi  an  argument  for  the 
"new'*  subsiituje  criteria  ih5ii  the  Naderiies 
and  their  friends  are  pushing:  subjective  ap- 
praisals, inevilably  political,  bf  the  worth  of 
candidates'  extra  curricular  activities  and  at- 
litudes^  (Lerner,  1980,  pp.  137-139) 

ETS  BUSINESS  WITH  THE  * 
STUDENTS 

Chapiter  7,  "The  ETS  VVay  of  Doing  Bus- 
iness: Student  Consumers  in  Captivity," 
raises  concernsabout  the  "monopoly"  of 
ETS  in  the  -esting  market,  the  lest  fees 
themselves  as  a  barrier  to  hi^jher  educa- 
tion, the  contractual  relationship  be- 
,  twecn  ETS  and  the  tcsi  taker,  ETS  at- 
tempts to  minimize  cheating  JNairn* 
seems  to  disapprove  in  this  chapter^s  he 
did  earlier);  and  the  potential  for  ETS 
clerical  errors  in  scoring  and  rep6rting 
exam  scores.  None  of  these  concerns 
troubles  me  much,  bufihcy  might  oth- 
ers. ETS  does  have  the  best-selling  tests 
in  some  areas  of  the  market  and  the  only  , 
tes(s  in  some  other  markets.  They  have 
these  because  the  people  who  want  t6 use 
test  data  require  ETS  tests  and/or  con- 
tract with  ETS  to  build  tests  for  tham. 
But  ETS  docs  not  always  win  against  th> 
Competition.  For  example.  The  Ameri- 
can Institute  for  Research^(AIR)' was 
awarded  the  lajt  contract  for  the  Medical 
College  AdmissionsTest.  My  in\erpreta- 
lion  of  the  "monopoly"— though  not 
Nairn's— is  that,  in  general,  the  market 
place  for  test  purchasing  and  test  use  is 
fairly  open.  Test  publishing  is  a  compct- 
itive^btisiness.  The  obvieus  exceptions 
are  the  tests  produced  by  the  U.S.  Gov-, 
ernment.  Through  the  Civil  Service 
Commissjon  (Office  of  Personnel  Man- 
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^  agemcni)  and  the  Dt-parimcnTs  of  Labur 
and  Defense,  the  federal  gover^iment 
produces  its  ovvn  tests  and  administers 
them  to  about  1.5  million  persons  annu 
ally  (see  Lerner.  1980,  p.  125). 

The  test  fees  issue  seems  minor.  A! 
though  a  1976  College  Board  report 
stated  that  test  fres  themselves  toiistiiutt 
a  barrier  to  higher  education  for  the  very 
pQor«  I  peisonally  am  skeptical.  1  here 
are  a  great  many  costs  associated  with 
college  attendance.  If  one  c  .n  not  come 
up  v.»ith  the  money  to  p;y  for  an  entrance 
exam,  it  is  doubtful  that  the  othej;  tosis 
could  be  handled  either.  At  «in>  lait,  the 
poinr  IS. moot  because,  as  Nairn  admits, 
the  College  Boar^  and  ETS  have  indi- 
vidual fee  waivers  for  needy  students. 
Nairn^objects  to  thts  system  that  requires 
a  student  lo  present  proof  of  poverty. 
'  Those  reluctant  to  endure  this  rue  . . . 
,  must  pay  the  fee  or  lose  the  opportiniiiy 
to  taice  the  Vest"  (Nairn,  1980,  p,  262>. 
But,  of  course,  if  a  student  is  not  willing 
to  admit  to  poverty,  it  would  also  be 
rather  difficult  to  get  a  scholarship  or 
any  kind  of  financial  aid  based  on  need 
so  the  test  expense  would  not  really  be 
the  delimiting  factor. 

The  business/ contractual  relation- 
ships , between  ETS  and  the  students 
trouble  metHot  at  all.  Nor  does  the  fact 
ihat  ETS  attempts  tu  minimue  cheating. 
The  potential  for  ETS  scoring  errors,  oP 
course,  exists.  I  believe  ETS  Uies  hard  at 
quality  control,  bui  obviously  they  are 
not  perfect,  and  thpy  could  try  harder. 

6TS  A  TWO-CLASS  INSTITUTION? 

Chapter  8,  "Inside  ETS.  The  Soft  Insti 
tution/^devotes  77  pa^es  to  such  topics 
as  the  nonprofit  privileges  ETS  enjoys, 
the  relationship  between  ETS^and  client 
boards  sui  U  as  The  College  Board  and 
the  Law  School  Admission  Cou nctl»  and 
the  notion  that  ETS  is  a  two-class  sys* 
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um.  No^'KU'asiirement  issues  come  up  in 
this  chapter— It  is  just  a  general  attack 
on  ETS.  The  attack  does  take  some 
strange  forms.  For  example,  consider  the 
following: 

£rs  reprcscmativcs  are  flown  at  Luiiiptiiiy 
(Lxpeiisc  lu  .i>MKi(iiion  mcciuigs  wiui  conven- 
tions »i round  the  world  whrii  .in  officer  de- 
tcriiiiiios  th.it  such  jttcndaiue  i$  justified  for 
professional  or  business  reasons.  ETS  staff  are 
^  eiKoiiraged  lo  publish  piipcrs  or  books  in 
du'ir  fields  and  hold  office  in  their  profes- 
sional societies.  (Nairn.  1980.  p.  318) 

riicsc  are  indeed  curious  "criticisms". 
Professional  organizations  have  long 
been  ad\ocatingsuch  behaMors  as  desir- 
able professional  development  and  in- 
volvement. 

The  notion  that  ETS  has  a  two-class 
system  takes  up  30  pages  of  this  chapter. 
What  the  notion  boils  down  to  is  that  the 

professionals  ai  ETS  are  paid  more  than 
theclerks  There  is  a  suggestion  that  this 
fact  disproves  the  ETS  claim  that  they 
are  like  a  university!  Chauncey  and  his 
follovvers  are  taken  to  task  for  trying  "to 
boost  the  productivity  and  decrease  the 
relative  numbers  of  ETS*  non-profes- 

*  sional  clerical  staff**  (Nairn.  1980,''p. 
3^6).  Nairn  suggests  that  "n on- profes- 
sionals at  ETS  have  been,  above  all,  a 
cost  lo  be  controlled  through  speedups, 
efficiency  studies,  and  careful  monitor 
ing  of  their  activities"  (p,  317,  italics 
added).  Nairn  presents  no  evidence  that 
the  "abo\e  all"  portion  of  the  quote  is 
true  and  logic  alone  tells  us  it  cannot  be. 
If  that  were  true,  the  clerkssimply  would 
have  been  dismissed.  Why  a  concern  for 
efficiency  is  bad  and  why  the  fact  that 
professionals  are  paid  moie  than  clerks  is 
bad  escapes  my  political/social  reason- 
ing abilities,  although  I  do  recognize  cer- 
tain governmental  forms  have  been  ad- 
vocated by  others  that  would  promoie 
inefficiency  and  eciual  pay  for  unequal 
work. 
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TRUTH  IN  TESTING? 

Chapter  9,  "Rays  ofjSunlighu  Winds  of 
Change."  is  devoted  lo  piomoiing  so- 
called  iiuih-in-iesiing  legislation,  such 
as  the  LaVallc  Bill  passed  in  New.York 
m  1970.  In  this  final  chapter,  we  are  pre- 
scnic'd  with  the  typical  proargunients  for 
such  legislation.  Rather  thiui  pijsent 
various  arguments  and  counter  argu- 
ments in  this  article,  I  refer  tfie  readers  to 
ahe'Educaiibnal  Commission  oPtFe 
States  (iocumcni  Searching  for  the  Truth 
About  'Truth  In  Testing'  Legislation 
(Brown.  1980).  I  cannot,  however,  resist 
quotmg  a  bit  from  this  chapter.  We  are 
told  that  after  the  LaValle  Bill  passed  the 
iwo  Houses,  'the  testing  mdustry  turned 
.11$  lobbying  and  letier-writmg /orc«  on 
Governor  Hugh  Carey.". but  "Ralph 
Nader  had  a  conversation  with  the  Gov- 
ernor" (p.  374.  Italics  added).  Ah,  but 
isn't  semantics  a  fun  thing? 

RESPONSES  BY  ETS 

Test  Scores  and  Family  Income  and  Test 
Use  and  Validity  are  short  (11  and  27 
pages,  respectively)  responses  by  ETS  to 
the  Nairn/Nader*Report.  I  have  already 
quoted  what  I  consider  to  be  the  most 
important  parts  of  the  first  document, 
but  I  urge  the  reader  to  yead  the  rest  of  it. 
The  second  report  Te^t  Use  and  Validity 
DoJnis  out  thesamestatistical  errors  that 
Inirn  made  and  that  I  have  already 
noted.  An  introductory  note  by^AVilliam 
Turnbull  gives  us  an  accurate  overview 
of  the  document: 

This  paper  presents  a  caieful  review  of  the 
Nairn  analysis  Jnd  finds  that  in  fan  it  is 
incorrect,  as  experience  and  research  .have 
told  us  for  some  time,  test  scores  do  indeed 
coniribiiie  useful  information  on  which  to 
base  admissions  decisions.  The  Nairn  exer- 
cise manages  to  arrive  at  the  opposite  conclu- 
sions through  a  combination  of  selective 


,rff>orting  and  statisncal  error,  and  presents 
them  with  a  rhetorical  flourish  that  fits  the 
evident  intent  to  demolish  the  tests  rather 
than  enlighten  the  reader. 

It  would  be  a  disservice  tostudcnts.  parents, 
institutions  jnd  the  public  at  large,  however, 
lo  leave  unanswered  an  attack  that  marshall^ 
half  truthstocreateanadvocate'scascagainsi 

the  use  of  test  scores  as  oneelemcnt  in  admis- 
sions. This  paper  is  intended  to  help  clarify 
some  of  ifielmportant  issues  that  may  have 
been  confused  by  the  Nader/Nairn  report 
(ETS,  1986b,  p.  5)  ,  - 

SUMMARY  .         >  .  - 

In  summar>.  theNaira^ader  document 
IS  a  big,  biased  blast  at  testing  in  general 
and  especially  at  ETS,  Why?  Because 
"the  CTtdibiliiy  of  ETS  is  essential  for  its 
survival"  (Nairn.  19^0.  p.  292).  The 
report  attempts  to  put  some  chinks  in  (he 
KT<  armor  of  credibility— or  perhaps 
destroy  it  completely.  But  why  use  such  a 
large  weapon?  Perhaps  because  the  anti- 
testing  forces  would  like  to^  think  of 
themselves  as  David  and  of  the  testing 
industry  as  Goliath.  (Of  course,  David 
used  only  a  small  smooth  stone,  but  then 
God  was  on  his  side.)  The  analogy  ' 
doesn't  hold,  as  pointed  out  by  Lcrner: 
Theantitesting  organizations  areindeed 
quite  powerful  (Lerner.  1980).  The  big 
biased  blast  will  likely  be  successful  in 
stirring  up  the  emotional  forces  of  the 
nonscholarly  ETS  foes.  It  is  not  likely  to 
win  many  converts  from  am9ng  those  * 
who  favor  testing  and  prefer  to  make 
decisions  based,  ai  least  in  pan,  on  dis- 
passionate scholarship.  I  hope  all  read- 
ers of  the  Nairn/Nader  Report  will  also 
read  the  ETS  responses.  ETS  docs  not 
reign  in  the  pejorative  way  the  Nairn. 
Nader  report  implies.  But,  in  writing 
the  truth  about  testing,  the  Nairn/TMader 
reiDprt  has^re^ched  a  nadir,  and  ETS  still 
reigns  if  we  allo^v  data  and  logic  to  rule 
our  mindsP'  "  * ,  ♦ 
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Chairman  Perkins.  Thank  you,  Dr.  Mehrens.  We  have  now  been 
joined  by  the  distinguished  chairman  6f  our  postsecondary  commit- 
tee. I  understand  Dr.  Johnson  has  arrived  and  you  are  scheduled  to 
be  the  next  witness.  Please  take  your  place  at  the  witness  table. 
You  may  proceed  as  you  wish.  We  welcome  you. 

STATEMENT  OF  SYLVIA  JOHNSON,  PROFESSOR  OF  RESEARCH 
;ShODOLOGY;  school  of  education.  DEPARTMENT  OF 

vsySmcAiiONAL  studies,  Howard  university 

Ms.  Johnson.  Thank  you.  ,   ...  u  r  ^.v,..^  

I  am  glad  to  have  the  opportunity  to  testify  before  the  subcom- 
mittee this  morning.  I  will  begin  by  giving  you  some  brief  informa- 
tion in  terms  of  my  background.  I  am  an  associate  professor  at 
Howard  University  in  the  School  of  Education  in  the  area  of  re- 
search methodology  and  statistics.  I  hold  a  Ph.  D.  degree  from  the 
University  of  Iowa.  While  at  the  University  of  Iowa  I  was  special 
research  assistant  in  testing  programs  and  my  degree  is  m  mea- 
surement and  statistics.  Years  ago  I  spent  1  year,  a  graduate  year 
at  Michigan  State  University  in  the  program  where  Dr  Mehrens 
"  teaches  and  I  have  a  masters  degree  from  the  area  which  Mr. 
Simon  represents  from  Southern  Illinois  University  and  undergrad- 
uate degree  from  Howard  University.  I  was  asked  to  make  my  com- 
ments in  terms  of  some  areas  related  to  measurements  that  have 
some  implications  for  the  bill  you  are  considering.  Specifically,  1 
waTasked  to,  comment  in  terms  of  the  use  of  tests, for  selection  and 
what  tests  can  and  cannot  dff.  I  would  like  to  begin  by  considering 
some  points  that  are  perhaps  less  technical  than  somfe  of  the  pomts 
that  might  be  raised  but  I  will  certainly  be  glad  to  go  into  more  , 
technical  points  if  desired.  ,  'J'-j 

I  think  we  need  to  be  aware  of  the  nature  of  measurement  and 
some  of  the  comments  I  will  make  here  are  related  to  a  publicabion    ;  r 
published  by  the  Institute  for  Study  of  Educational  Polid  at      /  , 
Howard  University  which  I  wrote  a  couple  of  years  ago  while  a  /  I 
"enTor  fellow  at  the  Institute.  In  terms  of  the  nature  of  measure-  ^ 
rSent-.  since  we  cannot  measure  minds  in  the  same  j^ay  ^  ""^Xe  / 
the  length  of  a  room,  all  educational  and  psychologica  measure-  ' 
rnent  is  done  indirectly.  We  never  are  measuring  psychological  fac-    /  • 
Mrs  directly  By  measuring  performance  or  behavior  on  some  task 
S-infer  the  leJel  of  achievement,  intellectual  functioning  or  some  / 
other  psychological  construction.  But  be(;ause  measurement  is  indi- 
rect dSes  not  mean  it  is  faulty.  In  fact  much  of  physical  measure- 
ment is  done  indirectly.  Inferences  are  made  because  of  certain 
SeSries  about  how  the  universe  operates.  These  m  ereiices  make  it 
possible  to  measure  from  distances  in  the  solar  system  to  distances 
between  and  within  atoms.  Physical  measurement  as  well  as  psy- 
choTogy  measurement  can  result  in  errors.  However,  our  errors  in 
psychological  measurement  may  be  particularly  hard  to  identify 
Ld  correct.  For  example,  if  I  say  the  combination  of  ingredients 
used  in  that  wall,  if  they  are  mixed  together  will  not  harden,  and  I 
attempt  to  test  that  theory  by  taking  a  stroll  over  into  the  adjoin-  - 
fng  Xce  in  this  direction  I  will  meet  with  some  solid  evidence  to 
refute  that  theory.  However,  the  social  scientists  lack  the  benefit  of 
such  firm  validation  or  invalidation  and  is  faced  with  a  strong  re-  , 
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sponsibility  for  careful,  thoughtful  analysis  and  empirical  valida- 
tion. In  testing  the  behavior  measure  used  as  the  basis  for  an  infer- 
ence is  the  test  score.  An  inference  is  then  made  to  a  level  of 
achievement,  aptitude,  personality,  interest,  or  some  other  human 
characteristic  which  cannot  be  measured  directly.  The  relationship 
between  this  test  score  and  the  characteristic  which  we  wish  to 
infer  may  not  be  the  same  for  all  examinees  particularly  for  many 
members  of  minority  groups  who  have  been  systematically  ex- 
cluded from  educational  benefits.  As  a  result  test  scores  alone  fre- 
quently are  not  such  measure  of  aptitude  or  other  psychological 
construpts-  for  minority  groups.  Leaders  of  minority  communities 
h^ye  seen  numerous  cases  of  discrepancy  between  ability  to  per- 
^^^lorm  and  measured  aptitude.  And  many  regard  tests  as  useless. 
The  reality  is  that  tests  are  increasingly  used  in  all  forms  of  deci- 
sionmaking. Their  use  and  misuses  need  to  be  more  fully  under- 
stood by  policymakers  and  community  leaders.  Many  factors  oper- 
ate to  attenuate  or  lower  test  scores  and  those  factors  tend  to  have 
the  greatest  influence  on  blacks  and  other  minority  applicants. 
These  include  factors  which  affect  the  actual  performance  of  indi- 
viduals on  the  tests  such  as  socioeconomic  status,  differences  in 
educational  opportunity,  motivation,  narrowness  of  content  of  the 
test,  atmosphere  of  the  testing  situation,  and  the  perceived  rel- 
evance of  the  test  to  .success.  They  also  include  factors  that^affect 
the  test  score  more  indirectly  3uch  ^as  composition  of  the  group 
used  for  item  tryouts  as  well  as  items  selection  and  item  analysis 
which  precede  the  standardization.  The  composition  of  the  stand- 
ardization of  groups  and  technique  and  procedures  are  employed  in 
item  construction.  Also  validity  and  appropriateness  of  tests  often 
differ  for  applicants  in  relation  to  the  same  future  performance  or 
criterion.  These  factors  attenuate  scores  and  result  in  validity  prob- 
lems raised  in  terms  of  measuring  scholastic  aptitude. 

When  we  use  tests  for  selecti'jn,  many  tests  as  you  well  know  are 
widely  used  for  graduate  professional  school  admissions  as  well  as 
for  admission  to  colleges.  Often  people  assume  that  a  certain  score 
01*  certain  cutting  score  automatically  eliminates  those  who  are  less 
able  and  chooses  those  that  are  better.  We  have  a  problem  that 
arises  when  it  is  assumed  that  if  a  certain  cutting  score  on  a  test 
eliminates  potentially  unsuccessful  applicants,  raising  that  score 
may  result  in  the  better  applicant  automatically  eliminating  more 
of  the  potentially  unsuccessful.  Tn  fact  this  is  not  always  the  case. 
,  That  IS  many  factors  need  to  be  ^considered  in  terms  of  college  ad- 
mission rather  than  a  single  criterion. 

A  rough  analogy  can  been  seen  in  the  following  situation. 

Suppose  one  wishes  to  board  a  bus  to  travel  some  distance  in  a 
large  city  where  there  is  an  established  bus  fare.  Let  us  assume 
that  fare  is  a  consistent  fare  for  going  whatever  distance  you  wish 
to  travel.  If  you  have  less  than  the  established  fare  you  will  not  get 
a  ride.  The  exact  fare  is  required*  Haying  more  money  will  not 
take  you  further  under  a  fixed  rate  schedule.  Whether  you  reach 
your  destination  does  not  relate  to  whether  you  have  more  than 
the  basic  fee  in  your  pocket.  It  relates  to  other  actions  you  may 
take  and  characteristics  you  may  have,  such  as  how  well  you  check 
the  route  map,  bus  schedule  and  whether  you  watch  to  see  if  you 
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are  nearing  your  destination.  Your  timely  arrival  relates  to  exter- 
nal factors  such  as  traffic  situation,  possible  accidents,  et  cetera. 

Let  us  carry  our  analogy  one  step  further.  Imagine  an  entire  col- 
lege of  individuals  waiting  to  board  this  bus.  And  some  have  the 
required  bus/fare  and  others  do  not.  The  bus  fare  will  be  one 
method  of  determining  who  rides  the  bus.  In  this  situation  there 
are  a  whole  set  of  antecedent  questions  that  determine  who  gets  a 
chance  to  drop  their  fare  in  the  box.  How  widely  were  the  bus 
schedules  and  route  information  distributed?  How  many  people  can 
the  bus  carry?  Who  regularly  rides  this  route  or  knows  other 
people  who  have  taken  this  bus?  Who  gets  in  line  first,  and  who  is 
driving  the  bus?  Once  the  bus  is  boarded  the  same  characteristics 
and  external  factors  determine  success  in  negotiating  the  system. 

An  educational  example  would  be  helpful  here  but  our  image  of 
the  test  that  is  the  general  public's  image  of  the  test  is  as  a  mental 
yardstick  which  makes  acceptance  difficult.  Let  us  conceive  of  the 
.  test  as  a  yardstick  that  varies  in  appearance  depending  on  the  pur- 
pose for  which  it  is  used;  a  medical  school  aptitude  test  used  to  pre- 
dict criterion  of  success  as  a  physician  could  be  viewed  as  a  yard- 
stick with  numbers  clearly  printed  in  integrals  halfway  up  this 
stick  and  blank  the  rest  of  the  way.  The  implication— this  is  a  rea- 
sonable measure  of  what  we  are  interested  in  up  to  a  certain  point. 
A^ter  that  we  need  to  look  at  other  yardsticks.  The  same  test  might 
be  a  blank  yardstick  when  used  for  another  purpose  such  as  pre- 
dicting success  as  a  sculptor  or  musician.  It  might  be  a  rubber 
yardstick  if  used  to  predict  success  in  high  school  science  courses. 
Even  though  the  type  of  content  is  appropriate,  the  inappropriate 
level  would  result  in  measurement  with  low  reliability  and  valid- 

"  ~^^he  personarStnbutes  and  characteristTcsThYrare  the  focus  of 
many  tests  are  complex  entities.  Test  developers  and  measurement 
researchers  are  aware  of  the  multidimensional  nature  of  intelli- 
gence and  other  aptitudes.  Earlier  writers  noted  the  general  im- 
pression that  intelligence  is  unit  dimension,  is  borne  out  by  the 
common  usage  of  th^  word.  We  speak  constantly  of  individuals  as 
having  high  or  low  intelligence  or  having  some  particular  degree  of 
intelligence.  This  practice  is  part  of  our  folklore,  an  example  of  our 
tendency  to  oversimplify  complex  concepts.  Verbal  tests  with  aca- 
demic type  tasks  are  used  to  measure  academic  aptitude,  general 
aptitude  and  intelligence.  The  justification  of  this  procedure  is  that 
when  nonverbal  and  performance  tasks  are  used  they , normally 
could  relate  highly  with  verbal  testing.  AnS,  thus,  therefore  are 
more  reliable,  easy  to  administer  and  cheaper  verbal  tasks  are  em- 
ployed However,  the  correlations  between  verbal  and  performance 
tasks  are  not  equally  high  in  all  groups.  They  are  most  likely  to  be 
high  in  those  persons  who  have  had  the  greatest  opportunity  to  de- 
velop their,  verbal  skills  maximally.  Those  with  the  greatest  envi- 
ronmental resources  for  the  development  of  traditional  verbal 
skills.  The  fact  other  tasks  may  more  accurately  assess  aptitude  in 
minorities  is  often  not  considered.  ,  i    •  i 

So -the  point  we  need  to  consider  first,  all  psychological  meas- 
urements are  not  the  same.  We  measure  characteristics  of  people 
by  inference.  The  same  test  score  does  not  mean  the  same  thing  for 
everyone.  The  score  of  500  is  not  always  a  500  is  not  always  a  500— 
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opposite  to  the  rose.  Nontest  information  may  give  better  clues  to 
potential  success  for  low  scoring  students.  However,  we  must  recog- 
nize that  nontest  information  can  have  the  same  weaknesses  as 
tests  in  terms  of  validity  and  reliability  and  again  must  be  used 
carefully.  This  means  the  complexity  of  decisionmaking  regarding 
the  future  of  our  young  people  must  be  appreciated  and  dealt  with 
accordingly.  There  is  no  simple  way  to  make  admissions  and  place- 
ment decisions.  Because  two  groups  different  substantially  on  the 
average  on  some  test,  such  as  SAT,  GRE,  AMCAT,  et  cetera,  does 
not  mean  one  group  is  brighter  than  the  other.  It  may  mean  there 
are  factors  in  the  test,  the  tested  and  the  test  taking  that  result  in 
these  differences,  typical  school  and  nonschool  experiences  of  one 
group  may  better  prepare  them  for  the  test  material,  may  even 
mean  one  group  is  better  prepared,  at  one  point  in  time  for  certain 
educational  experiences  but  it  does  not  mean  that  people  in  a  lower 
scoring  group  are  not  capable  of  competent  work  in  the  proposed 
course  of  study.  Even  though  national  legislation  regarding  tests 
has  not  been  enacted,  its  proposal  has  created  a  climate  within  the 
testing  industry  that  resulted  in  creative  approaches  to  openness  in 
testing  ami  increased  tolerance  to  those  within  the  industry  who 
have  previously  advocated  use  of  tests  for  opening  rather  than  clos- 
ing options.  Tests  probably  have  the  greatest  utility  in  providing 
continual  feedback  regarding  effectivness  of  educational  program- 
ing for  youngsters.  In  this  use  they  should  be  as  nonthreatening  as 
possible,  taken  when  the  youngster  is  ready,  often  by  computer, 
corrections  and  reasons  for  wrong  answers  provided  and  accompa- 
nied by  instruction  in  these  problem  areas.  When  used  as  rigid  ad- 
missions criteria  tests  only  serve  to  reinforce  the  bars  to  entry  and 
selective  programs  that  have  long  existed  in  other  ways  and  they 
discourage  creative  way  so  treating  instructional  material  to  make 
it  more  accessible  to  students  from  nontraditional  backgrounds.  I 
would  like  to  thank  you  for  your  time  this  morning  and  I  will  be 
happy  to  comment  further  and  my  written  presentation  will  be 
submitted. 

Chairman.  Perkins.  Your  written  presentation  will  be  entered  in 
the  record  without  objection. 
[The  prepared  statement  of  Sylvia  Johnson  follows;] 

Prkparki)  Statemknt  ok  Sylvia  T.  Johnson,  Ph.  D.,  Dkpartment  of  Psychoeduca- 
TioNAi,  Studies,  School  of  Education,  Howard  University,  Washington,  D.C. 

Good  morning  Mr.  Chairman  and  committee  members.  I  am  glad  to  have  the  op- 
portunit>  lo  speak  with  >ou  toda>  regarding  the  topic  of  the  use  of  testb  in  selection 
for  educational  programs. 

I  will  begin  with  a  brief  account  of  my  background  m  this  area.  I  have  been  a 
fa\.ult>  member  m  the  Department  of  Psychoeducational  Studies,  School  of  Educa- 
tion at  Howard  University  since  1971.  I  teach  graduate  courses  in  applied  statistics, 
research  met}iudo]og>,  and  measure ment»  and  I  supervise  Ph.  D.  dissertations  in 
educational  psychology,  I  received  my  Ph.  D.  from  The  Unj^versity  of  Iowa  in  Educa- 
tional Statistics  and  Measurement.  While  at  Iowa,  I  was  a  special  research  assist- 
ant, assigned  to  the  professor  who  was  also  the  director  of  Iowa  Testing  Programs. 
Several  years  earlier*  I  completed  a  year  of  advanced  graduate  study  at  Michigan 
State  University  in  the  area  of  Research  Design  and  Development. 

I  received  my  masters  degree  from  Southern  Illinois  University  at  Carbondale, 
and  *:omp!eted  my  undergraduate  work  in  mathematics  at  Howard  University. 

Three  years  ago,  I  spent  a  period  of  time  as  a  senior  visiting  fellow  at  the  Insti- 
tute for  the  Studv  of  Educational  Policy,  Howard  University.  While  there,  I  author- 
ized a  monograph  entitled  "The  Measurement  Mystique.'  Some  of  my  testimony 
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today  is  taken  from  "The  Measurement  Mystique."  However.  I  dp  not  sp^ak  for 
"XJSeS^^^^^^^^^^^ 

tant  to  remind  ourselves  of  the  nature  of  the  process  of  measurement 

Since  wTcannot  measure  minds  in  the  same  way  that  we  measure  the  length  of  a 
room  all  educational  and  psychological  measurement  is  done  indirectly.  By  measur- 
KKnce  ortehaviqr'on  some  task,  we  infer  th.  level  of  achievement,  intel- 
leciital  functioninK,  or  some  other  psychological  construct. 

Uadere  ^rminority  communi  seem  numerous  cases  of  discrepancy 

I  11  n^?„ai  abilitv  to  perform  and  measure  aptitude,  and  many  regard  tests  as 
u^l4  The  .reality  s  t^Tllis  are  increasingly  used  in  all  forms  of  decision 
mSg,  and  that  their  uses  and  misuses  need  to  be  more  fully  understood  by  policy 

'"HoT%rerr'resS'i'eve&  There  are  several  steps  in  the  process  of  construct- 

ten,  aiscussea,  ^,  .  .      .       norming,  or  standardization  process,  but 

the  test.  Here  the  hunches  of  writers  and  editors  are  literally  put  to  the  test  ,  oy 
seeing  how  well  available  subjects  actually  perform.  • 

OnL  the  tryout  items  are  administered  in  conjunction  with  an  actual  Previously 
Hpvpln^d  teK  ch  sen-er^  a  yardstick  forjudging  the  quality  of  the  new  items. 

wmmwmm 

SiSn  or  Zit?.Tg"p.  and  th.  Whmque,  .nd  pmodu,^  «n,to,^  m  U.m 
construction. 
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In  the  use  ot  test  fur  selection,  it  is  often  assumed  by  the  general  public  that  if  a 
particular  cutting  SLure  on  a  test  ib  useful  for  selection,  then  raising  that  cutting 
score  Will  be  even  better  in  seiectiun.  In  fact,  the  inclusion  for  pon  test  information 
may  give  better  clues  on  potential  success  for  lower-scoring  students.  As  a  cutting 
oLure  is  raised,  manv  puti^ntiallv  i>uccebbful  applicants  are  also  eliminated,  as  one 
seeks  to  eliminate  potentially  unsuccessful  applicants. 

Given  a  group  of  qualified  applicants,  the  fact  that  one  student's  test  scores  are 
somewhat  higher  than  those  of  another  does  not  mean  that  the  first  is  more  "quali- 
fied" than  the  second.  Some  basiC  level  uf  competenc>  should  be  establis'hed,  but 
be>ond  that  many  other  factors  should  be  used  tu  determine  the  changes  of  success. 

A  rough  anaIog>  can  be  seen  in  the  following  situation.  Suppose  one  wishes  to 
board  a  city  bus  to  travel  some  distance  in  a  large  city,  and  there  is  an  established 
bus  fare.  If  y(^u  have  less  than  the  fare,  you  will  not  get  a  ride.  Having  more  money 
will  not  take  >ou  farther,  under  a  fixed  rate  schedule.  Whether  you  reach  your  des- 
tination does  not  relate  to  whether  you  have  more  than  the  basic  fare  in  your 
pocket.  It  relates  to  other  actions  >ou  may  take  and  characteristics  which  you  ma> 
have,  such  as  how  well  you  check  the  route  map  and  bus  schedule,  and  whether  you 
watch  to  see  when  >ou  are  nearing  your  destination  so  that  you  can  he/td  for  the 
exit.  Your  timely  arrival  also  relates  to  external  factors,  such  as  the  traffic  situa- 
tion, possible  accidents,  etc. 

Let  us  carr>  our  analogy  a  step  further.  Imagine  an  entire  collection  of  individ- 
uals waiting  to  board  this  bus,  some  with  the  required  bus  fare,  and  others  without 
it.  Then,  the  bus  fare  will  be  one  method  of  determining  who  rides  the  bus.  In  this 
Situation,  there  are  a  whole  set  of  antecedent  questionS'that  determine  who  even 
gets  a  chance  to  drop  the  fare  in  the  box.  How  widely  were  the  bus  schedules  and 
route  information  distributed?  How  many  people  c^n_theJiUJiJL,arry?  Who  regularly 
rides  this  route  or  knows  other  people  who  have  takerTThis  bus?  Who  gets  in  line 
first?  And,  who  is  driving  thp  bus? 

Thus,  we  can  see  that  a  whole  set  of  factors  determine  success.  A  good  predictor 
an  this  case,  the  bus  fare^  can  measure  some  of  these  factors,  but  not  all  of  them, 
and  more  of  one  single  factor  does  not  necessarily  mean  that  one's  chances  of  suc- 
cess are  proportionally  increased. 

AA  educational  example  would  be  helpful  here,  but  our  image  of  the  test  as  a 
'mental  yardstick"  makes  acceptance  diffiLult.  Imagine  the  test  as  a  yardstick  vary- 
ing in  appearance  depending  on  the  purpose  for  which  jt  is  used.  A  medical  school 
aptitude  test  used  to  predict  the  criterion  of  success  as  a  ph>sician  could  be  viewed 
as  a  >ardstick  with  numbers  clearly  printed  in  even  intervals  nearly  halfwav  up  the 
stick,  and  then  blank  the  rest  of  the  way.  The  implication?  It's  a  reasonable  meas- 
ure of  what  we* re  interested  m,  up  to  a  certain  point.  After  that,  we  need  to  look  at 
other  "yardsticks." 

The  same  test  might  be  a  "blank  '  yardstick  when  use  for -another  purpose,  sQch 
iis  predicting  success  as  a  sculptor  or  musician.  It  might  be  a  "rubber  yardstick"  if 
used  to  predict  success  in  high  school  science  coursei/.  Even  though  the  type  of  con- 
tent IS  appropriate,  the  inappropriate  difficuit>  level  would  result  in  measurement 
with  low  reliability  and  validity. 

The  personal  attributes  and  chivacteristics  that  are  the  focus  of  many  tests  are 
complex  entities.  Test  developers  and  measurement  researchei  rare  aware  of  the 
multidimensional  nature  of  intelligence  and  other  aptitudes.  Paul  Horst,  an  early 
measurement  researcher  noted,  the  general  impression  that  intelligence  is  unidi- 
mensional  is  borne  out  b^  the  corjimon  usage  of  the  word  We  speak  constantly  of 
individuals  as  having  high  or  low  intelligence  or  of  haviAg  some  particular  degree  of 
intelligence.  This  practice  is  part  of  our  folklore  and  an  example  of  our  tendenc>  to 
oversimplify  complex  concepts". 

Verbal  tests  with  academic-t>pe  tasks  are  normally  (ised  to  measure  acifdemic  ap- 
titude, general  aptitude,  and  intelligence.  The  justification  of  this  procedure  is  that 
when  non  verbal  and  performance  tasks  are  used,  they  normaIl>  correlate  quite 
highly  With  verbal  tests,  and  thus  the  more  reliable,  easier  to  administer,  and 
cheaper  verbal  tasks  are  employed  However,  the  correlations  between  verbal  and 
performance  tasks  are  not  equally  high  in  all  groups.  They  are  most  likely  to  be 
nigh  among  these  who  have,  had  the  greatest  opportunity  to  develop  their  verbal 
skills  maximally,  those  with  the  greatest  environmental  resources  for  the  develop- 
ment of  traditional  verbal  skills.  The  possibility  that  other  tasks  may  more  accu- 
rately assess  aptitude  in  minority  youth  is  not  considered. 

Now,  non-test  information  can  nave  the  same  weaknesses  as  test  in  terms  of  va- 
lidity and  reliabilitv,  and  thus  care  must  be  taken  in  use  of  these  data  as  well. 

The  range  of  problems  encountered  in  using,  tests  in  selection  does  not  mean  that 
test  information  should  be  thrown  out.  It  does  mean  that  the  complexity  of  decision 
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makinc  rcRard.ng  the  future  of  our  young  people  must  be  appreciated,  and  dealt 
with  aeeorSmgly  There  i.s  no  simple  way  to  make  admissions.and  placement  dec 

^' B^ause  two  groups  differ  substantially,  on  the  average,  on  some  test  such  as 
GRE.  MCAT.  etc.,  does  not  mean  that  one  group  is  brighter  than  the  other  There 
are  factors  in  the  test,  the  tested,  and  the  test-taking  that  result  m  those  differ- 
ene<4  It  may  mean  that  the  typical  school  and  non-school  experiences  of^one  group 
ha^  better  prepared  them  for  the  test  material.  It  does  not  mean  that  people  in  the 
lower  scoring  group  are  not  capable  of  competent  work  in  the  proposed  course  of 

'  *'i?wnsidering  legislation  related  to  testing,  we  must  recognize  the  impact  that 
the  proposal  of  national  legislation  has  had.  It  has  created  a  climate  within  the  es  • 
fnSy  that  has  resulted  m  some  creative  approaches  toward  openness  in  test- 
Z  and  an  increased  tolerance  of  those  within  the  industry  who  has  previously  ad- 
v(5ated  use  of  tesU  for  opening  options  to  studenU,  rather  than  closing  them 
^hat  then  are  positive  uses  for  tesU?  TesU  probably  have  their  greatest  utility 
in  providing  continual  feedback  regarding  the  effectiveness  of  educational  program- 
ming for  Youngsters.  In  this  use,  they  sTiould  be  as  non-threatening  as  possible- 
taken  when  the  youngster  is  ready,  often  by  computer,  with  corrections  and  reasons 
for  wronr^^^ers  provided,  and  accompanied  by  instruction  in  those  problem 

""^When  used  alone  as  rigid  admissions  criteria,  tesU  only  serve  to  reinforce  thp 
bare  to  entry  in  selective  programs  that  have  long  existed  in  other  ways,  and  dis- 
courage  creative  approaches  to  treating  instructional  material  to  make  it  more  ac- 
CPfKiblo  to  students  from  non-traditional  backgrounds  ,ocf  <;.,k. 

CommenU  regarding  problem  areas  in  HR  1662-Section  3  Information  to  test  Sub- 
jects'and  Postsecondary  Educational  Institutions. 

/'.    L.  U-li:  •  ■  ,  .        .  u 

A*lone-ranKe,  t)r  conceptual  criterion  for  validating  tesU  used  in  section  may  be 
succe^  in  t\it  career  field.  However,  much  shorter  term  validation  criteria  are  em- 
Xyedf  in  practice.  For  example,  little  data  exisU  on  the  MCAT  and  lU  correlation 
wUh  success  as  a  physician,  but  many  studies  have  correlated  the  test  with  first- 
viar  medicd  school  grades.  One  reason  for  the  lAk  of  studies  using  a  long-range 
sr.?  0  coS^rthe  time  and  cost  involved.  A  more  i7«,'-H'"i'-™t^aMf  a 
is  the  difficulty  in  defimng  and  measuring  "succe.ss"  in  a  fiela.  The  fact  that  is  a 
problem  for  tho  test  m»an  be  described  clearly  to  the  test  ta-'.er,  along  with  the 
reasons,  and  any  proposed  plan  for  research. 

-  P.  1  L  11-16  .  .  ■■ 

This  section  may  seem  to  give  the  test  taker  more  information  than  it  actually 
doe^  The  'wrcent  of  variance  accounted  for"  which  this  statement  suggesU  be 
J^n  to  the^est  "ake  is  conceptually  not  useful,  and  perhap^  misleading.  There  is 
a  t^^  bi  itv  for  the  use  of  some  creative  appi-oaches  by  publishers  to  convey  the 
a  possibility  for  tne  use  01  of  the  test  improves  the  accuracy  of  predicting  future 
grede  point  average  over  and  above  all  other  information  used"  f  see  an  unneces- 
sary limitation  in  the  term  "expressed  as  a  percentage  . 

Chairman  Perkins.  1  think  before  we  go  on  to  the  second  panel 
perhaps  we  will  open  this  panel  up  to  so^e  questions.  Mr  Simon 

Mr  Simon.  First  I  have  to  note  that  Dr.  Johnson  received  her 
masters  degree  from  Southern  Illinois  University,  which  is  in  my 
district.  She  certainly  is  an  expert  witness. 

Chairman  Perkins.  I  paid  careful  attention  to-  that  part  of  her 

^'MrSiMON.  Let  me  ask  Dr.  Mehrens  and  Dr.  Johnson  if  both  of 
you  have  had  a  chance  to  take  a  look  at,  the  proposed  legislation. 
Mr.  Mehrens.  I  have.     '   .     .  •.        .   t  .  „„^ 

Ms.  Johnson.  I  have  looked  at  an  earlier  version  of  it.  I  have  not 
had  a  chance  to  examine  the  recent  version.  .  .  .,, 

Mr.  Simon.  I  am  advised  by  the  sponsor  that  it  is  the  same  bill 
Let  me  direct  this  to  Dr.  Mehrens.  Perhaps  I  should  be  directing  it 
.to  the  succeeding  witnesses  and  I  will  be  doing  that  .oo.  Sectiop  3 
of  the  bill  which  sets  forth  what  you  will  provide,  on  page  3  start- 
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ing  line  21,  the  purpose  for  which  the  test  is  constructed  and  is  in- 
tended to  be  used.  That  one  is  no  problem.  As  you  go  through  that 
series  which  are  the  ones  that  you  find  objectionable,  if  any,  in 
that  particular  section. 

Mr.  Mehrens.  It  would -take  me  a  while  to  read  through  them  to 
answer.  Statements  one  and  two  are  not  ones  which  I  find  objec- 
tionable and  ones  which  are  already  done  by  all  test  companies. 
With  respect  to  interpreting  the  results  statement  three  including 
explanation  of  the  test  is  fine.  Correlation  between  test  scores  and 
future  success  in  schools  may  not  be  known  by  the  publisher.  That 
would  be  something  the  school  would  have  to  provide.  Those  corre- 
lations woul(J  vary  from  school  to  school  depending  on  variety  of. 
factors  so  that  is  data  the  publisher  may  not  have  available.  I' 
would  not  be  opposed  to  the  school  providing  it  if  they  had  that. 

Mr.^  Simon.  If  I  may  interrupt.  I  have  another  question.  How 
many  schools,  agencies,  and  publishers  are  involved  in  the  test 
scores  business? 

Mr.  Mehrens.  I  would  imagine  not  having  sound  figures  most 
^hools  require  some  te^ts  but  not  as  an  admission. 

Mr.  Simon.  How  many  entities  originate  tests?  You  have  Univer-  , 
siW  of  Iowa  for  example. 
M^.  Mehrens.  In  terms  of  test  publishers? 
MfySiMOM.  Yes. 

Mr.  l^EHRENs.  There  are  two  m^jor  test  publishers  I  suspect  that 
haveitos^o  with  undergraduate  admissions  tests.  Educational  Test- 
ings Service  and  American  Council  on  Testing.  There  are  other 
publishers  such  as  Psychological  Corp.,  McGraw-Hill,  California 
Test  Bureau.  That  is  one.  So  probably  I  would  think  about  what  I 
would  consider  major  publishing  enterprises. 

Mr*  Simon,  lather  than  go  through  in  detail,  and  I  would  be  in- 
terested in  the  response  of  the  next  witnesses  to  the  same  question, 
I  would  be  interested  in  having  for  the  record  from  you  Dr.  Mieh- 
rens-a  response  to^tjhat  question^ 

Mri  Mehrens.  I  \vill  be  glad  to  give  you  that.  If  you  would  like 
that  in  writing  in  a  fe^w  days. 

Mr.  Simon.  Dr.  Johnson  if  I  may  ask  the  same  of  you  if  you  could 
go  through  that  section^S  and  see  if  there  are  areas  where  there 
are  problems  and  obvioudJy  not  just  to  state  there  is  a  problem  but 
something  of  the  nature  of\the  problem. 

Ms.  Johnson.  I  would  appreciate  the  opportunity  to  go  through  , 
it  thoroughly.  \ 

Mr.  Simon.  Then  if  you  can  submit  that  we  will  enter  that  in  the 
record.        •  \  v 

"    Thank  you,  Mr.  Chairman.  \ 

Chairman  Perkins.  Mr.  Erdahl.\ 

Mr.  Erdahl.  Thank  you,  Mr.  Chairman.  Thanks  to  our  two  wit- 
nesses for  being  with  us  today  and  others  in  the  audience  that  are 
here  as  interested  participants  and  listeners.  One  of  the  things  I 
would  address  to  both  of  you  if  I  might,, Dr.  Mehrens  and  Dr.  John- 
son, is  that  my  understanding  is — and  ^aybe  we  should  all  give 
Mr.  Weiss  proper  credit  that  evidently  Ijis  bill  has  evoked  some 
modification  in  policies  of  testing  companies  and  institutions  and  ii 
your  bill  passes  or  does  not  pass  maybe  you  have  achieved  at  least 
part  of  your  goal.  As  I  understand  this  may     a  fair  policy  in  test- 

\ 

\^ 
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vine  so  1  euess  the  question  I  would  ask  is  how  does  this  bill  equate 

S  because  my  understanding  is  th^t  s^e  testing  ^^^^^^  - 
panHs  and  institutions  have  already  achieved  what  might  be  some 
Sf  tt^ais  or  the  objectives  that  are  raised  m  this  Dili.  Woula  you 

'  Ms'fcoN"'Ari'^^^  in  my  testimony  I  think  the  bill 

has  had  Se  effect  of  stirring  up  activity  within  the  testing  commu- 
nifv  HowAer  it  is  a  bill-in  a  sense  that  there  can  be  a  lot  of  ac- 
fivVen»^^  the  beginning  but  it  is  important  to  have  I 
th7nk  prSly  some  things  in  place  to  continue  the  impetus  of  the 
activity  At  the  same  timi  I  do  think  that,  probably  there  may  be 
some  certain  aspects  of  the  bill  that  may  in  some  ways  limit  test 
cSpaniesTn  terms  of  changing  test  procedures.  Fo;  f  ampk  u^n| 
different  ways  of  administering  tests  because  of  certain  feedback 
that  h?s  to  be  given.  But  I  think  that  could  probably  be  modified.  I 
hfnk  that  the  activity  that  has  been  created  if  it  were  to  continue 
on  "ts  own  might  not  make  the  legislation  necessary.  But  I  do  not 
know  whether  that  would  be  the  case.  u„„  v,„„„  „nl.,n 

Mr.  Erdahl.  It  has  been  my  understanding  there  has  been  volun- 
tary disclosure  by  many  of  the  testing  companies  already.  Dr.  Meh- 

""M^;'1^tlBt.'S!ruTd1nIe  to  speak  on  tbk  briefly  Perhaps 
as  a  resuR  of  the  New  York  bill,  perhaps  as  a  result  of  previous 
bills  introduced  at  the  Federal  level  there  has  been  more  voluntary 
Sisclosure  of  some  items.  Vfe  have  an  example  that  has  been  widely 
Dublicized  about  two  scoring  errors  that  were  found  in  a  test  De 
?au    of  the  item  disclosure.  The  inference  has  been  made  by  pro- 
oonents  of  the  bill' that  this  will  result  in  better  tests.  Ui  course, 
whether  that  inference  is  accurate  or  not  depends  upon  once  we 
disclose  items  what  we  pi.t  in  place  of  those  item   We  will  a^^^^^^^^ 
find  faulty  items  I  suspect.  I  agree  very  much  ^ith  Dr  Johnson  s 
no<;it!on  that  it  is  difficult  to  measure.  In  the  psychological  ana 
eTucSnaTareV  the  test  validation  is  difficult  and  to  fi^^^^^^^^^^^ 
items  that  are  faulty  and  to  assume  from  that  that  the  resultant  o^ 
.^nhqeauent  tests  will  be  better  16  an  inference  I  am  not  necessarily 
Lnilna  ?o  make  I  believe-  if  we  expose  enough  items  and  we  are 
Sied  taw?i?e  new  itS  without  tL  detail  we  have  had  in  terms 
KtisS  aVal^ses  of  the  current  items  we  may  end  up  with  a 
noorer  test  One  other  brief  point  with  respect  to  the  impact  oi  tne 
Sosed  legislation-it  has  stirred  up,  I  think,  some  forces.  One  of 
K^^rTeoals  was  to  put  a  chink  in  the  armor  of  credibility  of  the 
Sucational  Testing  fervice.  I  am  pretty  sure  that  is  OOt  doing  A 
servSe  That  is  a  dfsservice.  We  have  abundant  evidence,  that  when  , 
•  we  comparrvarious  ways  ofjnaldng-decisio.ns-and  again  I  to^a^^^^ 
aeree  with  Dr.  Johnson  we  should  use  a  variety  of  ways-then  tests 
a?e  much  more  valid  than  things  apt  to  replace  them  such  as  inter- 
?iewT.      sTrring  up  those  forles  is  something  I  am  not  convinced 
tA/Jll  hp  a  good  thinff  for  the  students  in  the  long  run.  • 
"'L'^EkSl.  Think  you.  Another  auestion      D.  Jjh^son.  Ho^^ 

Ta^e'd  'ifth  usvlfslems  thTth^real  "rS^if  therfis 

oie  is  the  use  and  appHcatioHf  the  test  results  by  the  various  in- 
sti  u  onllf  we,"as'?fe  Congress  and  as  concerned  publj^ana  a 
editors  and  experts,  are  quite  concerned  about  the  results  oi  tne 
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tests,  that  js,  some  people  making  poor  scores,  it  seems  like, we  are 
shooting  the  messenger  that  brings  the  bad  news.  Maybe  there 
should  be  some  other  problem,  we  should  be  addressing  but  it 
seems' to  me  the  real  problem  is  how  the  test  results  are  used  and 
applied.  Obviousl}  they  should  not  be  the  only  criteria  forejudging 
whether  a  person  could  succeed  in  some  academic  p'ursuit.  Would 
you  address  yourself  to  that.  I  think  it  is  a  real  problem  that  you 
bring  to  our  attention. 

Ms.  Johnson.  I  think  to  the  extent  it  promotes  a  better  under- 
standing of  tests  within  the  general  public  it  does  serve  to  deal 
with  some  of  the  issues  that  I  raised.  That  is,  if  the*  general  public 
becomes  more, informed  about  the  limitations  of  measurement  then 
I  think  they  will  'impact  on  the  institutions  that  ^erve  them.  In 
fact,  actually  the  test  problem — tests  probably  are  used  less  within 
institutions  than  individuals  often  think.  However,  I  think  many 
people  in  the  general  public  think  this  is  somehow  skirting  or  get- 
ting around  or  giving  somebody  an  easy  time,  whereas  I  think  a 
greater  understanding  of  what  tests  can  do  and  how  they  are  made 
and  what  their, limitations  are  will  make  the  idea  of  usin^  a  vari- 
ety of  predictors,  which  in  fact  many  institutions  do  uSe,  more  ac- 
ceptable in  terms  of  the  general  public  interest.  As  far  as  the  busi- 
ness of  shooting  the  messenger,!  always  felt  that  while  ikoX  may 
not  be  appropriate,  there  is  nothing  wrong  with  asking  him  to  sit 
down  and  be  a  little  more  specific  about  his  message. 

Mr.  Erdahl.  I  think  that  is  a  good  explanation.  One  more  ques- 
tion, Mr.  Chairman,  to  Dr.  Mehrens.  You  indicated  in  your  testimo- 
*ny,  and  I  think  most  of  us  would  agree,  there  is  going  to  be  some 
type  of  indicators  tjiat  are  going  to  be  used,  including  testing  and 
interviews  by  someone.  I  believe  you  also  gave  the  impression  or 
ma}  he  you  said  it  directly  that  the  locally  originated  tests  would  be 
not  as  good  or  would  be  deficient.  Could  you  elaborate  on  that? 

Dr.  Mehrkns.  I  would  not  want  to  say  they  would  be  deficient. 
The  rationale  for  my  opinion  on  that  is  simply  the  sheer  difficulties 
of  making  these  kinds  of  predictions  and  the^  amount  of  time, 
effort,  and  money,  and  years  of  analyses  it  takes  to  build  instru- 
ments. It  seems  to  me  it  is  likely  that  the  nationally  developed 
tests  which  have  the  amount  of  money  and  expertise  behind  them 
are  going  to  be  greater,  resulting  in  better  test  in  the  sense  of  valid 
tosih  for  predicting  success  than  one  that  is  developed  locally  with 
less  expertise,  less  time,  and  less  money. '  ^ 

Mr.  Erdahi,.  Thank  you  very  much.  Thank  you,  Mr.  Chairman. 
Mr.  Craig. 

^\\  C'kAUi.  Thank  you  very  much,  Mr.  Chairman.  To  both  Drs. 
Mehren^  and  John^un  I  wuuld  fir^t  like  to  make  a  brief  staten|f;nt 
and  w^uld  appreciate  >uur  comment  on  that  statement  as  it  relates 
to  standardized  testing.  In  the  information  that  has  been  made 
available  tb  me,  and  qtfite  a  bjt  of  information  I  haye  read,  it  seems 
the  basis^  for  the  criticism  that  H.R.  1662  is  attempting  to  address 
is  the  co^nplaint  against  the  standardized  testing,  and  Tthat  it  dis- 
criminattjs.  Now  if  I  were  to  say  that  is  absolutely  correct,  it  does 
discriminate.  And  it  would  not  sell  if  it  did  not  discriminate  or  if  it 
did  not  bring  about  some,  process  of  measurement.  I  guess  you 
could  lik^n  this  to  a  yardstick.  Yardstick  measure  is  feet.  You  put 
two  objects  side  by  side  on  the  table.  One  of  them  is  1  foot  long  and 
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the  other  on6  is  2  feet  long.  The  yardstick  becomes  the  d'ocrimina- 
tor  Ox-  the  determiner  of  which  one  is  1  foot  long  and  which  one  is  2 
feet  long.  Instead  of  arguing  that  both  objects  a-e  equal  and,  there- 
fore, something  was  wrong  with  the  measurement-tool,  ought  we 
not  determine  frQm  the  tool  if  those  two  objects  were  to  be  equal? 
Then,  what  is  the  problem  jn  the  background  or  l|ie  basis  of  the 
two. objects,  because  one  is  1  foot  long  and  one  is  2  feet  long.  Is  that 
the  basis  of  the  argument  in  a  simplistic  way?  Are  Nye  not  using  a 
measurement  tool  and,  in  fact,  it  does  discriminate  and  it  was  de- 
signed to  db  from  a  basis?  ,  .     ,        .         r  j-  „  • 

Ms  Johnson.  There  are  Eelevant  and  irrelevant  bases  a  discrim- 
ination. I  think  that  the  problem  is  that  there  are  factors  that  can 
affect  test  scores  that  are  not  relevant  to  the  basis  on\  which  wp 
wish  to  discriminate.  When  perhaps  it  might  be  useful  here  cO  com- 
ment in  terms  of  the  way  the  test  are  constructed  although  Dr. 
Mehrens  has  done  this  to  some  extent.  When  you  set  up  .a  test 
after  a  set  of  items  has  been  written  and  discussed  and  edited  they 
are  tried  out  on  subjects  .similar  to  those  for  whom  the  test  is  in- 
tended. I  am  not  talking  about  the  norming  process  but  this  is  a 
kind  of  tryout  process.  When  those  items  are  tried  out,  it  if  often 
done  in  conjunction  with  a  larger  standardized  test  a  m&jor  test 
that  is  being  given  at  a  particular  point  in  time.  There^re  often 
tryout  items  given  along  with  that.  Then  the  scores  on  those  new 
items  are  compared  with  the  scores  on  the  bigger  standardized  t-st 
If  subjects  who  do  well  on  the  main  tests  or  this  old  t^t  we  might 
say  and  they  do  well  on  the  tryout  items  and  people  who  do  poorly 
on  the  major  test  and  also  do  poorly 'on  the  tryout  items  if  thfvt 
occurs  then  we  say  we  have  good  items  the  test  discriminated  well. 
We  keep  those  items.  Items  that  work  the  other  weo;  are  said  to 
discriminate  negatively  and  we  often  toss  those  out.  There  is  often 
something  wrong  with  the  way  they  are  worded  or  whatever.  Ihen 
there  may  be  a  variety  of  flat  items.  The  new  item  you  try  out  may 
be  the  people  who  do  well  on  the  old  test  and  the  people  who  do 
poorly  on  the  ,old  test  do  not  discriminate  between  so  we  toss  that 
out  and  say  iti  is  a  flat  item.  It  does  not  add  anything  to  the  score. 
In  fact  test  items  such  as  that  may  have  discrimination  within  c?r- 
tain  subgroups  so  that  perhaps  certain-I  am  speculating  because 
not  that  much  work  has  bnen  done  in  that  area-out  there  may  be 
some  items  that  have  particular  relevance  for  . some  groups  that 
never  make  it  to  the  main  instrument  that  is  being  constructed  be- 
cause they,  their  area  of  discrimination  those  with  whom,  wit/iin 
the  groups  within  which  they  discriminate  may  be  smaller  than 
the  total  group.  So  what  you  end  up  with  is  i^ems  that  discriminate 
grossly  and  you  may  lose 'some  of  the  fjner,.l^ints  of  discrimination. 
So  when  you  talk  about  the  test  being  a  yardstick,  I  think  you  have 
to  realize  that  yardstick  includes  both  measurements  you  want  and 
some  you  do  not  want.  And  that  has  to  be  recognized.  Constancy-is 
a  factor  in  terms  .of  test  items.  There  is  an'examjile  I  use  that  I 
would  like  to  share  with  you.  We  do  not  expect  tests  o  ever  be  con- 
tent free,  of  course,  but  it  is  these  kinds  of  figures  that  we  try  to 
get  tfest  publishers  to  Qv^n  out  by  using  contents  from  this  and  that 
Ind  the  other  but-that  does  not  always  Vorjt.  Maybe  somebody  gets 
a  break  because  they  know  something  aboutr  Euroijean  history; 
somebody  else  gets  a  break  because  they  know  something  about  art 
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but  that  does  nut  iilwa>b  work.  There  was  a  study  done  by  Medly 
and  Quirk  severed  yearb  ago  Ubing  national  teachers  exam  and  they 
developed  a  set  of  items  which  had  contents  of  specific  interests  to 
blacks  even  though  they  developed  the  items  so  that  the  kinds  of 
process  that  was  involved  was  similar.  Sure  enough  those  students 
did  better  on  the  black-oriented  items  and  white  students  did 
better  on  the  white-oriented  items.  Suppose  for  example  you  have 
an  item  on  the  GRE  that  has  to  do  with  Great  Britain  and  that 
knowing  something  about  its  history  would  be  helpful.  Let  us  sup- 
pose the  reading  passage  actually  contains  the  inft.mation  that 
you  need  to  know.  WeU,  someone  who  knew  that  before  the  test 
has  a  little  break  in  it  even  <^hough  the  content  is  already  there. 

Mr.  Craig,  Thank  you  very  much,  Dr.  Johnson. 

Mr.  Mehrens.  I  would  like  to  respond  briefly  also.  I  certainly 
agree  with  the  thrust  ol'  your  statement  but  I  must  admit  I  also 
agree  with  the  first  statement  that  Dr.  Johnson  made  that  there 
are  such  things  as  relevant  and  irrelevant  bases  of  discrimination. 
Then  she  proceeded  to  give  some  good  examples  of  the  possibilities 
of  irrelevant  discrimination.  As  I  read  the  research  evidence  on  the 
results  of  tests  for  various  ethnic  groups  the  various  standardized 
admissions  tests,  the  evidence  suggests  that  the>  are  equally  valid 
across  various  ethnic  groups,  that  is,  the  basic  correlation  between 
test  scores  and  what  the>  are  trying  to  predict,  success  in  college  is 
pretty  much  equal.  Now  this  does  not  suggest  that  we  should  not 
be  ver>  alert  to  the  kinds  of  things  Dr.  Johnson  is  raising  as  possi- 
bilities. We  should  be.  .It  is  the  fact  that,  as  I  view,  test  companies 
are  alert  to  these  things.  Test  companies  are  primarily  these  days 
trying  to  do  pretty  routinely  three  kinds  of  things  to  be  concerned 
with  what  we  might  think  of  as  ethnics  bias.  One  is  to  have  people 
that  represent  various  ethnic  groups  and  both  sexes  do  a  content 
subjective  anal>sis,  that  is,  look  at  the  items  to  see  if  they  are  apt 
to  be  the  kind  that  will  give  irrelevant  discrimination,  I  think  ev- 
erybody agrees  that  is  not  sufficient.  That  is  only  a  first  step  in 
terms  of  trying  to  control  that.  So  they  also  do  statistical  item 
analyses  with  rcspeot  to  ethnic  bias.  There  are  varieties  of  statisti- 
cal techniques  where  I  look  at  the  statistical  properties  of  the  item 
within  ethnic  groups  and  see  if  that  work  on  the  differential  to 
look  at  item  bias. 

Then  if  item  bias  does  show  up  in  those  it  is  statistically  they  go 
back  t<  when  t.he  pilot  study  was  done,  to  the  people  who  took  the 
test  and  try  to  find  out  what  their  thought  processes  were  or  why 
that  bias  might  exist.  The  reason  I  am  emphasizing  this,  and  I 
think  it  relates  to  an  earlier  question,  is  why  I  believe  there  will  be 
those  kinds  of  bias  or  discrimination  in  these  standardized  instru- 
ments than  there  would  be  in,  for  example,  in  interview  or  locally 
developed  tests  that  clearly  is  subject  to  all  the  irrelevant  discrimi- 
nations also  and  does  not  have  the' kind  of  safeguards  to  steer  away 
from  those.  \ 

Mr.  Crafg.  Thank  you  both  very  much.  I  guess,  'hen,  my  next 
#ue3tion,  which  I  think  will  bring  forth  a  brief  answer  is,  do  you 
Think  we  can  legislate  the  inaccuracies  or  the  errors  that  might; 
now  exist  in  some  standardized  testing  methods? 

Mr,  Mehrens.  No.  ^ 

Mr.  Craig.  Dr,  Johnson? 
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Ms  Johnson.  1  think  that  you  can  do  things  through  legislation 
that  may  assist  in  that  process,  not  guarantee  it. 

Mr.  Craig.  Thank  you.  I  would  agree.  I  do  not  think  I  can  guar- 
antee it  because  of  the  various  kinds  of  things  that  both  of  you 
brought  up  to  be  very  clear  as  relevant  kinds  of  things  that  hap- 
pened  within  that  testing  mode.  •,      j    ^    j  „„o„fi„ 

Dr.  Mehrens,  one  question  of  you:  I  understand  you  recent  y 
wrote  an  article  on  the  Nader  report  on  he  re.gn  of  ETS.  Would 
you  comment  briefly  on  that,  especially  with  their  claim  that  ETS 
oredict  grades  only  slightly  better  than  a  role  of  the  dice/ 
^  £  IvfEHRENs.  Yes;  I  have'  included  a  copy  of  my  art  cle  mth  my 
written  testimony,  so  it  is  on  file.  I  do  not  have  that  article  m  front 
■      of  me  It  is  in  my  briefcase  but  I  think  I  can  briefly  respond  to  your 
comment.  They  make  much  of  what  they  call  5  percent  of  nothing. 
Kt  is  a  common  phrase  they  use  when  they  talk  about  the  addi- 
tional validity  of  using  a  test  over  and  above  other  material.  Wow, 
let  me  just  find  the  right  section  if  I  can.  . 
There  are  some  prol?lems;  there  is  not  a  professional  measure- 
•       ment  person,  so  you  Lve  some  trouble  with  f  f  istics,  but  Mn 
Nader  ends  up  with  an  index,  to  use  his  figures,  of  13.4  for  using 
school  grades  alone  and  18.5,  using  testing  grades  combined. 

That  is  a  difference  of  5.1,  but  if  we  look  at  percentage  improve- 
ment, I  used  to  teach  8th  grade  math,  byt  if      f  to  m>>  as 
taught  in  8th  grade  math,  that  will  be  o.l  over  13.4  or  38  percent 

X  ™STa"s^nStT4!!'LedTpercentage  increase  notion  in  comparing 
Hhoselwo  numbers,  so  even  if  his  numbers  were  correct,  going  from 
131  to  15.5.  we  would  not  have  a  5-percent  improvement  but  a  d«- 
percent  improvement  by  Using  the  additional  data. 
^  It  seems  to  me  that  there  is  really  no  controversy  among  mea- 
surement experts.  The  combination  of  high  school  grades  and  some 
sSrt  of  aptitude  test  gives  you  a  better  predictor,  a  significantly 
better  predictor,  than  using  only  high  school  grades  alone. 
Mr.  Craig.  Thank  you  both  very  much. 

Let  me  conclude.  In  my  consultation  with  some  of  the  universi- 
ties in^y  State,  one  of  the  student  counseling  directors,  in  refer- 
ence  ?oTe^sts  made,  comments  about  some  of  Mr.  Nader  s  efforts  in 
this  whole  area.  He  speaks  of  the  American  Personnel  and  Guid-, 
ance  Association  national  convention  in  Chicago  a  couple  of  years 
ago,  when  he  splashed  this  out  on  the  American  scene.  . 

He  said  that  his  allegations  about  testing  were  so  invaLc  and  ri- 
diculous  that  a  fair  number  of  people  attending  that  convention 
simply  got  up  and  walked  oAt.  He,  said  his  reports  and  his  informa- 
tion offer  .really  no  credibility  whatever  to  the  issue. 

I  would  like  to  say,  for  the  record,  that  my  observation  is  that 
statement  is  extremely  valid,  and  I  think  that  the  people  before  us 
?his  Soming  have  testified  iii  a,  broadened  sen^e  to  demonstrate 
that  there  if  more  to  it  than>st  the  lack  of  measurement  that 
Mr.  Nader  and  company  are  Attempting  to  project  into  thi»  issue. 

Thank  you.  J  i. 

Mr  Weiss.  Thank  you,  Mr.  Cf;aig.      ,        ,  „  ,  .   -x  „r 

In  the  course  of  your  testimony,  you  stated  that  the  majority  of 
the  people  S  yoiivVield,  the  m^ijority  of  the  experts  in  measure- 
ment evaluation,  hold  views  that.^ar<i  similar  toj'ojtirs. 
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Now,  you  are  not  suggesting  by  that  statement  that  th  .re  are  not 
a  great  number  of  people  within  your  field  who  in  fact  support 
openness  and  disclosure,  are  you? 

Mr.  Mehrens.  I  suspect  it  depends  in  large  part  about  how  strict 
we  are  in  pur  definition  of  what  constitutes  a  measurement  expert. 

Mr.  Weiss,  People  you  define  as  experts;  right? 

Mr.  Mehrens.  I  would  grant  you  there  is  some  controversy 
within  the  field.  My  testimony  is  one  I  would  stick  with,  and  I  be- 
lieve my  views  are  quite  similar  to  the  views  of  the  majority  of  the 
experts,  obviously  more  thanjiSO  percent,  but  I  would  think  that 
must  be  upwards  of  85  percent,  if  I  had  to  take  a  guess  as  to  the 
percent  of  experts  in  measurement  evaluation  who  would  be  op- 
posed to  disclosure  of  items.  That  is  a  guess. 

I  believe  my  views  are  similar  to  the  views  of  the  majority. 

Mr.  Weiss.  Well,  isn't  it  a  fact  that  most  of  the  pressure  for  open- 
ing it  up,  for  taking  the  mystique  away  from  disclosure — because 
that  is  really  all  that  this  legislation  is  about,  it  does  not  seek  to 
mandate  anything  of  what  the  contents  ought  to  be  or  how  it  is  to 
be  used  or  whatever— that  much  of  that  pressure  for  opening  it  up 
came  from  within  the  field  itself,  of  people  who  have  been  involved 
throughout  their  careers  in  the  area  of  psychometrics,  if  you  will. 

Mr.  Mehrens.  That  is  not  my  impression  at  all. 

Mr.  Weiss.  Dr.  Johnson? 

Ms.  Johnson.  Certainly,  there  has  been  pressure  by  individuals 
within  it  who  have  professional  backgrounds  in  measurement  to 
deal  in  a  variety  of  ways  with  problems  related  to  measurement, 
and  one  of  them  being  legislative,  so  as  far  as  to  where  the  forces 
that  originated  the  current  movement  toward  legislation,  whether 
they  come  from  measurement  people  specifically,  I  guess  it  depends 
a  little  bit  on  how  you  do  define  measurement  people. 

I  think  that  there  are  many  minorities  who  have  had  some  back- 
ground in  measurement  and  others  who  have  had  some  back- 
ground who  may  not  have  been  active  in  the  professional  organiza- 
tions but  who  nevertheless  maintained  an  interest  in  measure- 
,ment.  -  ^ 

Mr.  Weiss.  Do  both  of  you  recogniz^  Dr.  Oscar  Euros  as  being  an 
eixpert  in  the  field?  \ 

Mr  Mehrens.  Yes;  he  is  deceased  now. 

M..  Weiss.  He  was  an  editor  of  the  Mental  Measurements  Year- 
book, one  of  the  winners  of  the  Educational  Testing  Service  s  dis- 
tiriguished  service  awards. 

Mr.  Mehrens.  Yos. 
j  Mr.  Weiss.  I  give  you  a  quote  of  his.  In  1978,  he  said: 

,    It  m  practically  impossible  for  a  competent  test  technician  or  test  counsellor  to 
f  make  a  thorough  appraisal  to  *.onbtruction»  validation,  and  use  of  standardized  tests 
,  bfcauhe  of  the  limited  amount  of  trustworthy  information  supplied  by  the  test  pub- 
lishers} 

Wouldn't  you  consider  that  pressure  from  within  the  industry,, 
somebody  who  is  highly  expert  as  to  the  reason  for  opening  it  up? 

Ms.  Johnson.  Dr.  Burros  irt  the  most  recent  update  in  the  book 
said  thai  he  had  hoped  by  the  publication  of  the  Mental  Meas- 
urements Yearbook  there  would  be  some  significant  improvement 
in  the  quality  of  instruments,  and  he  did  not  find  that  to  be  the 
case. 
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Yes;  I  would  agree  with  yOu.  -  , 

Mr.  Mehrens.  The  quote  that  you  are  talking  about  is  one.  with 
which  I  am  familiar,  of  course,  and  there  is  nothing  in  that  quote 
that  suggests  that  we  ought  to  disclose  items  to  the  i)ublic. 

He  is  concerned  about  the  availability,  within  your  quote,  I 
happen  to  believe  incorrectly,  but  he  is  an  expert,  he  is  concerned 
about  the  availability  of  evidence  regarding  the  validity  of  the  test 
to  the  reviewers.  He  is  in  no  way  suggesting  in  that  quote  that  we . 
ought  to  disclose  items  to  the  public. 

Mr.  Weiss.  You  must  be  very  unhappy  with  the  action  of  the 
Educational  Testing  Service  and  the  College  Entrance  Examination 
Board  in  making  5  out  of  12  of  their  major  administrations  every 
year  open  to  the  students  who  request  those  test  answers. 

Mr.  Mehrens.  Yes;  I  think  that  will  result  in  inferior  quality. 

Mr.  Weiss.  You  are  opposed  to  that  policy? 

Mr.  Mehrens.  Yes. 

Mr.  Weiss.  So  long  as  we  know  where  we  are  coming  from. 

You  make  a  statement  that  you  don't  know  of  a  single  college 
that  based  admissions  decisions  on  test  results;  page  5  of  your  testi- 
mony. 

Do  you  know  of  any  colleges  which  use  the  test  result  as  a 
cutoff? 

Mr.  Mehrens.  Not  as  a  direct  cutoff,  I  don't,  although  I  have 
been  informed  that  there  are  some  who  have  used  it  in  corrobora- 
tion with  other  things.  , 

Mr.  Weiss.  Have  you  ever  looked  at  a  catalog  by  Lovejoy  which 
lists  the  various  universities  and  colleges  and  tells  the  student  and 
potential  applicants  that  you  have  to  have  an  SAT  score  of  this 
amount  to  be  considered  for  admission? 

Mr.  Mehrens.  I  am  familiar  with  that  catalog;  yes. 

Mr.  Weiss.  Wouldn't  you  say  that  is  a  cutoff? 

Mr.  Mehrens.  Surely,  that  is  a  cutoff. 

Mr.  Weiss.  I  was  impressed  with  your  analogy  of  the  bus  ride, 
Dr.  Johnson,  and  the  people  who  have  the  chance  to  get  on  it  to 
begin  with,  if  they  have  the  exact  fare,  and  I  wonder  if  you  would 
comment  on  the  utilization  which  colleges  and  universities  make  of 
the  SAT  scores  by  way  of  that  exact  fare  provision. 

Ms.  Johnson.  Well,  if  a  variety  of  other  predictors  are  used 
along  with  the  SAT,  then  I  think  you  have  an  improved  situation. 
By  the  analogy  with  the  bus  ride,  I  meant  that  if  you  continually 
raise  the  cutting  score  on  the  hope  that  you  are  getting  better  and 
better  students,  it  is  really  a  fallacy. 

But  if  you  operate  with  a  certain  minimum  and  then  use  other 
factors  to  determine  admission  or  actions  beyond  \  that,  you  are 
going  to  do  a  fairer  job  or  if  you  use  alternate  procedures  so  that 
you  will  examine,  if  someone  should  have  low  test  scores,  if  you  ex- 
amine also  their  high  school  grade  point  average,  and  the  kinds  of 
courses  specifically  that  they  had  in  high  school,  if  one  takes  a  look 
at  some  factors  that  might  have  enteredJnto  the  test  score  and  rec- 
ommend to  the  students  certain  programs  or  certain  independent 
activities  that  might  result  in  that  student  being  better  prepared  to 
take. a  particular  course  of  study,  then  you  are  doing  a  better  serv- 
ice to  the  students  and  to  the  institution  than  if  one  is  using  an 
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arbitrary  and  increasingly  raised  score  as  the  number  of  applicants 
increases. 

Mr.  Weiss.  I  have  one  final  question  because  time  is  going  on. 

Dr.  Mehrens,  you  indicated  one  of  your  concerns,  although  you 
said  you  didn't  think  disclosure  would  have  much  of  an  effect  on 
cpaching,  but  whatever  effect  it  would  have  would  be  negative. 

Youare  aware,  I  am  sure,  of  the  recent  FTC  finding  that  in  fact 
?dme  oT ihe  testing  companies  had  been  giving  insufficient  or  inac- 
curate information  as  to  what  the  effects  of  coaching  would  be  on 
those  who  took  the  SAT,  that  is,  the  position  of  ETS  had  been  that 
there  was  practically  no  effect  at  all  of  coaching. 

The  FTC  found  that  that  was  not  so.  Now,  what  is  your  attitude 
as  to  what  use  those  tests  should  be  put  to? 

Why  do  you  say  that  it  would  only  benefit  the  wealthier  if  you 
open  the  test3  up  at  this  point,  if  you  made  it  available  to  studenU, 
test  results? 

Mr.  Mehrens.  That,  of  course,  is  not  my  testimony.  What  I  sug- 
gested in  my  testimony  is  that  it  would  only  benefit  them,  but  to 
the  extent  that  opening  up  the  test  questions  will  avail  the  coach- 
ing schools  of  more  material  to  use  in  their  coaching  and  to  the 
extent  that  it  will  be  an  effect,  I  don't  know  how  much  it  is  going 
to  benefit  those  that  can  afford  to  go  to  coaching  schools  if  coach- 
ing schools  have  an  impact,  I  would  put  the  word  '^binding''  in 
quotes  of  the  FTC  study,  but  certainly  they  are  some  of  their  con- 
clusions, but  if  you  assume  that  coaching  has  some  impact  on  test 
scores,  then  surely  it  seems  logical  to  assume  that  the  people  who 
can  afford  to  go  to  coaching  schools  will  be  the  beneficiaries  of 
that. 

Mr.  Weiss.  Don*t  you  think  one  of  the  effects  would  be  perhaps  if 
you  really  opened  it  up  that  people  who  otherwise  cannot  afford  to 
go  to  coaching  school  can  have  local  organizations  be  able  to  use 
the  return  test  as  a  basis  for  further  study? 

Mr  Mehrens.  They  could.  Of  course,  to  the  extent  that  the  ques- 
tions will  not  be  reused,  there  is  no  advantage  over  releasing  the 
questions  as  opposed  to  using  the  current  practice  prior  to  the  pre- 
vious practice  of  having  copies  of  test  questions  available,  so  those 
could  have  been  used  all  the  time. 

Mr.  Weiss.  Dr.  Johnson,  any  comment  on  the  coaching  issue? 

Ms.  Johnson.  Well,  I  think  that  part  of  the  problem  in  terms  of 
looking  at  coaching  is  that  one  persons  coaching  is  another 
person's  instruction,  that  is,  the  idea  of  what  is  coaching  and  what 
isn't  is  one  of  the  reasons  for  conflicts  in  terms  of  what  has  been 
found. 

I  think  that  one  thing  that  coaching  can  do  is  to  motivate  indi- 
viduals, that  is,  if  kids  feel  that,  hey,  that  test  score  isn't  the 
bottom  line,  in  fact,  somebody  says  I  can  do  better  if  I  go  and  really 
zero  in  on  this,  that  may  result  in  improved  performance. 

That  motivation  in  itself  may  help  to  get  the  student  really  into 
learning  how  the  test  operates,  what  attributes  of  the  test  taking 
situation  one  needs  to  be  in  contact  with. 

I  think  that  there  are  a  lot  of  things  that  can  be  practiced  in  the 
sense  of  getting  ready  to  take  a  test.  A  lot  of  test  taking  skills,  and 
in  a  sense  almost  an  emotional  readiness,  the  feeling  that  one  is 


EMC 


52 


really  able  to  do  it,  a  lot  of  that  can  take  place  in  a  coaching  or 
preparation  session  that  can  assist  a  student  in  doing  better 

I  would  agree  that  a  lot  of  this  is  already  being  done  in  terms  of 
middle  and  upper  income  students,  and  there  is  the  potential  for  it 
being  done  with  lower  income  students.  I  don't  know  whether  this 


will  in  fact  result- 
Mr.  Weiss.  Mr.  Simon? 


Mr.  Simon.  What  does  coaching  cost? 

Mr  Weiss.  On  the  basis  of  prior  testimony  that  we  have  had,  it 
can  run  around  $300  plus  a  rental  fee  for  some  of  the  materials,  so 
it  can  come  out  to  $350  la  the  most  expensive  of  the  schools. 
Mr  Simon.  Thank  you.  ,  t  u 

Mr  Weiss  Thank  you  very  much.  Dr.  Mehrens,  Dr.  Johnson. 
You  wfll  submk  responses  to  the  questions  that  Mr.  Simon  asked 
you  about  and  we  appreciate  your  taking  the  time  to  be  with  us 

^''ur  second  panel  has  George  Hanford,  president  of  the  Coilege 
Board,  and  Bruce  Zimmer,  executive  director  of  the  Law  Schools 

^tve^hLTe  you? "ill  statements  and,  without  objection,  they  will  be 
entered  into  the  record  and  you  may  proceed  as  you  wish. 
You  may  deliver  the  entire  statement;  whatever  is  your  pleasure. 

STATEMENT  OF  GEORGE  HANFORD.  PRESIDENT.  THE  COLLEGE 

'  BOARD 

Mr.  Hanford.  My  name  is  George  Hanford.  I  am  president  of  the 

Sn  r  so'n  of  a  graduate  of  Carbondale  Normal  School  before  it 
became  Southern  Illinois  University.  .         j  „f 

I  am  married  to  a  Minnesotan  whose  brother  is  a  graduate  of  St. 
Olafs,  and  I  work  in  New  York  City. 
Mr.  Erdahi..  He  better  stop  while  he  is  ahead.  r„ii^„p 
Mr.  Hanford.  As  you  know  from  previous  hearings  the  Col^^^^^^^ 
Board  is  a  national  nonprofit  association  of  more  than  2,o00  schools 
and  colleges  committed  since  1900  to  helping  young  people  get  into 

'°wf  are  best  known  for  the  tests  we  sponsor,  but  we  Provide  a  lot 
of  other  services  to  help  students  gain  access  to  higher  education 
Among  them  are  three  testing  programs  thjt  are  administered  for 
us  bv  ETS  that  would  be  affected  by  H.K.  ibb^.  .  . 

Because  the  College  Board  continues  to  oppose  its  provisions  and 
particularly  those  having  to  do  with  test  disclosure  I  am  gra  .efu 
for  the  invitation  to  testify  today  and  to  answer  the  three  questions 
asked  in  your  letter  of  invitation.  ,    ^  n      d„   j  u„,. 

My  written  testimony  makes  the  case  that  the  College  Board  has 
been  c7mmi?ted  to  fair  and  equitable  access  to  higher  education 

''wSa^l  been  t;fng  to  provide  common  currencies  to  make.it 
easier  for  young  people  to  go  to  college,  academic  currencies 
SiuU  tests  liki  the  Scholastic  Aptitude  Test,  the  SAT  and  a  cur- 
rency of  finaSne^  through  our  College  Scholarship  Service 
These  common  currencies  have,  made  it  possible  for  any  student 
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anywhere  in  the  country,  regardless  of  status,  race,  or  income  to 
consider  any  college  anywhere  in  the  country,  and  vice  versa. 

We  oppose  H.R.  1662  now  particularly  because  its  unlimited  dis- 
closure provisions  would  diminish  those  possibilities  by  compromis- 
ing the  utility  of  the  tests  used  in  the  admissions  process,  despite 
the  declared  intention  of  this  bill,  as  we  understand  it,  to  promote 
fairness,  equity,  and  accountability. 

In  the  matter  of  fairness,  our  SAT  and  achievement  tests  are  the 
most  objective  assessment  instruments  of  their  kind  yet  devised, 
free  of  differences  in  grading  standards  among  teachers  and  among 
schools  and  free  from  the  taint  of  personal  influence,  social  posi- 
tion, or  family  income. 

In  the  matter  of  equity,  we  have  in  my  quarter  century  with  the 
College  Board  seen  the  proportion  of  minority  youth  in  higher  edu- 
cation grow  from  3  percent  to  about  16  percent.  And  as  for  account- 
ability we  have  seen  the  number  of  young  people  in  higher  educa- 
tion increase  from  IVz  to  12  million,  a  remarkable  record  in  itself 
and  all  the  more  so  when  compared  to  that  of  any  other  country  in 
the  world.  I  see  no  reason  for  this  kind  of  governmental  interven- 
tion in  a  process  that  has  succeeded  this  well  without  it. 

Now  to  the  three  issues  you  have  asked  me  to  address: 

First,  the  reasons  why  the  College  Board  changed  its  policy  with 
respect  to  disclosure.  There  are, essentially  three:  First,  to  be  sure, 
we  have  changed  our  practice  with  respect  to  test  disclosure  but  we 
haven't  changed  our  position  with  respect  to  openness. 

When  I  joined  the  College  Board  staff  in  1955  high  school  seniors 
were  not  allowed  to  know  their  SAT  scores.  But  by  the  time  my 
♦  older  daughter  took  the  SAT  in  1962  we  were  not  only  reporting 
scores  but  also  making  half  an  SAT  available  for  practice. 

By  1978  We  were  publishing  "Taking  the  SAT,"  a  full  practice 
form.  Disclosure,  in  this  evolvitig  context,  is  but  a  natural  exten- 
sion of  the  process  of  opening  up  the  college  admissions  testing 
process*  that  has  been  going  on  since  World  War  II,  an  extension 
obviously  accelerated,- 1  am  the  first  to  admit,  by  the  spotlight  of 
public  attention  put  on  the  process  by  this  controversial  truth-in- 
testing  legislation. 

Second, vvas  the  board's  desire  to  demonstrate  again  that  it  is 
both  sensitive  and  responsive  to  public  interest  in  the  testing  proc- 
ess, and  that  it  is  possible  for  the  board,  given  the  time  to  do  so,  to 
develop  an  appropriate  program  of  action,  even  where  we  may 
question  the  educational  value  involved. 

We  have  5y  our  action  proved  that  the  ^If-regulating  and  volun- 
tary system,  given  the  time,  can  address  legitimate  concerns  with- 
out this  kind  of  governmental  intervention. 

,The  third  reason  for  the  change  has  to  do  with  the  New  York 
experience.  When  the  New  York  Act  was  being  considered  we 
argued  not  only  that  it  was  unwarranted  but  that  it  was  also  too 
hastily  conceived.  A  series  of  amendments  have  had  to  be  enacted 
to  deal  with  some  of  the  more  troublesome  features  of  the  legisla- 
tion; but  other  problems  remain. 

When  similar  bills  were  subsequently  introduced  in  25  other 
States  and  in  this  Congress  we  argued,  "Let's  wait  and  see  how  the 
New  York  law  works.'  Our  advice  has  been  heeded;  so  far  no  other 
bills  have  been  enacted. 
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We  carefully  and  deliberately  studied  what  was  going  on  m  New 
York.  Most  importantly  we  found  out  that  not  many  candidates 
wanted  the  disclosure  service.  No  more  than  3  percent  of  the  stu- 
dents who  took  the  SAT  in  New  York  in  1980-81  took  advantage  of 
our  question-and-answer  service.  ,    ,  • 

We  concluded  that,  at  that  level  of  demand,  five  national  admin- 
istrations which  now  accommodate  more  than  70  percent  ot  our 
candidates  would  effectively  meet  the  wishes  of  any  student  any-  - 
where  who  would  want  to  utilize  the  service.  •  ,  , 

We  also  used  the  opportunity  to  confirm  that  we  could  indeed 
live  with  the  disclosure  of  five  SAT  editions  a  year  without  compro- 
mising the  convenience,  the  quality,  or  the  fairness  of  the  tests, 
and  so  we  have  chosen  to  disclose  five  editions  nationally  to  pro- 
vide limited,  I  stress  limited,  disclosure  with  full  service  nationally, 
while  we  are  forced  by  the  unlimited  provisions  of  the  New  York 
law  to  curtail  services  and  increase  prices  there. 

The  board's  continuing  commitment  to  ope;jness  in  the  college 
admissions  testing  process,  our  demonstrated  responsiveness  to 
public  concerns,  and  our  good  faith  follow-through  on  our  ex- 
pressed intention  to  act  in  the  light  of  experience  with  disclosure 
in  New  York  demonstrate,  I  believe,  Messrs.  Chairmen  and  meni- 
bers  of  the  subcommittees,  that  the  board  is  not  at  odds  in  princi- 
ple with  the  stated  objectives  of  these  bills. 

And  I  bhould  say  here  that  however  much  we  may  differ  on  the 
substance,  legislators  like  yourselves,  concerned  about  education, 
have  performed  an  important  service  by  raising  the  issues  which 
we  are  addressing  in  this  forum. 

At  the  College  Board,  I  can  assure  that  that  we  are  doing  all  we 
can  at  this  point  in  time.  If  we  are  asked  to  publish  each  and  every 
SAT  edition  after  one-time  use,  the  quality  and  the  fairness  ot  the 
tests  will  be  compromised  and  the  opportunities  to  take  them,  par- 
ticularly on  the  part  of  the  handicapped  and  Saturday  Sabbath  ob- 
servers, will  be  greatly  diminished  if  not  destroyed. 

And  if  H.R.  1662  were  to  apply,  as  is  proposed,  to  our  subject 
matter  achievement- tests,  the  character  of  those  offerings  is  such 
that  we  would  undoubtedly,  albeit  most  reluctantly,  be  forced  to 
discontinue  them.  I  doubt  that  you  really  want  to  do  such  damage 
to  a  process  that  has  served  so  many  so  well.  ,    j-  - 

The  second  and  third  matters  which  you  have  asked  me  to  dis- 
cuss relate  to  the  two  flawed  test  questions  which  received  so  much 
attention  during  the  past  year.  The  discovery  of  one  was  the  result 
of  a  voluntary  service  of  the  College  Board  which  is  to  return 
PSAT  forms  free  to  all  students  nationally.  The  other  of  legisla- 
tively mandated  disclosure  of  the  SAT  in  New  York  State.  Both 
questions  were  found  to  have,  among  the  answers  presented,  one 
that  was  correct  in  addition  to  the  one  that  was  intended  as  cor- 

^^The  meaning  of  these  flawed  questions  is  that  the  tests,  like  all 
human  artifacts,  are  subject  to  human  fallibility.  In  one  sense,  the 
wonder  is  that  anyone  would  be  surprised  that  a  mistake  can  occur 
on  a  College  Board  test.  ,  ,  , 

In  another  it  is  that  out  of  more  than  1,500  questions  placed 
under  scrutiny  by  students  and  the  public  as  a  result  of  our  various 
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publications  since  January  of  1980  only  these  two  were  found  to  be 
flawed. 

In  both  of  these  instances,  where  scoring  was  already  completed 
and  reported,  the  Educational  Testing  Service  at  our  direction  re- 
scored  all  t>f  the  tests,  giving  credit  for  both  correct  answers  and 
rereporting  the  scores  to  all  receiving  institutions  even  though  the 
.  difference  in.  any  individual  SAT  case  was  no  more  than  2(n>oints 
on  the  test's  200-800  scale. 

In  other  words,  even  when  differences  are  small  our  policy  is  to 
correct  them,  not  only  to  avoid  any  possible  unfair  consequences  to 
the  students  but  because  to  do  otherwise  would  be  to  compromise 
the  credibility  of  a  process  which  we  view  as  a  public  trust 

Although  our  policy  for  many  ypars  has  been  to  entertain  and 
consider  seriously  any  challenge  to  the  accuracy  of  a  test  score,  or 
the  soundness  of  a  test  question,  at  any  point,  and  when  appropri* 
aie  to  take  remedial  action,  we  have  recently  formalized  and  ex- 
panded the  procedures  for  doing  so.  Where  the  views  of  a  challeng- 
er, generally  a  student,  and  the  view  of  Educational  Testing  Servt 
ice  cannot  be  reconciled,  we  have  added  a  procedure  for  independ- 
ent, impartial  tKifd-party  review  and  determination. 

I  believe  this  as  well  as  other  actions  I  have  described  to  you 
demonstrate  my  basic  point.  The  College  Board  was  founded  under 
voluiftary  educational  auspices  and  functions  as  a  public  trust  to 
perform  a  variety  of  services  to  help  students  and  institutions 
naake  better  decisions  about  each  other  and  themselves.  We  do  not 
make  those  decisions.  The  tests  we  sponsor  are  means,  rather  than 
ends,  means  to  help  implement  a  process  which  is  profoundly 
rooted  in  the  American  way  of  doing  things. 

We  intend  to  keep  those  means  responsive  to  the  interests  of  stu- 
dents, institutions,  and  the  public.  They  are  part  of  a  system  which 
.  is  certainly  susceptible  of  improvement  but  which  works  better 
than  any  other  in  the  world,  is  more  consistent  with  our  national 
values  than  any  other  could  be,  and  should  be  given  the  opportuni- 
ty to  continue  its  pursuit  of  equal  and  expanded  opportunity,  open- 
ness, fairness  and  accountability  without  the  burden  of  the  kind  of 
governmental  regulation  proposed  in  H.R.  1662. 

May  I  say  simply  in  conclusion  that  I  look  forward  to  the  possi- 
bility of  returning  to  Washington  later  this  year  to  discuss  with 
Mr.  Perkins'  subcommittee  the  pressing  matter  of  upgrading  the 
quality  of  schooling  in  America. 

H.R.  1662  focuses  on  the  role  of  tests  in  the  educational  enter- 
prise, but  a  much  more  fundamental  public  concern  today  has  to 
do  with  the  performance  of  our  schools.  For  the  eighties  the  Col- 
lege Board  initiated  a  decade-long  project.  Project  EQuality,  for  the 
purpose  of  helping  to  direct  attention  to  basic  academic  skills  and 
raise  educational  standards.  / 

I  woulcl  welcome  the  opportunity  to  share  with  the  subcommittee 
more  about  our  plans  and  objectives  in  this  effort. 

[The  prepared  statement  of  George  Hanford  follows:] 

Preparkd  Statement  or  George  H.  Hanford,  President,  the  CoLLkWE  Board 

Messrs.  Chairmen  and  members  of  the  Subcommittees,  my  name  is  George  H 
Hanford.  I  am  president  of  the  College  Board. 

Er|c  S3 
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The  College  Board  is  a  not-for-profit  national  association  of  more  than  2,500 
schools  and  colleges,  both  public  and  private  in  their  governance  It  was  founded 
eighty-one  years  ago  for  the  primary  purpose  of  makmg  the  process  of  gettmg  ad- 
mitt«i  to  college  easier  and  fairer  for  more  students  than  had  Previously  been  the 
case;  in  other  words  to  expand  access  to  postsecondary  education  This  has  contin- 
ued to  be  its  purpose.  j   •  ■  * 

The  Board  provides  services  to  students  an  institutions  in  college  admissions,  stu- 
d^nt  financial  aid,  counseling,  guidance,  placement,  and  credit  by  examination 
These  services  are  sponsored  by  the  members  in  furtherance  of  the  Board  s  purpose, 
but  are  available  to  all  individuals  and  educational  institutions  that  wish  to  make 
use  of  them.  The  policies  under  which  they  are  provided  are  established,  and  the 
services  themselves  are  continuously  overseen,  by  a  Board  of  Trustees  elected  hy  the 


Among  those  services  are  certain  standardized  test,  "^cl^^mg  the  ^^^^ 
Scholastic  Aptitude  Tests/National  Merit  Qualifying  Test  (PSAT/NMSQT)  the 
Scholastic  Aptitude  Test  vSAT),  and  various  Achievement  Teste,  which  would  be  af- 
fected by  HR  16G2.  the  Educational  Testing  Act  of  1981. 

The  Board  contracte  with  Educational  Testing  Service  of  Princeton,  New  Jersey  to 
prepare  and  administer  these  teste.  But  as  sponsor  and  representative  of  the  institu- 
tions which  use  the  teste,  the  Board  set  the  policy  and  is  responsible  for  the  process 

I  am  therefore  grateful  for  the  invitation  of  the  Subcommittees  to  testify  on  HK 
1662,  the  Educational  Testing  Act  of  1981.  The  invitation  specified  three  questions 
which  the  Subcommittees  wished  me  to  address.  I  shall  do  so  in  the  context  of  a 
briftf  Keneral  statement.  .      ,  .  .   r  ■ 

The  declared  purpose  of  these  bills  is,  among  other  things,  to  promote  fairness, 
equity,  and  accountability  in  the  use  of  teste  in  college  admissions  by  giving  stu- 
dente  and  the  public  more  information  about  these  teste.  . 

The  issues  of  fairness,  equity  and  accountability  have  been  primary  concerns  ot 
the  members  and  staff  of  the  College  Board  from  its  incepfaon  Our  teste  them- 
selves-first  only  in  academic  subject  matter  areas,  later  jomed  by  standardized 
teste  of  developed  mathematical  and  verbal  reasoning  ability-were  introduced  at 
the  outset  as  one  reliable  means  of  establishing  a  "common  currency  of  academic 
attainment  by  college-bound  studente  no  matter  where  they  came  from  or  where 
they  wanted  to  go  to  college.  They  afforded  one  of  the  few  assurances  of  objective 
and  uniform  assessment  that  our  educational  system  could  offer  to  document  mas- 
tery of  the  skills  and  knowledge  that  were-and  are-considered  essential  to  success 
in  doing  college  work.  r     j  r 

These  same  teste,  because  of  their  uniformity  and  objectivity,, their  freedom  from 
the  taint  of  personal  infiuence  or  social  or  economic  position,  have  made  it  possible, 
especially  in  the  years  since  World  War  II,  for  millions  of  high  school  graduates  who 
might  not  otherwise  have  been  considered  "college  material  to  validate  their  quali- 
fications for  such  opportunity  and  gain  admission  to  college  They  have  been  an  in- 
dispensable tool  in  advancing  the  cause  of  equal  as  well  as  expanded  educational 

°^The  Boa?d  s  concern  with  equal  and  expanded  opportunity  has  not.  however,  been 
confined  to  testing  as  such.  In  the  1950s,  the  Board  pioneered  the  concept  of  need- 
based  student  financial  aid,  thereby  helping  to  open  the  door  to  college  for  millions 
of  economically  disadvantaged  studente.  It  developed,  and  today  f  "ducts,  the 
nation's  largest  program  to  help  studente  present  their  economic  needs  to  colleges, 
Snd  to  help  colleges  work  out  t>ie  means  to  help  theni  through  scholarships,  loans 
and  jobs  to  pursue  their  educational  aspirations.  We  see  this  service  as  an  essential 
complement  to  the  service  of  helping  studente  to  present  their  academic  credentials. 

In  the  early  19C0s,  the  Board  moved  to  make  those  services  equally  and  insepara. 
biy  available  to  minority  and  majority  studente  alike  by  desegregating  all  of  ite  test- 
ing centers  throughout  the  nation-often  at  the  risk  of  personal  harm  to  those  in- 
volved. But  It  was  done,  and  even  today  testing  sites  are  selected  with  attention  o 
minimizing  the  sense  for  any  student  that  he  or  she  is  entering  foreign  territory  to 

^^T^^Vusl^of  fuller  information  for  studente  and  better  public  understanding  of 
teste  and  the  admissions  process  (including  the  intricacies  of  student  financial  aid) 
has  also  been  the  Boards  cause.  Again  in  the  1950s  when  the  conventional  wisdom 
n  education  said  that  studente  should  not  be  given  their  scores  on  standardized 
teste  because  they  might  not  understand  them  properly,  the  Board  adopted  the  prac- 
tice of  reporting  scores  directly  to  studente  as  well  as  to  their  schools  and  th3  col- 
leges to  which  they  were  applying.  .  f  11 

l^he  standard  practice  of  presenting  sample  questions  and  a  full  explanation  of 
the  nature  and  form  of  the  teste  was  adopted  in  the  Board  s  earliest  years  And  the 
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Board  has  consistently  acted  to  expand  the  information  provided  to  students  as  ad- 
vancing knowledge  demonstrated  the  educational  soundness  of  domg  so,  and  the  in- 
terests of  students  indicated  its'  desirability.  The  Preliminary  Scholastic  Aptitude 
Test  was  devised  as  a  means  of  providing  guidance  information  earlier  in  their  high 
school  careers.  Practice  samples  of  the  SAT  were  offered  in  the  1960s  and  in  1978 
the  Board  began  providing  free  to  all  registrants  a  full  sample  SAT— an  actual 
test— which  could  be  taken  under  timed  conditions  for  further  familiarization  and 
^  guidance. 

All  of  which  means,  Messrs.  Chairmen  and  members  of  the  Subcommittees,  that 
the  Board  is  not  at  odds  in  principle  with  the  stated  objectives  of  this  and  similar 
bills.  And  I  should  say  here  that  however  we  may  differ  on  the  substance,  legislators 
concerned  about  education  have  performed  an  important  service  by  raising  the 
issues  which  we  are  addressing  in  this  forum.  The  broad  public  discussion  that  has 
been  generated  in  these  halls  and  in  state  legislatures  across  the  nation  has  helped 
us  to  create  broader  public  awareness  of  how  admissions  tests  are  used— to  help  stu- 
dents get  into  college  rather  than  turn  them  away— than  our  educational  efforts 
could  have  achieved  alone,  i 

Nevertheless,  we  oppose  such  bills.  Not  because  we  oppose  the  interest  and  con- 
cern they  express,  which  we  share,  but  because  we  believe  that  the  Board's  educa- 
tional commitment  and  actions,  and  those  of  other  test  sponsors,  make  t|iese  bills 
unnecessary  and  therefore  inherently  undesirable;  and  because  the  specific  provi- 
sions of  these  bills  would  adversely  afTect  our  ability  to  sustain  the  present  level  and 
quality  of  service  which  we  offer  to  students  and  institutions.  Other  test  sponsors 
will  surely  speak  for  themselves,  but  I  believe  it  is  fair  to  say  that  all  of  them  .are 
committed,  as  is  the  Board,  to  providing  leadership  in  promoting  fairness,  equity 
and  accountability,  and  to  the  furtherance  of  public  information  and  understanding 
of  testing  and  \\a  place  in  the  process  of  admission  to  higher  education. 

The  college  admissions  process  no  less  than  curriculum  content  is  a  .sensitive  edu- 
cational area  which  is  uniquely  carried  out  in  this  country  by  purely  voluntary  and 
pluralistic  means,  consistent  with  the  deepest  values  of  our  democratic  system.  We 
feel  that  standardized  testing  and  the  admissions  process  of  which  it  is  a  part  should 
remain  the  responsibility  of  the  educational  community,  in  a  voluntary  and  pluralis- 
tic system  nurtured  by  the  schools  and  colleges  themselves  without  federal  or  state 
intervention.  This  country  is  blessed  With  perhaps  the  best  and  most  egalitarian 
system  of  higher  education  in  the  world,  and  the  sj;stem  that  created  it  should  not 
be  altered  without  compelling  reisons.  We  do  not  think  such  reason  exists. 

Let  me  now  turn  to  the  first  of  the  Subcommittees*  (juestions.  the  reasons  that  the 
College  Board  adopted  a  policy  in  March  of  1981  to  provide  a  national  question-and> 
answer  service  at  five  administrations  of  the  Scholastic  Aptitude  Test,  so  that  any 
student  at  such  administrations  could  order  copies  of  his  or  her  answer  sheet,  the 
correct  answers,  and  a  copy  of  the  questions  that  counted  toward  his  or  her  score. 

I  have  said  that  the  Board  historically  has  pursued  a  policy  of  opening  informa- 
tion  about  the  tests  to  students,  and  the  public,  and  I  have  highlighted  some  of  the 
earlier  actions  along  this  line.  I  should  also  note  that  just  in  the  last  year  and  a 
half,  the  Board  has  substantially  increased  its  information  services  m  several  other 
ways  first,  by  providing  a  similar  question-and-answer  service  to  all  students  taking 
the  PSAT/NMSQT,  by  providing  a  national  score  verification  service  option  for  stu- 
dents who  wanted  to  check  their  scores  but  did  not  want  all  of  the  questions  and 
answers,  and  'by  publishing  and  distribututing  widely  copies  of  additional  actual 
tests,  including  one  accompanied  by  full  technical  data  on  its  development  and  per- 
formance in  use. 

In  this  context,  the  *March  action  is  an  extension  of  policies  already  in  eflect,  and 
it  was  tiiken  for  three  main  reasons: 

The  first  reason  was,  in  fact,  our  stiinding  policy  of  commitment  to  full  informa- 
tion, to  expending  information  al>out  testes  to  students  and  the  public  so  long  as  it 
does  not  adversely  affect  the  cost  or  quality  of  services  to  students,  and /or  the  reii- 
ability  and  fairness  of  the  testd. 

The  second  reason  was  t^e  conclusion,  reached  by  our  Board  of  Trustees  after 
careful  stjd:^  of  our  exfierience  with  a  New  York  State  law  similar  to  HR.lfi62  that 
1)  such  service  and  information  could  be  offered  on  a  limited  basis  to  all  students 
without  damaging  the  quality  of  the  test  or  disadvantaging  students  who  need  spe- 
cial administrations,  and  2j  that  the  very  small  demand  demonstrated  in  New  York 
State  for  the  question  and  answer  service  the  overall  total  for  the  1980  -81  testing 
year  was  3  percent— meant  that  to  offer  the  service  nationally  at  administrations 
which  now  accommodate  70  percent  of  students  would  effectively  meet  the  wishes  of 
any  student  anywhere  who  would  be  likely  to  want  the  .service. 
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The  third  was  the  Board's  desire  to  demonstrate  again  that  it  is  both  sensitive 
and  resjinsive  to  pubUc  interest  in  the  testing  process.  'hat  .t  .s  po^.b  e  for 
the  Board,  given  the  time  to  do  so,  to- develop  a  program  of  action  that  demonstrates 
such  resp^nsiveness-even  where  we  may  question  wnether  'here  is  educat.ona 
value  to  be  gained.  Our  goal  in  the  words  of  the  Board's  chairman,  Dean  Fred  Har- 
gadon  of  Stanford  University,  was  to  "satisfy  both  proponents  of  test  disc  pure  ond 
nroponents  of  a  testing  program  that  produces  reliable  and  valid  results.  In  short, 
Kughf  to  prove  that  the  self-regulating  and  voluntary  system,  given  the  tjme 
and  opportunity,  can  address  legitimate  concerns  withqut  the  penalities  that  accom- 
^  nanvithisicind  of  governmental  intervention.  .    .1..  r 

Tetb«lieve  we  have  done  that.  Although  offering  very  extensive  opportunities  for 
thrqSn'and.answer  service,  the  schedule  adopted  by  the  Trustees.does  not  sac 
riHcSe  additional  opportunities  to  take  the  test  that  afford  convenience  to  some 
studente  and  institutions,  and  meet  the  special  needs  gf  many  more  oi  them. 

I  must  also  tell  you  in  all  good  faith  that  we  are  at  th.s  PO'nt  doing  as  much  as 
the  current  state  of  the  testing  art  permits  in  our  program.  If  the  Board  were  r(^ 
qmred  to  provide  question-and-answer  service  at  additional  administrations  of  the 
IaT  the  characte?of  our  program  is  such  that  we  would  be  forced  to  reduce  our 
,  ^hed-ule  to  those  administratk,ns  where  we  now  plan  .to  offer  the  question^and- 
answen  feature,  and  to  eliminate  all  other  regular  administrations  and  most  s^^^^^^^^ 
adminftktrations  for  institutional  purposes,  makeup,  and  to  meet  the  needs  of  handi- 

'°FSher£S'if  the  law  were  to  apply  to  our  subject-matter  Achievement  Tests. 
thrcharacTer  of  that  program  is  such  that  we  would  undoubtedly,  albeit  most  reluc- 
tantly, be  forced  to  phase  them  out.  „  ,  .  ^  .  u  j  *  j„  ..,.•♦1, 
TT^e  ^cond  and  third  questions  which  the  Subcommittees  posed,  had  to  do  w  th 
the  discovery  of  two  flawed  test  questions,  one  in  a  nationally  administered  edition 
of  the  PSAT/NMSQ'r.  and  another  on  a  form  of  the  SAT  administered  in  New  .York 
State  The  d  scov^  of  one  of  these  was  therefore  the  i-esult  of  yoluntary^seryice  of 
the  Board  in  returning  PSAT  forms  to  all  students,  and  the  other  the  result  of  a 
egisktWeiy  mandated  lervice  in  New  York  State.  Each  question  was  found  to  have 
amon^  the  answeb  presented,  one  that  was  correct  in  addition  to  the  one  that  was- 

'"Thf  meaning  SL'flZed  questions  is  that  the  tests,  like  all  human  artifacts^ 
are  subTcct  toTiuman  fallibility.  In  one  sense,  the  wonder  is  that  anyone  would  be 
surp"hat  a  mistoke  can  occur  on  a  College  Board  test  In  another  it  is  that  out 
of  more  than  1.500  questions  placed  under  scrutiny  by  students  and  the  publ  c  as  a 
Result  of  our  various  p_ublications  since  January  l980.  only  these  two  were  found  to 

'^We  are  not  complacent  about  such  flaws,  and  we  try  to  avoid  them  through  exten- 
sive quality  control.  Test  authors,  editors,  and  test  development  committees  of  hieh 
lihooT3conege  people  all  review  the  questions  repeatedly  and  intensively  for 
nnws  of  all  kinds-include^  .   .  j- 

This  sc  itiny  contfnles^^^^  the  administration  and  scoring  'he  test  and  m 
those  rare  instances  when  a'flaw  is  discovered  by  us  or  «"y°"e  else  at  that  poi^^^^^ 
our  policy  is  very  simple.  We  correct  ^he  error  with  a  primary  regard  to-fa"-"ess  for 
an  students  In  both  recent  instances,  where  scoring  was  aUeady  completed  and  re- 
tried the 'Educ^ional  Testing  Ser^lice  at  our  direction  rescored  alf  of  the  teste. 
S  c  edit  for  both  correct  answers,  and  re-reported  the  scores  to  a"  ^ece'v  ng  n- 
Stitiitlonq  even  thouch  the  difference  in  any  individual  case  was  no  more  than  i 
nte  on  the  PSATs^20:80  scale  and  20  points  on  the  SATs  200-800  scale  In  other 
words  even  where  differences  are  small,  we  correct  them  not  only  to  »v.oid  any  pos- 
S  unfai?  Consequences  to  the  students,  biit  because  .to  do  otherwise  would  be  to 
rnmnromise  the  Credibility  of  a  process  which  we  view  as  a  public  trust.  _ 

Afthough  ou?  Fi.licy  for  many  yea^  has  beento  consider  serious  y  any  cha  lenge 
to  the  accuracy  ^  a  test  score  o^  the  eOTt;^a  test  question  at  «ny  point  and 
-  where  appropriate  to  take  remedial  action,  we. have  recently  formalized  and  expand- 
ed the  nrocwlures  for  doing  so.  Where  the  view  of  a  challenger-generally  a  stu- 
dent-and  the  view  of  Educational  Testing  Service  cannot  be  reco.iciled.  vve  have 
added  a  procedure  for  independent,  impirtfal  third-party  review  and-*termination  - 

I  t^lieve  th"=  and  the  other  actions  f  have  described  to  you  demonstrate  .my  baSic 
DO  nt  The  Collece  Board  was  fountled  under  voluntary,  educational  auspices,  and 
Cols  as  a'Sliftrustto  perfor'm  a  variety  °f  «™ WeX^;^^^^ 
stitutions  make  better  decisions  about  each  other  and  about  themselves  We  ao  nw 
make  thL^  decisions.  The  tests  we  sponsor  are  means,  rather  than  ends,  to  impl^ 
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the  public.  Thev  ure  purt  uf  a  aystem  which  is  certainly  susceptible  of  improvement, 
but  which  works  btjtter  than  an>  other  in  the  world,  is  more  consistent  with  our 
national  values  than  an>  other  could  be,  and  should  be  given  the  opportunity  to 
continue  its  pursuit  of  equal  and  expanded  opportunity,  openness,  fairness  and  ac- 
countability without  the  burden  of  the  kind  of  government  regulation  proposed  in 
HR  1662. 

May  I  say,  finally,  that  I  look  forward  to  the  possibility  of  returning  to  Washing- 
ton later  this  year  to  discuss  with  Mr.  Perkins'  Subcommittee  the  pressing  matter  of 
upgrading  the  quality  of  schooling  in  America.  HR  1662  focuses  on  tharole  of  tests 
in  the  educational  enterprise,  but  a  much  more  fundamental  public  concern  today 
had  to  do  with  the  performance  of  our  schools.  For  1980s  the  College  Board  has  ini- 
tialed a  decade-long  project^Project  EQuality— for  the  purpose  of  helping  to  direct 
attention  to  basic  academic  skills  and  raise  educational  standards.  I  would  welcome 
the  opportunity  to  share  with  the  Subcommittee  more  about  our  plans  and  objec- 
tives in  this  effort. 

Mr.  Weiss.  Thank  you  very  much. 

Mr.  Zimmfer?  '  -  • 

STATEMENT  OF  BRUCE  ZIMaMER,  EXECUTIVE  DIRECTOR,  LAW 

SCHOOL  ADMISSION  COUNCIL  ^  . 

Mr.  ZiMMER.  My  name  is  Bruce  Zimmer,  executive  director  of 
Law  School  Admission  Council,  a  nonprofit  educational  association 
whose  members  are  all  of  the  ABA  approved  law  schools. 

Directly  and  throupb  our  operating  Corporation,  Law  School  Ad- 
missions Services,  we^pfovjde  a  wide  array  of  services  eftid  publica- 
tions related  to  law  school  admission- 
One  of  those  is  the  Law  School  Data  Assembly  Service,  the  na- 
tional system  of  gathering  and  distributing  academic  and  bio- 
graphical information  for  the  law  school  admissions  process. 

We  put  a  substantial  effort  in  this  program  in  order  to  render 
more  readily  comparable  .and  democratic  records  and  evaluation  of 
applicant  academic  records  in  the  admissions  process. 

Each  year  information  concerning  100,000  people  from  3,000  col- 
leges applying  to  over  250  law  schools  is  collecfted,  processed  and 
communicated  through  this  systeni.  The  law  school  admission  test 
is  another  valuable  component  of  the  national  law  school  admis- 
sion program.  We  contract  with  the  ^American  college  testing  pro- 
gram and  Educational  Testing  Service  for  the  development  of  tht 
law  school  admission  test.  /  ^ 

The  test  Is  administered  under  the  auspices  of  our  operating  cor- 
poration, Law  School  Adrtiission  Services.  »  , 

The  Law  School  Admission  Council  does  not  support  added  legis- 
lation to  regulate  educational  testirjig  agencies  or  test  use.  We  are 
not  persuaded  that  there  remain  problems  which  demand  legisla- 
tive ren»ody,  or  that  the  asserte^d  benefits  of  such  legislation  would 
outweigh  the  detriments  of  addjtiopal  regulation  of  an  educational 
community  already  burdened  with  extensive  regulation. 

Further,  the  impact  of  voluntary  and  responsive  actions  of  test- 
ing organizations  is  steadily  becopiing*  more  apparent  to  our  con- 
suming and  evaluating  publics,  ^cnd  especially  to  our^ritics.  The 
recent  record  of  test  programs  li^e  ours  may  or  may  hot  document 
a  need  for  some  forms  of  regulation  of  educational  testing.  We  wel- 
come study  of  this  question.   '    /  ,  * 

We  support  the  continued  oversight  of  Cohgresd  in  tRis  matter. 
But  we  do  not  think  a  case  for  Federal  admission  test  legislation 
has  as  yet  been  ma.*j:  /  v 

/ 

/ 
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The  idea  of  Federal  testing  legislation  is  not  in  itself  unthink- 
able. Under  certain  potential  circumstances  a  national  law  could 
preempt  conflicting,  confusing  and  oppressive  State  enactments. 
One  appropriate  and  coherent  scheme  of,  regulation  would-be  pref- 
erable to  many  uncoordinated  and  burdensome  schemes. 
'  Indeed,  our  own  research^  has  led  us  to  conclude  that  a  sound 
model  preemptive  ac|  could  readily  be  developed.  But  the  circum- 
stances we  face  today  suggest  that  enactment  of  a  Federal  test  law 
in  the  near  future  would  be  prematur,e  and  probably  unnecessary. 

The  national  debate  on  testing  for  higher  education  admission 
has  come  a  very  long  way  irf  the  4  or  5  years  that  testingbills  have 
been  receiving*  serious  attention  from  State,  legislatures^nd  from 
.  Members  of  Congress  and  their  staffs,  The  environment  in  which, 
testing  programs-operate  has  changed  dramatically  since  July  1979 
when  New  Yopk  enacted  a  test  disclosure  law  to  become  .effective 
at  the  start  of  1980. 

At  different  rates,  many  testing  organizations  have  made  major, 
mdeed  what  2  or  3  years  ago  would  have  been  thought  revolution- 
ary, commitments  to  openness  in  their  testing  programs. 

The  Law  School  Admission  Cduncil  has  offered  test  disclosure  for 
•    all  of  our  tests  throughout  the  United  States  and  throughout  the 
world,  other  than  some  very  limited  special  administrations,  since 
the  New  York  law  took  effect.       '     -  *     ,  .  . 

The  New  York  test  la\^  did  not  permit  us  to  continue  our  historic 
method  of  making  scores  comparable  from  test  to  test,- and  still  dis- 
close every  form.  Our  decision  to  adopt  universal  test  disclosure 
thus  triggered  a  significantly  revised,  structure  for  qur  test. 

As'^a  result  of  that  change  we  are  planning  to  introduce  a  revised 
LSAT  in  Jilne  1982.  It  will  be  comprised  of  four  scored  reading  and^ 
.   reasoning  sections,  two  unscored  pretest  or  equating  sections  and 
an  unscored  writing  exercise  for  individual  law  school  evaluation. 

A  10  to  oO  score  scale  will  replace  the  current  200  to  800  scale. 
We  have  put  into  the  record  some  substantial  explanatory 
material.  •  ^ 

Mr.  Weiss.  Without  objection,  that  will  be  received. 

Mr.  ZiMMER.  We  are  presently  contracting  to  develop  an  ade- 
quate inventory  of , this  education  of  the  LSAT.  Having  developed 
such  a  supply,  |We  plan  to  address  ourselves  to  emerging  methods 
ana  technolugit^b  in  evaluation  in  order  to^  provide  to  law  school  ap- 
"  phcants  in  the  late  eighties  and  early  nineties  the  best  academic 
measure  that  can  be  provided  at  that  time.  • 

Test  disclosure  is  a  service  law  school  test-takers  desire,  and  for 
which  they  are  willing  to  pay.  Because  consumer^ demand  for  dis- 
closed  tests  had  become  so  substantial,  about  60  percent  of  our  test- 
-  takers,  by  the  second  year  of  test  disclosure,  and  bfecguse  of  an  en- 
hanced interests  oji  our  part  in  providing  an  extta  increment  of 
quality  assuVance  for  our  test,  the  Law  School  Admission  CouncU 
Board  of  Trustees  elected  to  make  test  and  answer  record  disclo-  ^ 
sure  an  automatic  part  of  the  reporting  procedures  for  test-takers, 
beginning  with  the  1981-82  test  year. 

This  is  a  culmination  of  basic  commitments  on  our  part.  We  are 
\  rebuilding  our  services  to  accommodate  our  comsumers*  int'^rest  in 
^openness  in  testing. 
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Two  years  ago  the  State  of  New  York  took  a  decisive  position  on 
test  disclosure.  It  insisted  on  immediate  action  on  full  test  disclo- 
sure! A  sensible  scheme  of  phased  applicability  would  have  been 
more  fruitful.  By  giving  4  or  5  months  notice  for  radical  change  to 
organizations  that  had  hitherto  operated  on  much  longer  test  de- 
velopment leadtimes,  New  York  disrupted  the  orderly  conduct  of 
testing,  programs  like  ours. 

Its  actions  caused  increases  in  applicant  fees  that  probably  would 
not  have  been  under^taken  on  the  initiative  of  testing  organizations 
alone.  The  1979  New  York  law  produced  substantial  technical  prob- 
lems and  some  areas  of  unintended  encumbrance  and  intrusion. 
Several  of  these  problem  area?  were  modified  in  1980  in  a  coopera- 
tive effort  in  which  our  organization  took  an  active  part. 

Over  time  full  analysis  of  the  impact  of  disclosed  testing  on  test 
results  must  await  research  that  can  be  performed  only  after  sever- 
al years  of  disclosed  testing. 

In  no  small  measure  the  New  York  act  has  worked  reasonably 
because  c'^the  prudent  regulations  and  sensible  enforcement  proce- 
dures of  tiie  New  York  Education  Commissioner  and  his  staff. 

Indeed,  as  the  various  test  programs  adjust  to  disclosed  testing, 
there  is  a  greater  risk  that  ill-advised  regulations  and  enforcement 
procedures  will  emanate  from  the  State  educational  bureaucracies 
.  than  there  is  a  probability  that  substantive  provisions  of  a  New 
York-type  law  would,  themselves,  prove  intolerant  if  enacted  in  an- 
other State. 

"There  is  little  question  that  to  date  New  York  has  effectively 
preempted  the  national  testing  i«sue.  It  has  acted,  in  effect,  to  set  a 
national  standard  for  many  test  programs.  As  Pennsylvania  has 
done  in  the  area  of  agricultural  product  standards  and  as  New 
York  itself  has  done  in  the  insurance  law  field,  it  has  established  a 
de  facto  national  standard. 

New  York  has  done  this  by  providing  a  powerful  impetus  to  in% 
creased  test  disclosure  nationwide.  That  impetus  has  come  by 
virtue  of  the  need  and  desire  of  test  sponsors  to  maintain  testing 
opportunities  for  New  York  students  and  schools,  as  well  as  from 
the  momentum  of  public  opinion  arising  as  test  disclosure  in- 
creased scrutiny  of  the  underlying  soundness  of  admission  testing. 

Testijig  organizations  like  ours  have  discovered  that,  on  balance, 
test  disclosure  promoted  public  confidence  in  the  integrity  of  the 
test  instrument  and  the  testing  process.  It  became  symbolic  of  our 
public  accountability.  Indeed,  openness  has  helped  us  in  our  quality 
control  ef/orts.  ^ 

As  other  States  haye  considered  test  legislation  in  the  last  2 
years,  nearly  all  have  deferred  to  the  New  York  law  and  experi- 
ence as  reference  points.  Mosf  haye  concluded  that  the  colisider- 
able  progress  toward  national  test  disclosure  made  by  programs 
*^  like  oure,  steadily  joined  by  a  growing  list  of  major  test  sponsors, 
had  obviated  the  need  for  State-by-State  regulation. 

In  many  instances,  test  sponsors  have  accelerated  ^their  commit- 
ment to  openness  in  order  to  show  good  faith  and  thus  eliminate  a 
need  for  potentially  burdensome  regulation  During  this  past  year's 
sessions  there  was  support  in  several  State  legislatures  for  lesser 
included  variants  of  the  New  York  law. 
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One  such  bill  is  still  under  active  review  in  California,  another 
due  for  renewed  consideration  in  the  next  session  in  .Minnesota. 
Florida  considered  such  a  law  in  this  year  s  session.  In  each  ol 
these  casess  more  than  trivial  support  for  legislation,  rione  of  it  as 
vet  enacted,  came  from  education  committee  members  and  mem- 
bers on' the  legislative  floor  only  after  acceptance  of  provisions  sig- 
nificantly less  harsh  than  New  York  law  or  H.R.  Ibb^.  ,    .  „ 

Legislature  study  of. varied  problems  of  developing  and  producing 
tests  led  to  reduction  in  the  demand  that  every  test  form  immedi- 
ately be  disclosed,  so  long  as  a  substantial  right  to  disclosed  testing 
was  preserved  for  those  desiring  that  service. 

Careful  analyses  of  the  need  foV,  research  and  technical  informa- 
tion about  tests  led  legislators  to  modify  eliminate  or  focus  the 
"dragnet"  style  research  filing  requirements  of  the  New  York  law. 

Oregon  a  State  „wjth  an  effdctiye  consumerist  base,  provided 
strong  legislative  support,  still  sHort  of  that  needed  for  passage,  for 
the  190  amended  New  York  law.:  But,  none  of  the  many  States  evi- 
dencing strong  interests  in  testing  law  has  ignored  the  experience 
of  the  past  2  years.  I         ,     ,  i  .•      rr  *. 

None  has  sought  to  limit  prematurely  the  self-regulating  effort 
evident  in  most  parts  of  the  national  testing  community^t  While 
every  State  legislative  proposal  given,  serious  consideration  in  1981 
has  reflected  the  progress  that  has  been  made  in  the  last/  year  or 
two.  H.R.  1662  has  remained  materially  unchanged  from  its  H.K. 
4949  progenitor,  drafted  in  1979  after  the  New  York  law  was  en- 
acted and  before  its  effect  prodjiced  radical  changes  in  the  proce- 
dures of  many  testing  programs.      •  / 

State  legislators  have  learn^l  that  when  it  may  be  possible, 
indeed  useful,  in  testing  for  admission  to  one  career  or  profession 
may  not  be  so  for  another.  Th4y  have  come  in  some;measure  to 
accept  the  differences 'in  the  character  of  tests  and  of  ^their  use  in 
admission  processes.  j  ,  /      j  j 

The  Congress  should  avail  itself  of  records,  memoranda,  and 
other  products  of  hundreds  of  hours  of  State  hearings  t-hat-have 
taken  place  in  the  year  since  last  we  spoke  of  these  matters  in  this 

respectfully  request  that  if  tke  Congress  is  to  consider  a  nation- 
al testing  law  that  it  not  disregard  the  major  changed,  both  volun- 
tary and  coerced,  that  are  so  rapidly  taking  place  in  trie  admissions 
testing  environment.  As  long  as  no  State  adopts  a  coi^flicting  law, 
rather  than  a  lesser  included  laW,  New  York  will  provide  a  nation- 
al standard  admission  testing  la^v.  ik^^^r^mn 
steadily,  many  testing  organizations  voluntarily  and\by  coercion 
are  adopting  national  test  discl'psure  policies.  The  fordes  that  are 
getting  them  there  should  be  fallowed  a  bit  more  ti^ne  to  take  ■ 

^^U^\n  a  year  or  two,  the  progress  hitherto  made  tdwardWoluntary 
openness  in  admission  testing  has  not  been  maintained;  or  if  in 
that  time  conflicting  State  laws  and  regulations  have  actulally  been 
enacted,  the  Congress  might  then  consider  a  preemptive^^Fede.al 

We  wmibe  pleased,  at  that  time,  to  assist  in  the  effort. 
Thank  Vou  very  much.        „       „.         r  n  i 
(The  prepared  statement  of  Briice  Zimmer  follows:] 
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Prepared  STATKMENh\oF  Bruce  Zimmer,  Executive  Director,  Law 
School  Admission  Council,  Washington,  D.C. 

The  Law  School  Admissior^yCounclI  is  a  nonprofit  educational  association 
whose  members  are  the  171  law  Schools  approved  by  the  American  Bar  Asso- 
ciation. Directly  and  through  our  operating  corporation,  La^*^  School 
Admission  Services,  we  provide  a  wide  array  of  services  and  publications 
related  to  law  school  admission.  Our  most  administratively  and  operationally 
complex  program  is  carried  out  by  our  own  corporation.  It  is  the  Law  School 
Data  Assembly  Service,  the  national  system  of  gathering  and  distributing 
academic  and  biographical  information  for  the  law  school  admission  process. 
By  virtue  of  our  substantial  effort  to  render  diverse  academic  records  readily 
comparable,  this  system  has  been  instrumental  In  encouraging  the  considera- 
tion and  evaluation  of  applicant  academic  records  in  the  admission  process. 
Each  year,  Inforoiation  concerning  100,000  people  from  3,000  colleges  applying 
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to  over  250  law  schools  is  collected,  processed  and  communicated  through  this 
system.  Our  many  other  varied  activities  aimed  at  the  support  and  improve- 
ment of  the  law  school  admission  process  are  described  in  Appendix  B,  The 
Law  School  Admission  Test  is  another  valuable  component  of  the  national  law 
school  admission  program.  We  contract  with  the  American  College  Testing 
Progr^im  and  Educational  Testing  Service  for  the  development  of  the  Law 
School  Admission  Te^t.  The  test  U  administered  under  the  auspices  of  our 
operating  corporation,  Law  School  Admission  Services.  On  behalf  of  the 
Council  I  wish  to  thank  this  Committee  for  the  opportunity  to  present  our 
views  ana.  to  respond  to  your  questions. 

Proposed  testing  legislation  has  Impact  upon  a  large  number  and  wide 
variety  of  test  sponsors,  testing  agencies,  and  test  score  users,  as  well  as 
upon  test-takers.  No  one  can  sp'eak  for  all  members  of  any  of  these  cate- 
gories. We  speak  only  for  ourselves  and  for  the  test-using  law  schools  that 
arc  our  members.  No  other  test  sponsor  or  test  agency  speaks  for  us.  The 
Law  vSchooi  Admission  Council  does  not  support  added  legislation  to  regulate 
educational  testing  agencies  or  test  use.  We  are  not  persuaded  that  there 
remain  problems  which  demand  legislative  remedy,  or  that  the  asserted  bene- 
fits of  sach  legislation  would  outweigh  the  detriments  of  additional  regulation 
of  an  educational  community  already  burdened  with  extensive  regulation. 
Further,  the  impact  of  voluntary  and  responsive  actions  of  testing  organi- 
zations Is  steadily  becoming  more  apparent  to  our  consuming  and  evaluating 
publics  —  and  especially  to  our  critics.  The  recent  record  of  test  programs 
tike  oura  may  or  may  not  document  a  need  for  some  forms  of  regulation  of 
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edacattonal  testing.  We  weicome  study  of  this  question.  We  support  the 
Continued  oversij;ht  of  Congress  in  t'lis  rnatter.  But  vve  do  not  think  a  case 
for  Federal  admtbslon  test  lr;giaiation  has  as  yet  been  -nade. 

The  idea  of  feder-ii  testing  legislation  is  not  in  itself  unthinkable. 
Under  certain  potential  circumstances  a  national  law  could  preempt  conflicting^ 
con^45in^^  and  oppressive  state  enactments.  One  appropriate  and  coherent 
5cheme  of  reRuiatlon  would  be  preferable  to  many  uncoordinated  and  bur- 
d>;nson»»  schemes.  Indeed,  our  own  research  has  led  us  to  conclude  that  a 
"iounii  node!  '>reenpUve  act  could  readily  be  developed.  Rut  the  circu»n- 
♦taacsJs  f.t«,/»  tuday  suggest  that  enact.nnent  of  a  federal  test  law  in  the  near 
fut»ir«?  jtfouid  he  orenature  and  probably  unnecessary. 

The  aatiynai  debate  on  testing  for  higher  education  adoUssion  has  come  a 
very  long  Aray  m  the  four  or  five  years  that  testing  bills  have  been  receiving 
scriuus  attention  fron  state  legislatures  and  from  members  of  Congress  and 
their  si  tffs.  The  environment  in  which  testing  programs  operate  has  changed 
dramatically  since  July  1979  when  *Iew  York  enacted  a  test  disclosure  law  to 
become  effective  at  the  start  of  1980.  At  different  rates,  many  testing  or- 
ganizations have  made  najor  —  Indeed  what  two  or  three  years  ago  would 
have  been  thought  revolutionary  —  commitments  to  openness  in  their  testing 
programs.  The  Law  School  Admission  Council  has  offeretl  test  disclosure  for 
ail  of  our  tests  throughout  the  United  States  and  throughout  the  world,  other 
than  some  very  limited  special  administrations,  since  the  New  York  law  took 
effect.  The  New  Yorlj:  test  law  did  not  permit  us  to  continue  our  historic 
method  of  making  scores  comparable  from  test-to-test,  and  still  disclose  every 
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form.  Our  decision  to  adopt  universal  test  disclosure  thus  triggered  a  signi 
ficanlly  revised  structure  for  our  test.  As  a  result  of  that  change  we 
planning  to  Introduce  a  revised  LSAT  in  June  1982.  It  will  be  comprised  of 
four  scored  reading  and  reasoning  sections,  two  unscored  pretest  or  equating 
'sections  and  a'^nscored  writing  exercise  for  individual  Uw  school  evaluation, 
A  ten  to  fifty  score  scale  will  replace  the  current  200  to  800  scale  (See 
Appendix  A  for''  description  of  the  198:  LSAT  revision)  "  We  are  presently 
contracting  to  develop  an  adequ<ite  Inventory  of  this  edition  of  the  LSAT. 
Slaving  developed  such  a  supply,  we  plan  to  address  ourselves  to  emerging 
methods  and  technologies  in  evaluation  In  order  to  provide  to  Uw  school 
applicants  In  the  late  ^eighties  and  eariy  'nineties  the  best  academic  measure- 
ment that  can  be  provided  at  that  time. 

Test  disclosure  is  a  service  our  test-takers  desire,  and  for  which  they 
are  willing  to  pay.  Because  consumer  demand  for  disclosed  tests  had  become 
so  substantial  (about  sixty  percent  of  our  test-takers)  by  the  s^nd  year  of 
test  disclosure,  and  because  of  an  enhanced  interest  on  our  part  in  providing 
an  extra  increment  of  quality  assurance  for  our  test,  the  Law  School 
Admission  Coundl  Board  of  Trustees  eiecte^d  to  make  test  and  answer  record 
disclosure  an  automatic  part  of  the  reporting  procedures  for  test  Ukers, 
""beginning  with  the  1981-8^  test  year.  This  is  a  culmination  of  basic  commit- 
ments on  our  part.  We  are  rebuilding  our  services  to  accommodate  our  con- 
sumers' interest  In  o|)enness  In  testing. 

Two  years  ago  the  State  of  New  York  took  a  decisive  posiUon  on  test 
disclosure.    It  Insisted  on  Immediate  action  on  full  te«t  disciosur/i.    A  sensible 
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scheme  t^f  phase  J  appUcAbilitjr  Arouiti  hdve  been  more  fruitful.  By  giving  four 
or  five  rnonths  notice  for  radical  change  to  organizations  that  had  hitherto 
operated  on  nach  longer  test  Jeveloprnent  lead  times,  New  York  disrupted  the 
orderly  conduct  of  testing  programs  like  ours.  Its  actions  caused  increases 
\(\  applicant  fees  that  probably  would  not  have  been  undertaken  on  the  initia- 
tive of  tosilni;  or<?anizations  alone.  The  19  '  Mew  York  law  produced  substan- 
tial tec\nic,il  pcoblems  and  some  areas  of  unintended  encumbrance  and  intru- 
sion. 'Several  of  these  probiem  areas  were  modified  in  1980  in  a  cooperative 
♦•ffort  ia  ^hlch  our  organization  took  an  active  part.  Final  a,nalysis  of  the 
iTjpict  uf  iiisciosed  testing  on  test  results  must  await  research  that  can  be 
performed  onU  after  several  years  of  disclosed  testing. 

/ 

In  no  small  Tieasure  the  fJew  York  Act  has  worked  reasonably  because  of 
the  pr.ident  regulations  and  sensible  enforcement  procedures  of  the  J^ew  York 
=:diicnion  Commisslon*»r  and  his  staff.  Indeed,  as  the  various  teit  programs 
idjtist  to  disclosed  testing  there  Is  a  greater  risk  that  Ul-advised  regulations 
and  cnforce-Tient  procedures  will  emanate  from  ihq  state  educational  bureau- 
cracies than  there  is  a  probability  that  substantive  provisions  of  a  New  York- 
type  law   would,    (hemsclves,  prove  intolerable  if  enacted  in  another  state. 

There  Is  little  question  that  —  to  dat<3  t  New  York  has  effectively  pre- 
empted the  national  testing  issue.    It  has  acted,  in  effect,  to  set  a  national 
standard  for  many  test  programs.    As  Pennsylvania  has  done  in  the  area  of  . 
agricultural  product  standards  and  a»  Mew  York  Itself  has  done  in  the  in- 
surance law  field,  it  has  established  a  de  facto  national  standard.    New JYork 
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has  done  this  by  providing  a  powerfai  Impetus  to  increased  test  disclosure 
nationwide.  That  impetus  has  come  by  virtue  of  the  need  and  desire  of  test 
sponsors  to  maintain  testing  opportunities  for  New  Ydrk  students  and  schools 
—  as  well  as  from  the  motnentum  of  public  opinion  arising  as  test  disclosure 
In^Veased  scrutiny  of  the  un^vdying  soundness  of  admission  testing.  Testing 
organizations  like  ours  have  discovered  that,  on  balance,  test  disclosure 
promoted  public  confidence  in  the  integrity  of  the  test  Instrument  and  the 
testing  process.  It  became  symbolic  of  our  public  accountability.  Indeed, 
openness *haf  helped  in  our' quality  control  efforts. 
% 

As  other  states  have  considered  test  legislation  in  the  last  two  years, 
nearly  all  have  deferred  to  the  New  York  law  and  experience  as  reference 
points.  Most  have  concluded  that  the  considerable  progress  toward  national 
test  disclosure  made  by  programs  ^Ijke  ours  —  steadily  joined  by  a  growing 
list  of  major  test  sponsors  ~  had  obviated  the  need  for  state-by-state  regu- 
lation. In  many  Instances,  test  sponsors  have  accelerated  their  commitment  to 
openness  In  order  to  show  good  faith  and  thus  eliminate  a  need  for  potentially 
burdenfome  regulation.  During  this  past  year's  sessions  there  Was  support 
In  several  state  legislatures  for  lesser  Included  variants  of  the  New  York  law. 
One  such  blU  is  ftUl  under  active  review  In  California,  another  due  for  re- 
newed consideration  In  the  next  session  In  Minnesota.  Florida  considered 
such  a  law  In  this  year's  session.  In  each  of  these  cases,  more  than  trivia! 
support' for  legislation  (none  of  It  as  yet  enacted)  came  from  education  com- 
mittee members  and  member^  on  the  legislative  floor  only  after  acceptance  of 
provisions  significantly  less  harsh  than  New  York  law  or  H.R.  1662.  Legisla- 
tive study  of  varied  problems  of  developing  and  producing  tests  led  to  reduc- 
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lion  in  the  de  *d  that  every  test  form  immediaieiy  be  disclosed  —  so  long  as 
a  substantial  right  to  discloseii  testing  was  preserved  for  those  desiring  that 
service.  Careful  analysis  of  the  need  for  research  and  technical  information 
about  tests  led  legislators  to  modify,  eliminate  or  focus  the  "dragnet"  style 
research  fUinfi  requirefnents  of  the  rjew  York  law.  Oregon,  a  state  with  an 
etfective  cjui^umerist  base,  provided  strong  legislative  support  —  still  short 
of  ihdt  lecded  for  passage  —  for  the  1980  amended  New  York  law.  But, 
av>nc  7(  th.;  T)Any  states  evidencing  strong  interest  in  testing  law  has  ignored 
the  f*<o«f*nfnco  o(  the  past  two  years.  Vone  has  sought  to  limit  prematurely 
t^c  3«Mf  rcij'jiuin*;  effort  evident  in  most  parts  of  the  national  testing  comma- 
ntv.  '."hiie  ever/"  state  legislative  proposal  given  serious  consideration  in 
Sas  roCiectC'l  the  progress  that  has  been  made  in  the  last  year  or  two, 
'l.R.  1^63  has  re-nained  maton.illy  unchan^jod  fronri  its  H.R.  4949  progenitor, 
^rjfi**«t  in  l*^"?^  aCt*:*-  th'«»  '^ew  Vor'-^  law  -vas  eiiact'jt!  and  before  its  effect 
i^roJuco.i  ndic.i*  changes  in  the  Procedures  of  many  testing  programs.  State 
iei;isiat:)rs  Uav»?  liMrned  that  wh.it  may  be  possible,  indeed  useful.  In  testing 
for  a.liit:fStoa  to  one  career  or  profession  may  not  be  so  for  another.  They 
have  comre,  in  some  measure,  to  accept  the  differences  in  the  character  of 
tests  and  of  iheir  jse  m  admission  processes.  The  Congress  should  avail 
Itself  of  records f  memoranda  and  other  products  of  hundreds  of  hours  of 
state  hearings  ihat  have  taken  place  in  the  year  since  last  we  spoke  of  these 
matt^frs  in  this  hearing  room? 

I  respectfully  request  that  if  the  Congress  is  to  consider  a  national 
testing  law  that  It  not  disregard  th9  major  changes,  both  voluntary  and 
coerced,  that   ire  so  rapidly  taking  place  m  the  admissions  testing  environ- 
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ment.  As  long  as  no  fltate  adopts  a  conflicting  law,  rather  than  a  lesser 
Included  law,  New  Yorj^  wlU  provide  a  national  standard  admission  testing 
law.  Steadily,  many  testing  organizations  voluntarily  and  by  coercion  are 
adopting  national  test  >^lsclosure  policies.  The  forces  that  are  getting  the-n 
there  ahould  be  allowed  i  bit  more  time  to  take  effect. 

If,  In  a  year  or  two,  the  progress  hitherto  ma de^  toward,  voluntary  open- 
ness in  admission  testing  has  noi  been  maintained,  or  if  in  that  time  conflict- 
ing state  lajvs  and  regulations  ha/e  actually  been  enacted,  tHe  Congress  might 
.then  consider  a  preemptive  fe^deral  testing  act.  We  will  be  pleased,  at  that 
time, s to  assist  In  the  effort. 
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•When  tlew   York  Standardlzftd  Testing  Act  was  passed  in  1979,  the 

sponsors  intended  to  preserve  the  testing  organization's'  abilit/  to  n:iake  scores 
cornparable  from  test  lorm  to  test  form  and  from  test  administration  lo*  test 
ad-ninistration.  But  ^their  inqutr/  into  the  process  of  equating,  as  the  above 
described  process  i5  called,  was  limited  to  one  or  two  of  the  largest  volume  test 
programs.  In  eq\iat'{ng,  as  in  other  areas  of  substance,  admission  tests  are 
diverse  in  content,  structure  and  goal.  Test  proj^rams  in  law,  graduate  school, 
and  business  admissions  were  overlooked  by  the  test  sponsors*  broad  legislative 
brush  strokes.  Thu5,  the  New^York  test  statute,  by  virtue  of  Its  requirement 
that  each  test  form  used  be  published,  required  us  ^o  abandon  a  method  of  test 
production  that  had  been  effective  for  our  test  and  to  commence  a  crash  re- 
search program  to  find  another  equating  method.  Until  January  I,  1980,  new 
editions  of  the  LSAT  were  placed  ^on  the  score  scale  by  administering  to  com- 
parable populations  the  new  edition  and,  at  the  same  time,  editions  already  on 
the  scale.  In  otlier  words,  whole  editions  of  the  LSAT  were  "splraled"  with 
other  editions  of  the  lost  at  the  same  administration,  ^^ditions  of  the  test  were 
typically  used  at  two  or  three  different  administrations.  As  a  practical  flatter 
this  production  method  was  precluded  by  the  statutory  requirement  tK^t  each 
test  form  used  be  published  after  every  administration.  The  Law  School 
A-dtnisslon- Council' had  at  its  disposal  a  very  limited  number  of  usable  test  forms 
which  were  placed  on  scale  before  The  Mew  York  Test  Law  was  enacted.  These 
tests  have  been  used  to  bridge  the  tlnne  gap  until  a  new  equating  method  can 
be  developed  and  ioiplemented.  The  introciuctlon  of  a  new  method  of  equatit^g 
required  chang^es  In  the  LSAT  Itself,  as  well  as  In  the  statistical  procedures 
used  to  assure  that  scares  achles^ed^on  one  edition  of  the  LSAT  mean  essentially 
the  same  thing  as  those  achieved  on  another.  Development  of  a  revised  Law 
School  Admission  Test,  adapted  to  a  test  disclosure  environment  and  encompass- 
ing other  desired  improvements  l^  under  way.  The  revised  test,  to  be  intro- 
duced in  JuneVl982  is  ^scribed  In  preliminary  fashion  in  the  materials  that 
follow  as  part  of  this  appendix.  Please  note  that  the  July  1981  Law  School 
Admission  Rulletin  will  soon  be  supplanted  by  a  more  current  re.vision.  The 
material  concerning  Question  Type  III,  In  particular,  will  be  subject  to  revision 
as  the  refinennent  of  the  test  continues  through  Its  final  developmental  stages. 
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November  1980  , 


Dt\r«lopiiUftt  of  Ntw  LSAT 
Proc»#dg\  


Development  work  U  under  way  on  Xht 
most  significantly  different  Law  School 
Admission  Test  In  the  thirty-two  year 
history  of  that  test.  The^  ^*aw— SchCoT 
Admission  CpOncir^HMrd  ofVTrustees. 
approved  this  ciaJor«*  effort  at  > 
Spring  1980  meeting.  Approval  followed 
a  series  of  Vecommendatlons  made  by 
the  CouncIl'sV  Test  Development  and 
Research  Cofttmlttee  after  thorough 
study.  As  much  as  two  million  dollars 
Is  to  b*s  expenucd  on  the  development 
and  Introducttorf  of  fifteen  new  forms  of 

~nfe  LSAT.  ThA  LSAC  Board  reported 
on  the  decisloi^  \and  Its  Implementation 
during  the  educational  component  *of  the 

\  LSAC  Ann»j»l  Mceling  In  late*'May.  1980, 
The  rtew  test  Is  Expected  to  be  given 
for  the  first  tlmi  In  the  ^  summer  of 
1982.    That  test  isWxpected  tot 

IConslst  of  sljt  thlrty-flve  minute 
V  sections,    two  \of    which    will  be 

equating  or  pretext  sections  that 
T  will  not  contriDUte  to  candidate 
*    scores.    The  four  scored  sections 

will  Include  four\dIfferent  types  of 

questions*    only  one   of  which  Is 

currently  used.  \ 

5Measure  abilities  ar«i  skills  related 
to-pr.  blem  Identlflcitlon.  analysis, 
logic »     reasoning     and  reading. 

5Also  contain*  subject  ^o  modlfica* 
tlon  based  on  futur,e  research*  an 
unscored  writing  simple  or  exer- 
cise. A  cdpy  of  It  he  completed 
exercise  would  be  transmitted  to 
each  law  school  to  which  a  candi- 
date directed  an  iLSD^S/LSAT 
report.  \ 

5Be   equated*    that   Is  ^havo  scores 


statistically    made    to  'mean  the 

same    thing**'  only   to  other  new 

forms  of  theXtest  and  not  to  the 
present  LSAT. 

5Be  placed  on  a  score  scale 
different  from  the  200-80^  scale 
currently  employed.  5 

Even  though  scores  on  the^new  LSAT 
will  not  be  directly  comparable  to  scores 
on  the  present  test,  the  design  specifi- 
cations have  been  set  to  cause  the  test 
to  have  psychometric,  qualities  which 
will  achieve  at  least  the  levels  of  per- 
formance of  the  present  test.  This 
means  that  the  new  LSAT  will  b«  de- 
signed to  distinguish  >mong  law  school 
applicant?  at  various  ability  and  talent 
levels  as  well  as  the  present  test  does. 

Questions  for  Inclusion  on  the  new  test 
are  now  being  developed  at  Educational 
Testing  Service  under  contract  with 
Law  School  Adrtdsslon  Services. 
General  direction  and  policy  decisions 
related  to  the  project  are  vested  In  the 
LSAC  Test  Development  and  Research 
Committee.  Day-to-day  management  of 
specific  components  of  the  work  Is  j 
being  carried  out  by  relevant 
LSAC/LSAS  professional  staff. 
Questions  for  the  new|jt\»«t  are  being 
pretested  In  current  aomlnlstratlons  of 
the  LSAT.  The  liiltlal  phases  of  the 
project  are  proceeding-  according  to 
schedule. 

Many  of  the  contemplated  changes  have 
been  under  conslderatlot>  by  the  Test 
DeveIop;itent  and  Research  Committee  for 
ths  past  few  years.  These  changes  are 
of  *  kind  that  will  permit  the  retention 
of  the  principal  design  considerations  ^f 
the  past  —  strong  validity*  high  rella- 
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blUty  ind  difflculty,  and  good  dlfferen- 
tUtlon  among  persons  of  high  tevels  of 
ability 'and  training. 

Writing  Ability  Score  Eliminated 

The  current  Writing  Ability  score  wrlH 
b«  eliminated  when  the  new  version  of 
the  LSAT  becomes  operational^  There 
are  a  number  of  reasons  for  Jhls 
ehanf'e.  Plrst,  the  WA  wore  adds  Jlttle 
or  nothing  to  prediction  of  academic 
performance  for  the  great  majority  of 
law  schools.  Second,  'Writing  Ability' 
Is  a  misleading  title,  given  the  type  of 
question  on  which  the  score  Is  based. 
Finally,  no  .type  of  question  testing 
writing  skills  In  a  multiple-choice  format 
has  been  judged  particularly  desirable 
for  Inclusion  In  the  new  version  of  the 
LSAT. 

LSAC  has  approved,  subject  to  future 
research  considerations,  an  unscored 
writing  sample  or  exercise  for  the  new 
version  '  of  the  LSAT.  Copies  of  a 
candidate's  written  work  on  this 
exercise  would  be  forwarded  to  law 
scnouis  that  receive  his  or  her  LSAT 
icorot  Such  an  exercise  would  be 
Intended  to  strjcss  to  candidates  the 
importance  of  writing  In  legal  education. 
It  should  enable  a  law  school  to  make 
an  Informed  judgment  concerning  the 
basic  writing  skills  of  a  particular 
applicant. 

Increased  Law  Faculty  Participation 

In  order  to  provide  a  substantial  oppor- 
tunity for  law  faculty  reaction  to  specl- 
flc  questions  proposed  for  the  new  test, 
LSAC  President  Walter  B,  Rausbenbush 
Is  appointing  a  Test  Question  Review 
Committee,  That  Committee,  a  diverse 
group  of  law  professors.  Is  to  begin  its 
work  In  January,  1911,  It  will  review, 
analyze  and  critique  prospective  LSAT 
questions.  The  goal  of  the  review  pro- 
ject U  to  assure  that  every  question  on 
the  new  LSAT  has  been  screened  by 
experienced  '  law  professors.  The 
committee  will  review  questions  for 
clarity,  fairness  and  other  relevent 
tests  of  approprlatenem. 


Background  for  Changes;    New  York 
Law 

In  *  1980,  legislation  regulating  post- 
secondary  admission  testing  programs 
became  effective  in  New  Yck.  Similar 
legislation  Is  being  considered  in  twenty 
states  and  in  Congress.  One  result  of 
the  legislation  Is  to  require  LSAC/LSAS 
to  make  changes  in  the  way  In  \rhlch  , 
the  LSAT  Is  constructed  and  admini- 
stered. Th*  New  York  .Testing  Act 
affects  many  aspects  of  the  LSAT  that 
h^ve  been  under  discussion  since  1977 
by  the  Test  Development  and  Research 
Committee  of  LSAC  as  well  as  staff  and 
consulting  professional  advisers. 

Equating,  Test  Production  and 
Statutory  <Jomp»anc7 

Because  It  requires  the  disclosure  of 
each  form  of  the  LSAT  (other  than 
those  used  a'  limited  administrations) 
the  New  Yo  K  Testing  Act  makes  it 
necessary  to  develop  a  new  method  of 
equating  the  test.  Equating  la  the 
^taUitlcal  process  by  which  scores 
attained  on  different  forms  of  a  given 
test  ju-e  adjusted  to  take  into  account 
slight  differences  in  difficulty.  By 
equating,  differences  in  scores  which 
might  result  from,  a  person  having  taken 
one  form  of  the  LSAT  rather  than 
another  ore  minimized.  In  the  past,  a 
new  form  of  the  LSAT  was  equated  by 
administering  the  new  form  along  with 
two  previously  equated  forms  of  the 
test.  Approximately  one  third  of  the 
group  taking  the  test  used  the  new 
form  and  one  third  each  of  the 
previously  equated  forms.  Difficulty 
levels  and  scaled  scores  for*i{Jie  new  , 
test  could  then  be  determined  by  com- 
paring the  performances  of  the  three 
randomly  selected  groups  of  test 
takers.  Thli^thod  of  equating  a  new 
form  of  the  LSAT  Is  generally  known  as 
spiral  Ingi 

As  you  can  see,  the  New  York  Law 
precludes  the  use  of  the  splrallngt 
equating  method.  Because  the  law 
require^  the  disclosure  of  every  test 
form  Irortedlately  following  the  use  of 
that  form,  there  can  be  no  previously 
equated  and  undisclosed  forms  to  s$nral 
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with  new  forms  of  the  LSAT,  once  the 
J  present  supply  Is  exhausted.  A  new 
method  of  equating  needs  to  be  found  If 
the  LSAT  program  Is  to  continue  In  the 
same  manned  as  In  the  past.  Of  equal 
concern  Is  the  need  to  produce  many 
mor?  new  forms  of  the  LSAT  than  In 
the  past.  Until  disclosure  of  each  form 
df  the  test  used*  was  required/  a  torm 
of  the  test  was  usuilly  administered 
three  or  four  tlmei  before  being 
retired*  With  disclosure  of  every  form 
of  the  <est  administered  no  form  could 
be  reused  without  risking  compromise  of 
the  accuracy  and  fairness  of  the  testing 
process.  Production  of  the  new  LSAT 
forms  will  have  to  exceed  by  a 
considerable  amount  the  number  of 
'forms  required  In  the  past.  In  turn, 
this  leads  to  concern  for  the  quality 
and  quantity  of  questions. 

The  needs  to  -find  a  new  equaUng  . 
metho<l,  'to  maintain  the  quality  le>?el  of 

^  the  LSAT  and  to  produce  more  editions 
of  the  LSXJ  every  year  dictate  changes 
.In   both   the  types  of  questions  being 

.  used  on  the  LSAT  and  In  their 
presentation.  These  same  changes  will 
also  result  In  Increase  1^  flexlblMty 
In  the  way  the  LSAT  Is  "  administered 
and  provide  an  additional  method  to 
deal  with  the  concern  for  the  test  taker 
whrf  may  be  tempted  to  copy  from 
another.  Applicants  sitting  next  to 
each  other  during  a  test  administration 
will  be  leis  likely  to  be  tempted  to  copy 
from  those  seated  beside  them  If  they 
know  that  they  ax:e  working  on  different 
sections  of  the  test  at  the  same  time,  as 
they 'may  well  be. 

Pretesting  Methods 

As  just  noted,  sections  of  equal  length 
will  make  possible  "scrambling,"  or  re- 
drdsrlng,  of  test  sections,  on  ths  same 
form  and  among  various  forms  of  the 
test.  This  process  will  permit  pretest- 
ing of  different  sections  of  the  test  at 
different  places  In  the  test. 

All  LSAT  questions  »re  pretested  before 
^  being   used  operationally  on  a  form  of 


the  test.  Among  other  reasons, 
questions  are  pretested  to  establish 
their  level  of  xllfficulty  and  to  Identify 
any  that  appear  to  operate  poorly  or 
differently  than  anticipated.  Answers  to 
questions  being  pretested  dr  not 
contribute  to  candidates'  LSAT  »cores 
and,  consequently,  the  New  York 
Testing  Act  does  not  require  that  these 
questions  be  disclosed.  Reviews'  of 
recent  forms  of  the  LSAT  produced 
Information  that  pretest  statistics  for 
some  questions  differed  from  the 
statistics  demonstrated  when'  the  sam« 
questions  were  Included  as  operational 
items  on  the  test.  Some  explanations  of 
this  phenomenon  are  plausible.  Until 
this  year,  pretest  sections  appeared  In 
the  same  place  on  all  forms  of  the 
LSAT.  This  fact  was  known  by  many 
candidates.  Candidates  may  have  been 
tempted  to  "loaf"  or  "let  up"  on  pretest 
sectloixs.        If  did,  their 

performance  on  pretest  questions  dld^ 
not  accurately  reflect  the  way  In  which " 
they  would  approach  operational 
questions.  Sines  the  objective  of  the 
pretesting  process  Is  to  gather  accurate 
Information  about  the  performance  of 
questions  being  considered  for  use  In 
'  the  LSAT,  the  practice  of  consistently 
placing  pretest  questions  In  the  fame 
positions  on  each  test  might  have 
detracted  from  the  reliability  of  the 
Information  produced.       ^  -r^^ 

Reducing  ^Potential  for  CoachabtHty^ 

The  effects  of  coaching  —  the  use  of 
artificial  or  short-term  learning  to 
Improve  tait  performance  —  have  also 
been  considered  la  the  design  of  the 
new  L.SAT.  Coaching  success  may  be 
related  to.  question  or  Item  type  format, 
particularly  to  the  "fixed  format*  nature 
of  the  question  Involved.  Questions 
being  considered  for  the  new  version  of 
the  LSAT  have  been  examined  for 
potential  coachabllity .  Only  fhose  types 
of  questl'^ns  for  which  success  In 
coaching  nas  been  judged  to  be  low  will 
be  selected. 
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The  Score  Scale 

The  200-100  score  scale  of  the  LSAT 
.  was  established  In  194S.  It  was  based 
oh  the  performance  of  candidates  who 
took  a  te»t  far  different  from  the  one 
now  being  administered.  Over  time,  new 
version*  of  the  LSAT,'  containing  dlfr 
ferent  types  of  questions;  have  been 
Introduced  gradually  and  equated  to 
previous  versions.  Despite  these 
changes,  the  200-800  score  scale  was 
preserved . 

Because  of  the  major  change  in 
questions  employed  on  the  nrw  LSAT, 
that  version  will  not  test  the  same 
qualities  that  w-re  tested  by  older 
versions  In  exactly  the  same  ways. 
Consequently,  even  if  the  200-800  seal* 
were  to  be  retained,  scores  on  the  old 
and  new  versions  would  not  likely  mean 
the  same  thing.  ^  While  there  is  no 
change  In  the  criterion  for  the  test 
or  tht  <nt«>nded  use  of  the  test,  groups 
of  applicants  might  be  ordered  slightly 
differently  by  the  nc:w..l;iC5jLJhan  they 
•*ould  have  been  on  the  current  CSAT. 
In  addition,  the  particular  200-tOO  score 
scale  employed  in  the  LSAT  program 
h\s  been  a  subject  of  concern  to  LSAC 
for  !»ome'Ume.  This  tjjiree-digtt  score 
scale  can  create  an  Impression  of 
precision  that  Is  not  warranted. 

The  problems  described  above— masking 
the  non-comparability  of  old  and  new 
versions  of  the  LSAT  by  using  the  same 
score  scale,  and  creatit>g  a  misleading 
appearance  ''of  precision  with  the 
current  200-500  score  scale — can  most 
effectively  be  resolved  by  establishing 
an  entirely  different  score  scale  for  the 
/lew  version  of  the  LSAT  being  devel- 
oped. The  LSAC  is  actively  discussing 
alternative  score  scales.  No  final 
decisions  havs  yet  been  madt 
concerning  the  score  scale  that  will  be 
adopted  for  the  neviT  Version  of  the 
test.  It  Is  very  likely  that  scores 
earned  by  candidates  taking  the  new 
version  of  the  test  will  fcok  quite 
different  from  scorea  that  have  been 
reported  on   the  200-100  scale  In  the 


past.  Scores  will  probably  be  reported 
by  use  of  fewer  digits,  fewer  score 
Intervals,  and  a  slightjy  smaller  range 
than  is  the  case  with  the  current 
LSAT.  f 

Further  Reports 

As  work  on  a  new  LSAT  progresses, 
periodic   reports   will   jbe  made  in  this 
publication,     as    well  j  as    at  various 
meetings  and  prograrasiof  LSAC. 
GLD/WBR  , 
TOW/BIZ  j 
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Board  D«ciiioDi  Advance 

Promm  For  N»w  LSAT  < 

Ih  the  Movemb'er  issue  of  this  pubUca- 
tlon  a  comprehensive  report  on  the 
development  qf  a  new  LSAT  was 
offered.  At  if  December  meetingr  the 
t^SAC  Board  decided  significant  Issues 
related  to  theJ,  Implementation  tof  that 
project.  1 

A  new  score  scaie  has  been  selt;cted  for 
the  test  currently  being  developed. 
The  new  LSAT  will  be  scored  oh  a  l£  to 
^scaTe.  The  Tiean  score  wTIT  be  3(>7 
tKe "standard  deviation  vvlH  be  8.  Thus 
abogt  two- thirds;  of  scores  will  occur  In 
the  22  to  )d  ranfec.  In  contrast  to  about 
;he  450-650  r*n«e  9n  thr  present  test. 
The  scale  will  utllUc  2  1/2  standard 
deviations  fro-i  the  mean,  rather  than  3 
as  on  the  present  test.  This  means 
that  about  one  jpercent  of  the  top  and 
bottom  performances  will  be  compressed 
downward     or     upward  respectively. 

c 

Readers  of  the  Bu  lie  tin  will  recall  that  a 
scale  other  than  200-800^  was  selected 
for  the  new  LSAT  because  that  Instru- 
ment will  not  ^est  the  same  .qualities 
that  were  tested  by  older  versions  of 
the  LSAT  In"  exactly  the  same  ways. 
Consequently,  even  If  the  200-800  icale 
had  been  retained  r  scofes  on  the  old 
and  'ntw  versions  would  not  likely  mean 
th«  same  thing.  While  there  Is  no 
change  In  the  cJfUerlon  for  the  test  — 
or  the  Intended  use  of  thr  test,  groups 
of  applicants  might  be  ordered  slightly 
differently  by  the  new  test  thtn  they 
^ould  haye  bee^  on  the  current  LSAT. 
In  addition,  thi  three  digit  score  scale 
employed  In  the!  LSAT  program  has  been 
a  subject  of  cdncern  to  LSAC  for  «ome 
tlm«  because  the  three  digits, can  create 
an  Impression  of  precision  that  Is  not 
warranted.  ' 
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In  order  toipreserve  current  expecta- 
tions of  applicants  and  law  schools, 
both  old  and  new  LSAT  scores  will  be 
reyorltS'  IST  r"7lve-year  ficriodafter 
the  Introduction  of  the  new  LSAf.  Anrt 
finally,  the  Board  ratified  the  use  of 
six  35  minute  sections,  two  of  which 
"^e  variabfe  content  pretest  or 
equating  sections.  A  writing  sample 
section  Is  to  be  Included,  however  Its 
length   has   not   yet   been  determined. 

The  calculation  of  an  LSAT  College 
Mean  <LCH)  his  for  some  time  been 
controversial  — i  both  ^as  to  reliability 
and  utility.  The  Board  has  tentatively^ 
decided  to  abandon  LCM  calculation  with 
the  Introduction  jof  a  new  test.  A 
fuller  discussion  of  the  LCM  issue  will 
take  place  at  the  1981  Annual  Meeting. 
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(APPENDIX  B) 


LAW  SCHOOL  ADMISSION  COUNCIL  ,  ^ 

The  Law  School  Admission  Council  (LSAO  is  a  non-profit  educational 
association  of  the  171  ABA-approved  law  schools  organized  to  faciUtate  the 
admissions  process.    According  to  its  charter  of  incorporation,  the  Council's 
purposes   are  "to'  construct,  administer,  and  report  scores   for  tests  for 
adraassion  to  law  school;   to  conduct  educational  research;  and  to  provide 
services  to  law  schools  and  the  educational  community."  As  the  number  of 
applicants  has  Increased,  the  law  school  admission  process  has  become  more 
competitive  and  complex.    The  range  of  Council  services  and  activities  has 
e|<panded  to  serve  and  inform  those  involved  In  that  process— law  schools, 
applicants  and  undergraduate  institutions.    Services,  programs  and  publications 
are  provided  by  the  Council  to  assist  each  of  these  groups. 

History.     In  1947,    representatives  of  a  group  of  law  schools  met  with 
College  Entrance  Examination  Board  staff  to  discuss  the  possibihty  of  developing 
a  common  test  for  use  in  admitting  students  to  law  school.     There  was 
considerable  interest  in  proceeding  with  the  project,  and  efforts  to  develop 
such  a  test  were  undertaken  by  the  Educational  Testing  Service.    The  first  Law 
School  Admission  Test  (LSAT)  was  administered  in  February.  1948.  Nineteen 
law  schools  used  the  test  that  ye*r-    Those  schools  becarrse  associated  as  the 
Law  School  Admission  Test  Council.   Mth  a  Policy  Committee  to  set  operational 
guidelines  for  the  new  testing  program.     In  later  years,  additional  committees 
were  estabhshed  to  oversee  aspects  of  the  program.    The  Policy  Committee 
evolved  into  the  Executive  Committee  and  then  the  Roard  of  Trustees.    In  1968 
the  Law  School  Admission  Test  Council  was  incorporated  and  in  1973  the 
corporate  name  u/as  changed  Xo  ™Law  School  Admission  t:ouncil''  to  reflect  t  . 
broader  activities  of  the  organization.    In  1978  the  Council  opened  a  national 
office  in  Washington.  D.C.  to  conduct  public  affairs  and  government  relations 
work  and  to  provide  support  for  numerous  Council  activities.    In  1979,  the 
Council  incorporated  a  wholly-owned  not-for-profit  subsidiary  called  Law  School 
Admission  Services  (LSAS).   governed  by  a  nine  person  Board  of  Directors 
appointed  by  the  LSAC  Board,     LSAS.  operating  as  of  July  1980  m  Newtown. 
Pennsylvania,  hai  full  responsibility  for  operation  of  the  Law  School  Data  ' 
Assembly  Service,  and  all  other  Council  services  other  than  the  development 
and  administration  of  the  Law  School  Admission  Test.    £TS  remains,  at  present, 
contractor  for  these  aspects  of  the  LSAT. 

Governance.  The  Council  conducts  fbrmal  business  at  an  annual  meeting, 
held  in  recent  years  in  late  May.  Member  schools  have  one  vote  apiece,  cast 
by  a  Council  representative  selected  by  the  dean  or  faculty. 

The  ongoing  governance  of  the  affairs  of  the  Council  is  conducted  by  its 
Board  of  Trustees.    The  Board  normally  meets  three  times  a  year  (m  early 
December.  In  late  April  or  early  May,  and  at  the  Annual  Meeting)  and  has 
fifteen   members:     the  President;    the  Immediate  Past  President  or  the 
President-Elect  in   alternate  years;   the  chairpersons  of  the  five  standing 
comrnittees:  six  members  elected  by  the  Council  (three  each  year)  for  two 
years.    The  term  of  the  President  Is  two  years;  the  President-Elect  becomes  the 
Pretident  on  completion  of  one's  service  as  Presi<ftnt-EIect.    The  Secretary  is 
elected  for  a  one- year  term  by  the  Board  of  Trustees  at  its  meeting  immediately 
following  the  Annual  Meeting.  ' 
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Staff      The  Executive  Director  of  the  Council  operates  an  oface  In 
Washington,  D.C.  which  provides  support  for  a  variety  of  Council  activities.  A 
substantial  staff  Is  maintained  In  Newtown,  Pennsylvania.    It  operates 

under  the  direction  oC  the  President  of  that  organisation. 

Finances:  Virtually  all  of  the  Council's  income  Is  derived  P*^^. 
by  those  who  register  for  the  basic  admission  services  (LSAT  and  L5DAS)  and 
those  who  purchase  the  Prelaw  Handbook.  The  Council's  operating  budget  for 
1980-81  U  about  six  and  one  half  million  dollars. 

Committees.     The  Council  has   Ave  standing  committees  (Finance;  I'«gal 
Affairs;  Frogramy.  Education,  and  Prelaw;  Services;  an^TesJ  Development  and 
Research^     The  chairpersons~and  members  of  these  committees  are  appointed  by 
the    President   and  are   responsible   to  the   Board  of  Trustees.  Policy 
recommendations  and  appropriation   requests  from  committer*  are  generally- 
referred  to  the  Board  for  final  action,  although  matters  requiring  an  immediate 
decision  can  be  handled  in  consultation  with  the^President .    Standing  committees 
meet  at  least  twice  a  year  on  a  regular  basis. 

Organizational  Affiliations.    The  Council  Is  a  founding  and  continuing 
sponsor  of  the  Council  on  Legal  EducAtion  Opportunity  and  has  working 
relationships  with  many  organizations  active  in  legal  education. 

Annual  Meeting.     The  Annual  Meeting,   which  has  been  held  in  recent 
years  during  the  last  week  of  May,  includes  workshops,  seminars,  and  a 
busin^'ss  meeting.    Workshops  and  seminars  covtr  topics  of  current  conce.  n  to 
thos?  responsive  for  admissions-e.g,,  affirmative  action,  statistical  concepts, 
legal  and  legisLitive  developments  and  use  of  non-quantifiable  factors.    At  the 
business  session,  reports  are  considered  and  officers  and  new  trustees  elected. 

Other  Meetings  and  V/orkshops.    The  Council  sponsors  several  educational 
programs  during  the  year,  including: 

Regional  Workshops  are  one  day  programs  designed  for  law  school  faculty 
members  who  Serve  on  admissions  committees  and  administrators.    The  regional 
workshops  are  scheduled  during  the,  fall  and    re  desig-.ed  to  explore  major 
issues  in  depth. 

1  The  Summer  Workshop  is  a  1*  day  program  in  late  June  or  early  July, 
designed   for   faculty   members  and   senior   law  scSiool  administrators  'Jjith 
responsibility  for  admissions.    Significant  subjects  are  considered  in  large 
general  sessions  and  small  discussion  groups.  ^ 

Prflav    adviser   workshops    ire  one   day   programs    for    those  in 
undergraduate  Institutions  who  advise  students  contemplating  admission  to  law 
school.    The  workshops  are  designed  to  acquaint  advisers  with  Council  services 
and  with  various*  aspects  of  the  admissions  process. 

Services.    The  LSAT  is  a  half-day  multiple  choice  test  designed  to  measure 
abUities  Important  m  the  study  of  law.    It  provides  two  scores:    an  LSAT  score 
and  a  writing  abihty  (WA)  score.    The  LSAT  portion  measures  the  ability  to  , 
understand  and  reason  with  a  variety  of  verbal  and  quantitative  materials.  The 
♦writing  abihty  portion  measures  the  use  of  standard  Enghsh.    The  test  is 
intended  to  supplement  the  undergraduate  record  and  other  Information  about 
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"       •     r        «f,"^^ent  of  potentiaJ  for  law  school  work.    It  covers  a 
of  f^.     ^^^l^'^^'^^P""^*'  "^"*l»y  acquired  over  a  long  period 

01  tune,  and  gives  no  advantage  to  students  with  particular  specializations: 

,„rl  1*1?         f""^"^^  Assembly  Service  (LSDAS)  centralizes  the  collection 

and  comb^ine'/a  transcripts .  required  for  law  school  admission  decisions 

?„L  f      surnmary  of  these  transcripts  with  hSAT  scores  and  background 

Information  (e.g.,  address  and^datc  of  birth)  to  produce  an  LSDAS  Report  for 

-ra^^r"'"^^*'"^/^''^^  *  ^"--^y  of  all  the  data  ^ollecVed 

(with  grades  and  measures  of  credit  reported  in  a  standard  form  of  notation). 
IS  attached  to  copies  of  the  candidate's  transcript(^) ,  and  Is  forwarded  to  law 
schools  designated  by  the  candidate. 

aooro'^ved  b7  rh'/'^'RA^^f'^*'^^'*  (LSCRS)  provides  law  schools 

fd^^HMfv  r.nHM^  ^  0PP<;»-'""i'y  to  have  the  LSDA^  61e  searched  to 

identify  candidates  who  have  given  their  permission  to  be  in  LSCRS  and  who 
have  characteristics  specified  by  the  schools  participating  In  the  service.  It 
Irhnla^lMn        'Vif.m''        °PP°^'""»'y  to  be  made  aware  of  educational  and 
scholarship   posslbiUtles   that   they   might  not  otherwise  have  considered. 

'  o 

The  ^Council  also  sponsors  service*  for  internal  use  bv  law  -rhnnU  in 
manag  ng  their  ad.isslon^s  operation-e.g. .  Extended  SerWce^  Sorts^l  series 
?„H  fh  Vni  .    c  ^'l"*  produced  periodically  from  the  LSDAS  system) 

e?fec  ivenci,  o7  r^^AT^  (which  provides  for  continuing  evalultion^f  the 

effectiveness  of  LSAT  scores  and  undergraduate  grade  point  averages  in 
predicting  academic  performance  in  law  .school). 

Publications.  Several"  Counci]  publications— e.g.,  the  Guide  to  * 
th".  /^H-  ^^!J*'*^  statistical  data  and  information  about 

a    1,^  ?  u"^u^^  °^  undcratraduate  institutions),  the  Operations  Reference 

Book   (which   contains  operational  information  abo  t  Coundl  services),  the 

wi/                                      ^^^^"^                ^«P°^'3  of  an  indlvi<Jual  law 
schjxsl  5  validity  studies  and  general  background  material),  the  Directory  of 
Prelaw  Advisors   (which   lists   the   names  and  addresses  of  advisers  at 
rl*7ol'^n"*'*'^^"fl^'"j'°"^''          *  ^»d«*y  distributed  new5letter  published  by 
bo  h  LSAC  and  LSAS.   Law  School  Admission  Bulletin.    Other  publications, 
listed  below,  are  more  general  in  nature.  *   

•K^  tC"'**LiP'i*^"''^'*°"  °f  registration  materials  is  intended  for  canclldates 

who  take  the  LSAT  and  use  the  LSDAS.    It  explains  thes«  and  other  Coundl 
services,  provides  complete  registration  Information  and  forms,  and  discusses 
the  meaning  of  scores  and  contains  iw>me  sample  test  questions.     Copies  are 
available  without  charge.    In  recent  years,  the  materials  have  been  expanded  to 
include  an  actua   LSAT  form  with  an  answer  key.  Information  on  preparing  for 
the  test,  general  test-taking  strategies,  and  materials  on  how  to  answer  LSAT 
questions.    It  also  includes  a  discussion  of  the  different  types  of  test  questions 
and   an    analysis   of    the    correct   answers   for  some  sample  questions. 

Reports  of  LSAC  Sponsored        earch  is  a  three  volume  set  of  research 
e'ntiuld  TsAC  P  l^'^'         addition,  a  green  looseleaf  binder 

entitled     LSAC  Research'  contains  a  ^bn^f  overview  of  all  Coundl  sponsored 
.1     X  *  summary  of  each  completed  project.    As  new  projects  are 

completed,  a  summary  and  full  report  will  be  Issued  to  update  the  binders. 

STe  law  Hb°rirv  .„T  ^^^r^  ^  school-for 

me  law  library  and  one  for  the  admissions  office. 
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The  Legal  A f fairs  Manual,  published  iolntly  by  the  Council  and  the 
Assodatipn  of  American  Lasv  Schools  (AALS),  contains  a  checklist  of  federal 
stat-tes  and  regulations  which  affect  the  operations^  of  law  schools,  memoranda 
analyzing  the  Impact  of  particular  statutes  and  regulations  on  law  schools  and 
suggesting  ways  in  which  schools  might  respond,  the  pertinent  federal  statutes 
and  regulations,  and  a  litigation  bulletin  sumcrtirixlng  state  and  federal  cases  of 
particular  interest  to  legal  education.    The  Manual  and  its  supplements  are 
distributed  without  cost  to  all  Council  member  schools;  the  subscription  rate  for 
others  is  $50  for  the  original  binder  and  an  annual  125  fee  for  the  up-date 
service* 

The  Annual  Council  Report  contains  financial  reports  and  a  variety  of 
other  materials  reflecting  Council  activities  for  the  year.    It  Is  distributed  to  all 
member  law  schools. 

The  Prelaw  Handbook  Is  a  publication  of  the  Council  and  the  AALS.  It 
contains  general  information  on  the  legal  profession  and  law  schools  for  those 
interested  in  the  study  of  law,  a  description  of  the  program  of  each  American 
Bar  Association  approved  law  school,  and  the  admissions  profile  for  the  most 
recently  admitted  dass  for  the  great  majority  of  these  schools.  *It  may  be 
purchased  at  most  college  bookstores  or  by  mail  from  Law  bchool  Admission 
Services , 

Law  as  a  Career/ Prelaw  Advice  fo^  Minority  Students.  The  first  of  these 
paopKTeTsTs  "written  for  high  school  seniors  and  college  uaderclassmen,  while 
the  second  is  directed  .to  minority  students.  Both  are  available  from  LSAS  in 
quantities  of  100  for  $6,00. 

The  "Prelaw  Adviser  Issue'  of  the  Law  School  Admission  Bulletin  is 
pub^shed  quarterly  to  provide  prelaw  advisers  with  inforrnation  about  Coundl 
services  and  general  admission  matters.  • 

The  Prelaw  Advisor  Kit  is  a  portfolio  for  advisers,  containing  ^Tiaterlals 
explaining  in  detail  CounclTser  vices  and  polldes.    Afso  Included  are  copies  of 
several  Council  publications.    A  Kit  is  sent  annually  without  charge  to  each 
prelaw  adviser;   additional  copies  are  available  for  $5.00  each  from  LSAS. 
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In  General 


LAW  SCHOOL  ADMISSION  TEST 
Prelimmary  Descriptive  Material  For 
Question  Type«  For  1982  Revision 


The  LSAT  U  designed  to  measure  certain 
mental  abilities  important  in  the  study  of 
law  and,  thu^,  to  aid  law  schools  in 
assessing  the  academic  promise  of  their 
applicants.  The  test  covers  a  broad 
range  <^  academic  disciplines  and  is 
intended  to  give  no  advantage  to  candi- 
dates from  a  partlcfrfar  academic  back- 
ground. The  qiicstlonn  yielding  the 
LSAT  score  are  designed  to  measure  the 
ahiJity  to  read»  understand ,  and  reason  • 

In  the  Spring  of  l^fif>,  final  approval  was 
given  by  the  fJoard  of  Trustees  to  the 
Law  Srhool  Admission  Council  for  the 
intro<iuction  of  a  revised  version  of  the 
La*  ^choot  Admission  Test.  Thin  *new" 
versiu..  of  the  LSAT  is  scheduled  to  bo 
admini  t<»red  for  the  first  time  In  June» 

i^ven  though  scores  on  the  new  US  AT 
will  not  be  directly  comparable  to  scores 
on  the  present  test,  the  design  speciffca- 
tionts  have  been  ^et  to  cause  the  test  to 
havo  psychometric  qtjalitles  which  will 
achieve  at  lea^t  the  levels  of  performance 
of  the  pre<«ent  test.  This  means  th^t 
the  new  LSAT  he  designed  to  distin- 
guish amonm  Uw  school  applicants  At 
various  ability  an*I  talent  leveis  as  well 
the  pr*»sent  t«^t  'Iocs. 


The  CX»estion$ 


The  -new*  LS\T  wiH  cof»si5t  of  six 
thirtvflvp  "^in  itf  ?Iea»oa^.  twr*  of  *hlch 


will  be  equating  or  pretest  sections  that 
will  not  contribute  to  an  examinee's  a 
score .  The  four  scored  sections  will 
include  four  different  types  of  qucstior]^. 
It  is  Jintlclpated  that  these  four  sections 
will  consist  of  between  110-120  questions. 

Also  planned  is  a  20-30  minute  writing 
sample  or  exercise.  This  writing  s^ple 
will  not  be  scored.  A  copy  of  the 
examinee's  written  work  will  be  sent  to 
each  Uw  school  to  which  an  LSA^/LSDAS 
Report  Is  sent  for  the  examinee. 

The  ^Score  Scale  

The  2(fD-800  score  scale  of  the  LSAT  was 
established  in  1949*  ft  was  based  on  the 
performance  of  candidates  who  took  a 
test  far  different  from  the  one  now.  being 
administered.  Over  time,  new  versions 
of  the  LSAT,  containing  different  types 
of  questions,  have  been  Introduced 
gradually  and  equated  to  previous  ver* 
slons.  Oesplte  these  changes,  the 
200-SOO    score     scale    was  preserved, 

Because  of  the  major  change  in  questions 
employed  on  the  new  I^SAT,  this  version 
will  not  test  the  same  qualities  that  were 
tested  by  older  versions  In  exactly  the 
same  ways.  Consequentlyi  even  if  the 
200-800  scale  vfert  to  be  retained,  scores 
on  the  old  ^nd  new  versions  would  not 
likely  mean  the  saw  thing.  While  there 
Is  no  change  in  the  measurement  objec- 
tKfi's  for  the  testf  or  the  'intended  use 
rt{  the  teitt,  groups  of  applicant?)  might 
ix?   ordered  slightly   differently   by  the 
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new  test  than  they  would  have  been  on 
the  'current  LSAT. 

In  addition*  the  particular  200-800  score 
scale  employed  in  the  LSAT  program  has 
been  a  subject  of  concern  to  LSAC/LSAS 
for  •ome  lime.  This  three-digit  score 
scale  can  create  an  impression  of  preci- 
sion that  Is  not  warranted. 

It  has  been  determined  thai  cn  rnttreiy 
different  score  scale  will  deal  most 
effective^  with  these  and  the  many 
other  considerations  which  must  be  taken 
into  account  when  making  a  decision 
about  the  scale  to  be  used  on  .a  test 
such  "«  the  LSAT-  The  scale  decided 
upon  wJl  yield  scores  across  the  range 
10-50,  '.'he  lowest  score  will  be  10,  and 
50  will  >c  the  highest  score.  It  is  ex-  j 
pected  that  these  extremes  will  be  ap- 
proximately two  and  *one  half  standard  * 
deviations  £rom  the  mean. 


Preparation  Materials 


I.SAC/LSAS  rec9gnlic5^  that  there  Is 
interest  in  and  concern  a^out  this  revi- 
sion in'  the  LSAT,  even  thoyjgh  it  will 
not  be  administered  until  June,  1982,  Of 
particular  concern  are  the  types  of  ques- 
tions which  will  be  bciuded  on  the 
•new"  test.  The  descriptions  of  the 
'  foQr  question  types  which  will  comprise 
the  "new*  LSAT  provided  here  ^^^^ 
Intended  to  meet  these  interests  and^^ 
concerns  at  this  early  state  of  Introduc- 
tion of  the  "new"  test.  Additional 
Informatlor^  about  the  test  and  Its  Intro- 
duction will  be  made  available  during  the 
1981-82  school  year.* 

On  the  folk>wing  pages  there  are  sample 
questions  similar  to  thosti  which  will  be 
used  In  the  revised  version  of  the  LSAT, 
and  discussions  of  the  answers,  Includ- 
ing ej(planations  of  hos'f  the  ^answers 
were  determined.  For  eAch  ^typ^  of 
question  there  is  Gr:*l  a  general  descrip- 
tion and  discussion  of  the  objectives  and 
techniques  for  that  question  type.  Then 
follow  the  directions  preceding  that  type 
of    question   and   sample  questions  with 


discussions  of  the  answ^irs.  The  general 
level  of  difficulty  of  mosft  of  these  ques- 
tions Is  given  to  provide  a  guide  to  how 
examinees  have  performed  on  these 
questions. 

As  with  the  present  LSAT,  actual  test 
formj«  will  contain  a  number  of  trial 
questions,  and  all  examinees  do  not 
necessarily  receive  exactly  the  same  lest 
book.  Answers  to  trial  questions  will 
not  be  counted  In  the  scoring. 

The  descriptive  materials  represent  the 
general  natUXe  of  the  test.  LSAC/LSAS 
have  tried  to  present  Information  here 
about  the  types  of  questions  which  will 
be  used  in  the  LSAT.  But,  circum- 
stances ma.y  require  that  other  question 
types  be  used.  Thus  the  caution  that, 
material  not  described  In  the  discussions 
of  question  types  may  appear  in  the 
test. 

The   •General  Test-Taking  Suggestions" 
in   the   1981-82  LSAS  General  Inrforniatlon  « 
Booklet   will   be  appropriate  to  the  re- 
vised version  of  the  LSAT.  t 

In  tKe  questions  which  follow  the  kicas, 
presentations  and  views  are  those  of  the 
original  authors  and  arc  not  intended  to 
represent  the  opinions  of  Law  School 
Admission  Council.  Law  School  Admission 
Services  or  their  agents  and  contractors. 

Please  remember  that  the  •new^  LSAT  Is 
In  the  final  stages  of  development  and 
that  some  changes  In  the  material  pre- 
sented here  arc  expected. 


 QuestioR  Type  I 

The  purpose  of  this  question  type  is  to 
measure  the  ability  to  read  with  under- 
standing and  Insight.  This  type  of 
question  explores  the  examinee's  ability 
to  analyze  a  written  passage  from  several 
perspectives:  the  ability  to  recognize 
both  explicitly  stated  elements  In  the 
passage  and  assumptions  underlying 
statements  or  arguments  In  tho  passage 
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at    well  the   knplicatlom   of  those 

statements  or  arguments.  Because  the 
written  passage  upon  which  questions 
are  based  presents  a  sustained  discus* ' 
sion  of  a  particular  topic,  there  Is  unple 
context  for  analysing  a  variety  of  rela-  » 
tionshipss  for  .example,  the  function  of  a 
word  in  relation  to  a  larger  segment  of 
the  passage,  the  relationships  among  the 
various  ideas  in  the  passage,  or  the 
relationship  oi  the  author  to  his  or  her 
topic  or  to  the  audience. 

There  are  six  specific  kinds  of  questions 
related  to  this  type.  These  kinds  focus 
on  (1)  the  main  idea  or  primary  purpose 
of  the  passage;  (2)  information  e;q}lidtly 
stated  In  the  passage;  (3)  information  or* 
ideas  Implied  or  suggested  by  the  au- 
thor! (4)  possible  Application  of  the 
author's  ideas  vo  oth^^r  situations;  (5) 
the  author's  logic,  reasoning,  or  persua- 
>sive  techniques;  and  (6)  the  tone  of  the 
passage  or  the  author's  attitude  as  it  is 
revealed «in  the  language  used.         >  'v\ 

r — — ^ 

This  question  type  contains  passages  of 
approximately.  450  words,  each  passage 
providing  the  basis  of  answering  six  or 
more  questions.  The  passages  are 
drawn  from  a  variety  \  of  sources  and 
subject  matter  areas. 


Suggested  Approach 


T5mc? — readin'^  passages  are  drawn 
from  many  different  disciplines  and 
sources,  you  should  not  be  discour- 
.  aged  by  encountering  material  with 
which  you  are  not  familiar.  It  Is 
important  to  remember  that  ques- 
tions are  to  be  answered  on  the 
basis  of  the  information  provided  hi 
the  passage.  You  may,  however, 
want  to  do  last  a  passage  that 
seems  to  you  particularly  difficult 
or  unfamiliar. 

iThere  are  different  strategics  for 
approaching  the  questions;  you 
should  decide  which  works  most 
effectively    for    you.      You  might 


experiment  with  different  strate* 
^es.  Some  different  strategies 
aret  reading  the  passage  very 
closely  and  then  proceeding  to  the 
questions;  skimming  the  passage, 
reading  quickly  through  the  ques- 
tions ,  and  then  rereading  the 
passage  closely;  and  reading  the 
questions  first,  then  reading  the 
passage  closely.  You  may  find  that 
different  strategies  work  better  for 
different  kinds  of  passages;  for 
example,  it  might  be  helpful  with  a 
difficult  or  unfainiliar  passage  to 
read  through  questions  first. 

IWhatever  strategy  you  choose,  you 
should  analyze  the  passage  carefully 
before  answering  the  questions.  As 
with  any  kind  of  close  and  thought- 
ful reading,  you  should  be  sensitive 
to  dues  that  will  help  you  under- 
stand less  explidt  aspects  of  the 
passage.  Try  to  separate  main 
ideas  from  supportlnge  ideas  or 
evidence;  try  also  to  separate  the 
author's  own  Ideas  or  attitudes  /rom 
information  he  or  she  Is  presenting 
in  an  objective  manner.  It  is  impor- 
tant to  note  transitions  from  one 
idea  to  the  next  and  to  examine  the 
relationships-  among  the  different 
ideas  or  parts  of  the  passage:  For 
example,  are  they  :ontra8tlng?  Are 
they  complementary?  You  should 
consider  the  points  the  author 
makes  and  the  co.iclusions  he  or 
she  draws  and 'also  now  and  why 
those  points  are  made  or  conclu- 
sions drawn. 

5You  may  find  It  helpful  to  underline 
or  mark  key  parts  of  the  passage. 
For  example,  you  rolght  underline 
main  ideas  or  Important  arguments, 
or  you  might  cirde  transitional 
words  (although,  nevertheless, 
correspondingly,  and  the  like)  that 
wUl  help  you  map  the  structure  of 
the  passage  or  you  might  note 
descriptive  words  that  will  help  you 
identify  :he  author's  attitude  toward 
a  particular  idea  or  person. 


o 
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lAlways  read  aU  the  Answer  cholcct  . 
before   selecting    the  best  apiwer. 

5Be  careful  not  to  plck»  an  answer 
choice  simply  because  i]^  is  a  true 
statement;  be  careful  ala©  not  to  be 
misled  by  answer  choices  that  are 
only  partially  true  or  only  partially 
•atisfy  the  problem  posed  in  the 
question. 

lAnswer  the  questions  on  the  basis 
of  the  information  provided  In  the 
passage  and  do  not  rely  on  outside 
knowled  ge .  You  r  ow  n  views  or 
opinions  may  sometimes  conflict  with 
the  views  eJepressed  or  the  Informa- 
tion provided  In  Ihe  passage;  be 
sure  thaff  you  work  within  the 
context  provided  by  the  passage. 
You  should  not  expect  to  agree  with 
everything  you  encounter  In  read- 
ing passages. 

 SampU  Qtt— tioiu 

Each  passage  In  this  group  is  followed 
by  questions  ^  based  on  its  content . 
After  reading  a  passage,  choose  the  hest 
answer  to  <r4ch  question  and  blacken  the 
corresponding^  space  on  the  answer , 
sheet.  Answer  all  questions  following  a 
passage  on  the  basis  of  what  is  sUted  or 
implied  In  that  passage.  (Some  or  an  of 
the  passages  for  this  test  have  been 
adapted  from  published  material  to  pro- 
vide the  .examinee  wUh  significant  pro- 
blems for  analysis  and  evaluation.  To 
make  the  passages  suitable  for  testing 
purposes,  the  style,  content,  or  point  of 
view  of  the  original  may  haye  been 
altered  in  some  cases.) 

There  are  two  social  conceptions 
which  can  be  expressed  only  in  terms  of 
myth.  One  Is  the  sodal  c'ontract,  which 
presents  an  account.  p(  the  origins  of 
society.  The  other  Is  the  Utopia,  wrtlch 
presents  an  Imaginative  vision  of  the 
telos  *or  end  at  which  social  life  alms. 
The  myth  .of  the  social  contract  and  the 


myth  of  the  Utopia  both  begin  in  an 
analysis  of  the  present,  the  sodety  and 
concerns  that  confront  the  mythmaker, 
and  they  project  this  analysis'  in  time  or 
space.  The  contract  projects  it  into  the 
past,  the  Utopia  into  the  future  or  to 
some  distant  place.  To  Hobbes,  a  con- 
temporary of  the  Puritan  Revolution,  the 
most  Importa/ii  social  principle  was  the 
maintenance  of  de  facto  power;  hence  he 
constructs  a  myth  of  the  social  contract 
that  turns  on  society's  surrender  of  that 
power.  To  Locke,  a  contemporary  of  the 
Whig  Revolution,  the  most  Impthrtant 
sodal  principle  was  the  relation  of  de 
facto  to  legitimate'  or  de  jure  authority; 
hence  he  constructs  a  myth  of  the  social 
contract  that  turns  on  society's  delega- 
tion of  power.  The  value  of*the  myth  of 
the  social  contract  -  as  sodal  theory 
depends  on  the  depth  and  penetration  of 
the    social    analysis    that    inspires    it . 

The  social  contract,  although  it  Is  a 
genuine  rayth  that  disguises  opinion  as 
fact,  is  also  usually  regarded  as  an 
integral  part  of  sodal  theory.  The 
Utopia,  on  the  other  hand,  although  Its 
origin  Is  also  sodal  analysis.  Is  thought 
of  as  fiction.  The  reason  for  the  differ- 
ence In  the  way  the  myths  are  perceived 
is  that  the  emphasis  In  the  contract  myth 
falls  cTn"  the  present  facts  of  sodety, 
facts  that  it  is  supposed  to  Explain . 
And  even  to  the  area  where  historical 
evidence  lies;  and  so  the  myth  preserves 
at  least  the  gesture  of  making  assertions 
that  can  be  definitely  verified  or  re- 
futed. 

The  Utopia,  however,  cannot  even 
pretend  to  make  verifiable  assertions 
because  It  an  overtly  speculative 
myth;  it  Is  ^designed  to  contain  or  pro- 
vide a  vision  of  one's  social  ideas,  not  to 
be  a  theory  connecting  sodal  'facts 
together.  There  have  been  one  or  two 
attempts  u>  take  Utopian  contructlons 
literally  by  trying  to  set  them  up  as 
actual  communities,  but  the  histories  <yf 
these  communities  make  melancholy  read- 
ing. The  Utopian  writer  looks  at  his  or 
her  Own  sodet/  first  and  tries  to  see 
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what»  ^(or  hit  or  h.:  pxirpoten,  Iti 
significant  elements  are.  The  Utopia 
Itself  shows  what  a  sodety  would  be  like 
If  tho9C  elements  were  allowed  to  exist  In 
their  ideal  form.  Plato  looked  at  his 
society'  and  saw  Its  structures  as  a 
hierarchy  of  priests,  warriors,  artisans, 
and  servants—much  the  same  structure 
that  inspired  the  cast  system. of  Jndla. 
The  Republic  shows  what  a  society  would 
be  like  in  which  such  a  hler^archy  func- 
tioned on  the  principle  of  justice,  that 
is,  each  person  doing  his  or  her  own 
work. 

I.  The  author  belleves^  that  the  myth 
of  the  social  contract  can  be  valu- 
able as  social  theory  when  the 
writer  of  the  myth 

(A)  has*  studied  the  history  of  the 
myth    of    the    social  contract 

(B)  has  analyzed  the  differences 
between  the  conceptions  of  the 
social  contract  and  the  Utopia 

(H)  has  made  an  Insightful  analy- 
sis of  society 

(r>)  is  concerned  with  the  justifi- 
cation of  power 

(V.)   is    Interested    In    social  goals 

This  questiSn  refers  apcclflcaily  to  a 
Atateoicnt  made  by  the  author  at  the  end 
of  the  first  paragraph.  The  author  says 
that  the  value  of  the  myth  of  the  social 
contract  depf?nd«  on  the  quaiity--thc 
"depth  and  penetration" — of  the  analysis 
of  society  that  forms  a  background  to 
the  particular  myth.  The  answer  to  this 
question  of  moderate  difficulty  Is,  there- 
fore, choice  C,  Konc  of  the  other 
answer  choices  relates  directly  to  the 
author's  view  of  what  makes  the  social 
contract  valuable  as  social  theory.  While 
the  author  might  agree  that  the  activities 
described  In  choices  A  and  R  and  the 
kinds  of  motivatlv'n  lu^^^ejilcd  in  choices! 
D  and  Iv  might  affect  the  nature  or  value 
of  a  particular  m/th  of  the  social  con- 
tract, none  of  these  *our  choices  directly 
or  adequately  answers  the  qucstio{i  as  It 
is  posed*  * 


2.  With  which  of  the  following  state- 
ments about  an  actual  Utopian 
community  would  the  author  be  most 
likely  to  agree? 

(A)  A  Utopian  community  Is  more 
equitable  to  all  of  its  members 
than  Is  a  non-utoplan  commu- 
nity" 

(B)  Life  in  a  Utopian  community  Is, 
not   likely    to   be   much   more  * 
pleasant  than  life  in  present- 
day  society* 

(C)  In  the  future  there  will  be  no 
more  Utopian  communities;  they 
will  be  found  only  In  books* 

(D)  A  communltyijascd  on  Utopian  » 
Ideals  Is  more  likely  to  survive 
than  Is  one  based  on  the  con- 
cept   of    the   social  contract. 

(£)  Although  It  Is  unlikely  that  a 
Utopian  community  will  flourish 
in  the  future,  any  attempt  ^o 
found  -  a  Utopian  community 
s^hould  be  encouraged* 

In  order  to  answer  this  rather  difficult 
question,  you  must  evaluate  each  of  the 
answer  choices  In  i  efercnce  to  the  au- 
thocU  various  state  ments  about  actual 
Utopian  communities.  The  statement  that 
the  history  of  actual  Utopian  communities 
makes  "melancholy  reading"  implies  that 
fhc  author  believes  that  historical  Utopia 
communities  have  generally  failed  to 
achieve  their  goals.  Choice  A  can  be 
eliminated  because  ther5  Is  ho  evldenc<5 
in  the  passage  that  Utopian  communities  ^ 
have.  In  the  author**  view,  achieved 
greater  equity  than  ordinary  communi- 
ties* Choice  Bi  however.  Is  compatible 
with  the  Idea  that  actual  Utopian  com- 
munities do  not  accomplish  their  goals» 
and  It  is  the  best  answer*  Choice  C, 
while  at  first  appearing  pUuslblo  given 
the  author's,  lack  of  optJjrjIsm  with  , regard 
to  the  success  of  these  communities,  Is 
not  supported  by  any  evidence  In  the 
passage:  the  author  nowhere  indicates  or 
Implies  that  Utopian  communities  are 
unliHcly  to  be  established  In  the  future* 
CbolecsO  can  be  eliminated  because  there 
Is  no  evidence  in  the  pas5nBe  to  support 
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U  and  because  the  ai/ihor'^J  <Ie»crip;lon 
of  ihe  social  coniraci  in  fact  suggests 
ihai  a  society  based  on  •  present  facts' 
or  analysis  of  th^e  past  might  be  more 
viable  than  one  )<ased  oh  the  imaginative 
"fiction*  of  the/Utopia,  Although  choice 
R  acknowledge  the  author's  skepticism 
with  regard/to  the  Utopian  communities. 
It  incorrectly  attrttSutes  support  of 
Utopian  communities  to  the  author;  a 
positive  view  of  the  worth  of  such  com- 
munities Is  not  borne  out  by  anything  In 
the  passage. 

3«     According  to  the  passage,   Plato  is 
an    example   of   i   mythmaker  who 

(A)  contructed  a  Utopian  society 
based  on  elements  of  his  own 
s6ciety 

(B)  contructed  a  Utopian  society 
as  a  way  of  criticizing  his  own 
society  ^ 

(C)  contructed  a  Utopian  society 
set  In  a  period  before  recorded 
history 

(D)  uicd   the   myth   of   the  Utopia 
^  to  convey  the  concept  of  the 

social  contract 
^)    u&ed  the  rrfyth  of  the  Utopia  to 
ake      verifiable  assertions 
about  history  J 

This  question  refers  tp  the  last  two 
sentences  of  the  last  paragraph*  of  the 
passage.  There  the  author  describes 
the  structure  of  Plato's  society  and 
Indicates  that  The  Republic  projects  that 
society  into  one  operated  "on  the  princi- 
ple of  Justice"  -  a  Utopia,  Once  the 
links  between  Plato  and  The  Republic 
and  a  society  operated  "on  the  principle 
of  Justice*  and,  "a  Utopian  society"  havo 
been  made»  choice  A  can  be  seen  to  he 
the  hcst  answer.  While  each  of  the 
other  choices  might  be  accurate  state- 
ments there  Is  ho  Information  In  the 
passage  to  support  their  accuracy  and 
thus  none  of  them  l»  preferred  over  A. 
This  question  Is  of  moderate  difficulty. 


I 


4, 


In  the  passage  the  author  Is  pri- 
marily concerned  with 


(A)  analyzing  a  process 

(B)  developing  an  ^analogy   

(C)  explaining  differbnccs 

(D)  settling  argumcrfts  ' 

(E)  refuting  .opponchts 

This  relatively  easy  question  requires  a 
choice  among  very  brief  summaries  of  the 
purpose  of  the  passage.  Differences  in 
the  myths  are  directly  referred  to  in  the 
passage  and  examples  and  evidence  of 
Contrast  are  the  constant  focus  of  writ- 
ing. All  of  the  choices  other  than  C 
refer  to  activities  in  whTCh  the  author 
expresses  no  Interest  nor  Is  in  any  way 
Involved  in  the  passage.  — ^ 

According  to  the  passage,  which  Of 
Oic  following  hdst  describes  the 
difference  between  the' way  in  which 
the  myth  of  the  social  contract  and 
the  myth  of  Ihe  Utopia  are  per- 
ceived? 

(A)  Th<>*myth  of  the  social  con- 
tract is  often  regarded  as  art 
accurate  explanation  of'  present 
sodety,  whereas  the  myth  of 
the  Utopia  is  oftt?n  regarded  as 
a  fiction  Involving  element5  of 
present  ^society, 

(B)  The  myth  of  the  social  con- 
tract Is  often  believed  lo  be  an 
accurate  account  of  soclcHy's 
past»  whereas  the  myth  of  the 
Utopia  is  usually  rejtarded  as  a 
probable  account  of  society's  - 
future, 

(C)  The   myth   of    the  social  con- 
trAtt  Is  usually  regarded  aS  a 
less    imaginative    treatment  of 
the  themes  that  are  liic^jjasil? — 
of    the    myth    of    the  u'.opla.' 

(0)  The  myth  of  the  social  con- 
tract Is  usually  thoi»^iht  of  as 
a  ooiitlcal  statement  i  whereas 
the  myth  of  the  Utopia  Is 
usuail"/  thought  of  as  a  senti- 
mental treatment  ^  of  social 
goals. 

(fv)  The  myth^  of  the  social  con- 
tract Is  u*iJ»ally  thought  of  as 
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InsighlfuL-^  social  analysis, 
whereas  the  myth  of  the  Utopia  a 
^)s  ^usually    thought    of   as  a 
psychological  analysis. 

This    que^ttlon    requires    the    review  of 
answer  choices  whicfv^^urport  to  aythe- 
a.ld   integrate  views  ^ou'hd  }h  the 
passage.    Choice  E  can  be  eliminated  by 
virtue  of  the  reference  to  psychological 
analysis  as  the  way  In  which  utopla  Js 
usually  thought  of.     No  .dtrtt^t  support  , 
for  this  conclusion  is  found  Ir  tho  p»s- 
sage.    Roth    tAe    references    to  political 
statement   and  sentimental   treatment  In 
choice  D  are  very  difficult  to^sj^pport 
based  on  -anything    directly    stated  or^ 
-auggestt^f  by  tjic  author  In  the  passage 
«nd  render  ihe  choice  weak.     Choice  C 
suggests    a    conipar^on    based    on  how 
hnaginative   the  theints  of  the  myth  are. 
perceived   to   be.     This  contrast  is  no 
where  directly  stated  'aitd  for  Q  lo  b<;^  * 
the  preferred  tinswer  '4^ouki  require  you 
to  infer  ^n  ev^hution  of  spdai  contract 
ai  to  the  ievei  «if  ima^tinAtlon  shpwn  by 
it  '  since,  the    fn;^lhs,  are    not  directly 
coAipared  by  the  author  In  this  w«y.  ft 
loo  becomc«t  a  ,wec»k  choic<f.  Choige  B  is 
not    preferred    hv^-AUsc     It    MMch  thai 
social  contract  Is  an  accurate  accourU  o( 
the  past  while  Ihc  passage  dcclare»  that 
it  emphasizes  the  present  and  because  It 
declares    that    utopla  ^  is    perceived    as  . 
being     probable     though     the  passage 
indicates  it  to  be  an  ideal  vcith  no  sug- 
gestion   of  ^Its  probability.     The    bc«t  C 
choice   for    this   dlfflci4t  question  Is  A 
since  it  directly  reflects  the  first  part  of  ^ 
the   second   paragraph  ^of   the  passage^ 

6i     The  primary  purpose  of  the  passage 
is  to  1 


(A)  offer  some  reason<t  for  .tht 
conllnuefl  popularity  of  the 
myth  of  the  soci.nl  eontract  and 
the  njyth  of  the  utopla 

(B)  /  shov*  thai  political  events  have 

Influenced    the     writers  who 
-    have   written  *about  the  con-^ 
cepts    of    the    sodal  x^ontract 
^more  tban  they  h^v^  influenced 


'  ^the  writers   who  have  written 
About  the  concept  of  the  Utopia  ^ 

*       ,  (C)   compare  the  orlgi^l  of  the  nf/th 
(  of  the  social  contract  with  the 

origin    of    the-  myth    of  the 

^  '  Utopia  on  the  basis  of  the  In^ 
terrelatlonshlp  betwe(*rk^t^lilical 
and  economic  factors  *  v 
(D)  explain  why  there  Is  a  differ- 
ence between  (he  way  In^  which 
the  myth  of  ihe  social  "Contract" 
haff  been  perceived  and  |he 
way  in  which  the  myth  of  the 
Utopia  has  bc<fn  perceived  in 
the  past 

(R)  contrast  the  my^h  of  the  social 
extract  an*J  the  myth  of  the 
ut^la  ont  the  •basis  of  the  way 
in  Mfhlch  each  type  of  myth  is 
rel/iled  to  'social  .analysis  and 
th^  way  in  which  each  typo  of 

"    ^  myth  Is  perceived. 

Cl}oice  A  in  this  question  refers  to  the 
cuni^f^uvd  pupuUrity  of  the  myths  which 
is>  no  whctc  addressed  by  the  author  In 
the  passage.  While  political  events  arc 
ma^ie  In  t^e  passage  to  establish  refer- 
encje   ||^oint»   for  Locke  and  Hobbes,  rfo 

.contrast  between  these  writers  and  those 
dealing  wlUj  utopla  Is  ever  offered  by 

,th(i   author*^  Thus  choice  B  is  a 

*on|;.  .The  ^comparison  suggested  ,ln 
Choice  G  is  also  not  made  by  the  pas- 

-iwae  wl)lth*states  that  tbc  origin  of  both 
mfths  is  lo  tbc  present  but  docs  not 
focus  on  political,^  economic  or  other 
Specific  factors  in  'society  in  It^  rcfir- 
'  cn^cs  to  the  origin  of  Ihc  myths.  Choice 
C  is  not  preferred.  Choice  D*  Is  not 
preferred  because  It  deals  only  with  the 

^perception  aspect  of  the  passage  while 
<^oIce  E  integrates  ifoth  perception  of 
^he  myths  and  their  rchtlonship  to  sodal 
.^nalf^ts  and  is  the  best  answer  to  this 
moderately  ^flcult  question. 


1 


■■Jypo  II  question*  focus  on  tho  ability  th 
i^nderstiind*  a  structure  relationships 


Q'uestion  Type  11 
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and  to  draw  concSuilons  About  that 
structure.  The  examinee  Is  asked  to 
understand  the  conditions  used  to  esta' 
bllsh  the  structure  of  the  relationship 
and  to  deduce  new  Information  from 
therrt*  Each  group  of  Type  II  questions 
con«ists  of  (I)  a  set  of  some  three  to 
seven  related  cor.itttlons  (and  sometimes 
older  esp«natory  material)  describing  a 
structure  of  relationships*  and  (2)  three 
6r  more  questions  that  test  understand- 
ing of  the  implicatlQns  of  that  structure. 
Although  eaqh^  question  in  a  group  Is 
based  on  the  same  set  of  conditions,  the 
questions  ate  independent  of  one  an- 
other: answering  one  question  in  a 
group  does  not  depend  on  answering  any 
other  question. 

No  knowledge  of  formal  Jogic'  Is  required 
for  solvl;ig  these  problems.  Type  II 
questions  are  Intended  to  be  answered 
using  knowledge,  skill,  and  reasoning 
ability  which  are  expected  of  college 
students  and  graduates. 

Riach  gi'oup  of  questions  Is  bascdjon  a 
set  of  conditions  that  cstablishi  refitlon- 
shlps  among  persons,  places,  things,  or 
events.  The  rclatlonsh^os  are  common 
ones  such  as  temporal  o  der  (X  arrived 
before  Y  but  after  Z)i  spatial  ^cjler  (M 
always  sits  in  frOnt  of  G  and  balijnd  F); 
group  membership  (If,  ,Profess<Kfc  Green 
serves  on  the  committee,  then  Professor 
Brown  must  also  serve);  and  family 
structure  (Mary  Is  Juan's  mother  and 
Belinda's  sister).  The  conditions  should 
be  read  carefully  to  determine  the  exact 
nature  of  the  relationships  Involved. 
Some  relatlon5;iif>s  are  fixed  (P  and  R 
always  sit  at  th,»  same  table).  Other 
relationships  are  .arlable  (0,  must  be 
asslgrj^d^'to  either  table  1  orf  table  ^)., 
....Sffmcr  relationships  that  are  not  stated  In 
the  conditions  can  be  deduced  from  those 
that  are  stated.  (If  one  condition  about 
books  on  a  shelf  specifies  that  Book  L  Is 
to  the  left  of  Book  Y,  and  another 
specifics  that  Book  P  is  to  the  left  of 
Book  I»»  then  it  can  be  deduced  that 
Boolt  P  is  to  the  left  of  Book  Y.) 


Suggested  Approach 


iSome  examinees  prefer  to  answer 
first  those  questions  in  a  group 
that  seem  lo  pose  little  difficulty 
and  then  to  return  to  those  that 
stem  troublesome*  It  Is  best  not  to 
start  one  group  before  finishing 
another  because  much  time  can  be 
lost  In  returning  to  a  question 
group  and  reestablishing  familiarity 
with  Us^wXelatlonshlps.  Do  not  as- 
sume that,  because  the  conditions 
for  a  set  look  long  or  complicated, 
the  questions ,  based  on  those  condi- 
tions -wlU  b-  especially  difficult. 
1 

Jin  reading  the  conditions,  do  not 
Introduce  unwarranted  assumptions; 
for   instance.   In  a  rtet  establishing 


relationship  of  hdjjht  and  weight 
among  the  members  Jof  a  team,  do 
not  assume  that  a  toerson  who  Is 
taller  than  another^  person  must 
weigh     more     than     that  person. 

?It  is  intended  that  the  conditions^ be 
as  clear  »»  possible;  do  not  inter- 
pret them  as  If  they  were  designed 
to  trick  you.  'For  example.  If  a 
question  asks  how  many  people 
could  be  eligible  to  serve  on  a 
committee,  consider  only  those 
people  named  In  the  explanatory 
material  unljsy  directed  o^thofwlse. 
When  In  doubt,  read  the  conditions 
In  their  most  obvious  sense.  How- 
ever, the  language  In  the  conditions 
Is  intended  to  be  read  for  precise 
meaning.  It  Is  essential,  for  In- 
sunce,  to  pay  particular  attention 
to  words  that  describe  or  limit 
relationships,  such  as'  only,  exactly, 

never,  always  must  be,  cannot  be, 
and  the  like.  The  result  of  the 
careful  reading  described  above 
should  be  a  clear  picture  of  the 
structure  of  relationships  Involved, 
Including  what  k|nds  of  relationships 
are  permitted,  who  or  what  the 
participants     In     the  relationships 
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are,  and  what  15  and  in  not  known 
about  the  structure  of  the  relation- 
ships. For  instance,  following  a 
careful  reading  it  can  often  be 
determined  whether  only  a  single 
configuration  of  relationships  is 
permitted  by  the  conditions  or 
whether  ait<;rnative  configurations 
arc  permitted . 

IMany  examinees  find  it  useful  to 
underline  key  points  in  the  condi- 
tions or  to  draw  a  diagram  repre- 
senting the  configuration,  as  the 
directions  for  the  sectio't  suggests. 

5Even  though  some  people  find 
diagrams  to  be  very  helpful,  other 
people"  seldom  use  them.  And 
among  those  who  do  regularly  use 
diagrams  in  solving  these  problems, 
there  is  by  no  means  universal 
af;(*cement  on  which  kind  of  dia.7ram 
is  best  for  which  problem  or  in 
which  casas  <*  diagram  is  most 
useful.  Thercfort*.  do  not  be 
concerned  If  a  particular  problem  in 
the  test  seems  to  be  best  approached 
vv^thout  the  use  of  diagrams. 

5 Each  question  should  be^  considered 
separately  frorr  the  other  questions 
jn  its  group;  no  information,  except 
what  Is  given  In  the  original  condi- 
tions, should  be  earned  over  from 
one  question  to  another.  In  some 
cases  a  question  will  simply  ask  foi  , 
conclusions  to  be  drawn  frotn  th<; 
conditions  as  originally  given.  An 
incUvidual  question  can,  however, 
add  Information  to  the  original 
conditions  or  temporarily  suspend 
one  of  the  original  conditions  for 
the  purpose  of  that  question  only. 
For  example,  if  Question  *l  adds 
the  information  "if  P  is  sitting  at 
tablo  this  infornaatlon  should 

NOT  be  carried  over  to  any  other 
question  in  the  group. 


8>«ple  Quo tioim 


Each  group  of  questions  is  based  on 
a  set  of  conditions.  In  answering  some 
of  the  questions  It  may  be  useful  to 
draw*  a  rough  diagram.  Choose  the  best 
answer  for  each  question  and  blacken 
the  corresponding  space  on  your  answer 
s)?eet.  '  ^ 

Questions  1-3 

Six  people  are  standing  in  a  ticket 
line,  one  behind  the  other,  all 
facing  the  ticket  window. 

Each  person  Is  w-earing  a  colored 
hat.  ' 

There  are  two  people  wearing  blue 
hats,  two  people  wearing  red  hats, 
one  person  wearing  a  green  hat, 
and  on6  person  wearing  a  yellow 
hat. 

The  number  of  people  between  the 
two  people  wearing  red  hats  Is  the 
same  as  the  number  of  people 
between  the  two  people  wearing 
blue  hats.  That  number  may  be 
zero, 

1 .  All  of  the  following  are  possible 
color  arrangements  for  the  first 
three  hats.  In  order  from  first  to 
third,  EXCEPT 

(A)  blue,  yellow,  red 

(B)  red.  yellow,  blue 

(C)  red ,  red  ,  blue 

(D)  yellow,  blue,  green 

(E)  yellow,  green,  blue 

x 

The  answer  to  this-  moderately  difficult 
questicr  can  be  determined  as  follows: 
examine  each  «nswer  choice  and  decide 
whether  It  is  possible  to  complete  the 
arrangement  of  the  hats  in  a  way  that 
would  not  violate  any  of  the  conditions. 

In  choice  (A),  the  arrangement  BYRBGR 
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Is  possible  (with  B  standing  for  a  person 
wearing  a  blue  hal,  V  for  a  person 
wearing  yellow,  and  so  forth  ♦)  This 
rules  out  (A)  as  a  possible  answer, 
since  the  question  asks  you  to  Identify 
the  arrangement  thar-  is  NOT  possible. 

In  choice  (B),  RYBRGB  Is  possible, 
which  rules  out  (B)  as  a  credited  an- 
swer* 

In  choice  (C),  RRBBGY  Is  possible, 
which  rules  out  (C)  r*s  a  credited  an- 
swer* 

In  choice  (E) ,  the  arrangement  YGBBRR 
is  possible,  which  rules  out  (E)  as  the 
credited  answer* 

In  choice  (0)  however,  no  acceptable 
order  can  be  constructed*  The  first 
three  hats  are  YBG,  leaving  one  blue 
hat  and  two  red  hats  to  complete  the 
line*  An  attempt  to  place  the  remaining 
blue  hat  In  eich  of  the  remaining  posi- 
tions (fourth,  fifth,  and  sixth)  shows 
that  no  acceptable  order  exists: 

YBGBRR 
or 

YBGRBR 

^  or 
YP-ORRB 

In  each  arrangement,  there  would  be  an 
unequal  number  of  people  between  the 
people  wearing  the  two  blue  hats  and  the 
people  wearing  the  two  red  hats*  Choice 
(D)  is  the  credited  answer,  since  It  is 
the  only  arrangement  that  Is  NOT  pos- 
sible* — 

The  explanation  of  the  ('way  to  answer 
this  question  demonstrates  several  points 
that  may  be  useful  in  answering  other 
questions  of  this  type*  First,  .a 'simple 
diagraming  system  In  which  B  stands  for 
a  person  wearing  a  blue  hat,  Y  stands 
for  a  person  wearing  a  vellow  hat,  and 
so  forth,  makes  It  easy  ^to  diagram  each 
order  In  a  concise  manner,  Second,  In 
this  question,  which  asks  you  to  deter- 
mine which  if  not  a  possible  arrange- 


ment. It  is  necessary  to  determine only 
one  possible  arrangement  to  rule  out 
each  of  the  offered  choices,  even  though 
{here  might  be  other  possible  arrange- 
ments that  would  satisfy  the  conditions* 
ihlrd.  In  a  question  that  asks  you  to 
determine  which  choice  is  NOT  accept- 
able. It  Is  very  Important  to  keep  In 
mind  that  what  you  are  seeking  as  the 
answer  Is  an  UNACCEPTABLE  combina- 
tion* 

2*  If  the  fourth  person  Is  wearing  a 
yellow  hat,  which  of  the  following  Is 
a  complete  and  accurate  list  of  all 
of  the  people  who  could  possibly  be 
wearing  the  green  hat? 

(A)  The  third  person 

(B)  The    first    and   third  persons 

(C)  The    first    and   sixth  persons 

(D)  The    first,   second,   and  third 
persons 

(E)  The    first,    third,    and  fifth 
persons 

This  moderately  dlf.lcult  question  can  be 
approached  by  considering  each  of  the 
choices  in  turn* 

In  choice  (A)  it  Is  relatively  simple  to 
determine  that  the  third  person  could  be 
wearing  the  green  hat*  The  arrange- 
ment BBGYRR  satisfies  all  the  condi- 
tions* Tffls  makes  choice  (A)  attractive, 
but  the  careful  test-taker  will  notice  that 
the  question  asks  for  a  "complete"  list  of 
the  people  who  could  possibly  be  wearing 
the  green  hat;  therefore  It  Is  necessary 
to  continue. 


In  (B) ,  It  can  be  demonstrated  that  the 
first  person  could  be  wearing  the  green 
hat*  For  example  the  arrangements 
GBBYRR  satisfies  all  the  conditions. 
This  demonstrates  that  choice  (B)  is  a 
possible  answer,  and  alsrj  rules  out 
choice  (A)  since  (A)  is  not  a  complete 
list  of  the  people  who  could  be  wearing 
the  green  hat* 

In  choice  (C),  it  Is  not  necessary  to 
make   a,  diagram*     Since  It  has  already 
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been  shown  that  the  third  person  couid 
be  wearing  the  green  hat»  (C)  cannot  be 
a  ^complete"  list  of  all  the  persons  who 
could  be  wearing  it. 

In  choice  (0)  it  is  necessary  to  deter- 
mine whether  or  not  the  second  person 
could  be  wearing  the  green  hat.  One 
way  to  do  this  would  be  with  the  follow- 
ing diagram; 


1 


This  shows  that  no  matter  how  the  red 
hj|l^and  the  blue  hats  are  distributed, 
iMneu  will  not  be  an  equal  number  of 
people  between  the  two  wearing  the  blue 
hats  and  ,two  wearing  the  r^d  hats. 
This  rules  out  choice  (O)  as  the  credited 
answer,  since  th'S  question  asks  for 
complete  and  accurate"  list  of  the  people 
who   could   be   wearing    the  green  hat. 

In  choice  (B)  a  similar  dtagram  could  be 
constructed: 


This  alio  shows  that  no  matter  how  the 
red  hats  and  the  blue  hats  are  diitrib" 
uted,  the  conditions  cannot  be  satisfied. 

Choice  (B)  therefore,  ts  the  credited 
answer.  Notice  that  in  order  to  answer 
this  .question,  it  Is  not  necessary  to 
determine  that  the  sixth  person  cannot 
be  wearing  the  green  hat,  nor  Is  It 
necessary  to  determine  all  of  the  dif- 
ferent  acceptable  arrangements.     It  ts. 


however,  very  imp>ortant  to  pay  close 
attention  to  the  wording  of  the  question, 
to  be  sure  that  the  answer  chosen  is  the 
"complete  and  accurate'  list  of  all  of  the 
people  who  could  be  wearing  the  gteen 
hat. 

3.  If  both  people  wearing  red  hats  are 
farther  back  In  line  than  both 
people  wearing  blue  hats,  and  if 
there  is  at  least  one  person  beiween^ 
the  person  wearing  the  yellow  hat 
and  the  person  wearing  the  green 
hat}  which  of  the  follov.ing  must  be 
true? 

I.  The  third  person  Is  wearing  a 
blue  hat. 

II.  If  the  first  person  is  wearing 
a  blue  hat,  the  fourth  person 
Is  wearing  a  red  hat. 

III.  The  third  and  fourth  persons 
are  wearing  hats  of  different 
colors* 

(A)  I  only 

(B)  II  only 

(C)  III  only 

(D)  I  and  III  only 
(K)  II  and  III  only 

On^  approach  to  this  difficult  ques- 
tion would  be  to  construct  a  diagram 
showing  ail  of  the  possibilities  allowed 
under  the  restrictions.  From  line  (1)  It 
can  be  determined  that  I  need  not  be 
true.  Line^  (i)  and  (Iv)  show  that  II 
must  be  true.  The  diagram  as  a  whole 
siiows  that  in  must  be  true.  Therefore, 
(£)    is  '  the    answer    to    this  question. 
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Quegtion  Type  m 


ThU  type  of  question  is  designed  lo 
evaluate  both  reading  and  reasoning 
skills.  With  respect  to  reading,  the 
questions  require  an  accurate  and  de- 
tailed understanding  of  the  situation 
established  by  1)  a  descriptive  set  of 
facts  that  leads  to  a  dispute  or  case 
and»  2)  two  rules  that  can  be  used  to 
govern  the  •  outcome  of  the  dispute  or 
case. 

With  respect  to  reasoning,  the 
questions  require  an  ability  to  identify 
relevant  Information  and  recognize  how 
to  apply  tl'at  information  in  a  sequence 
of  steps.  Specifically,  this  will  require' 
the  ability  to:  recognize  when  or  under 
what  conditions  a  general  rule  should  be 
applied  to  a  specific  set  of  facts;  recog- 
nize when  the  application  of  two  rules  to 
a  dispute  or  case  will  lead  to  different 
outcomes;  determine  whether  new  infor- 
mation is  relevant  to  the  application  of  a 
general  rule  to  a  specific  set  of  facts; 
determine  how  th*  is  sup  raised  by  a 
question  be<irs  on  the  application  of  a 
rule  to  a  given  set  of  facts. 

Although  the  facts  and  the  rule^ 
may  be  real  or  imaginary,  they  do  not 
presuppose  knowledge  of  law.  The  rules 
may  be  written  using  language  similar  to 
that  used  by  advocates  and^  jurists,  but 
no  actual  knowledge  of  law  is  needed  to 
understand  the  rules.  If  it  is  necessary 
to  know  the  meanings  of  any  technical 
terms  that  are  present,  their  meanings 
will  be  explained.  It  must  be  kept  In 
mind  that  though  theue  problems  may 
seem  like  those  dealt  with  by  the  law, 
they  arc"  tests  of  reading  and  reasoning 
abilities  only. 

AH  of  the  questions  of  this  type  are 
presented  in  sets.  Kach  question  in  a 
,set  must  be  evaluated  Independently  of 
all  other  questions  in  the  set.  Each 
question  and  the  issue  that  it  raises 
must  be  examined  only  .li^  lerms  of  the 
facts  and  the  rules  given  for  that  set. 


The  basic  elements  of  these  pro- 
blems are: 

The  Facts:  a  factual  description  of 
the  characteristics ,  the 
specific  actions »  and  the 
relationships  between  peo- 
ple or  institutions; 

The  Dispute 

or  Case:  a  conflict  that  arises  be- 
tween the  people  or  Insti- 
tutions./ decribed  in  the 
facts; 

The  Rules:       the  two  rules  that,  when 
applied  to  the  f«»cts  either 
independently  or  togeth- 
^      er,  govern  the  outcome  of 
the     dispute     or  case; 

The  Questions:  the  Issues  to  be  classi- 
fied in  terms  of  their 
importance  in  applying 
the  rules  to  resolve  the 
dispute  or  case. 

The  exerase  In  these  problems  is 
one  of  classification.  The  Issues  raised 
must  be  classified  in  terms  of  their 
relationship  lo  the  application  of  the 
rules  to  the  dispute  or  case  described  In 
the  facts.  Issues  can  be  classified  In 
four  ways. 


(A) 


A  major 

requires 

rules. 


issue  whose  resolutipn 
a     choice    between  the 


Issues  of  this  type  require  the 
application  of  the  rules  given 
to  govern  the  outcomes  of  the 
dispute  or  case.  If  the  appli- 
cation of  each  of  the  rules 
leads  to  a  different  outcome, 
and  there  Is  no  basis  for 
making  a  decision  about  which 
rule  to  apply,  a  choice  be- 
tween the  rules  must  be  made. 

(n)   A     major    issue    whose  resolution 

requires    additional    facts  or  rules 

but  does  not  require  a  choice 
between  the  rules. 
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Issues  of  this  type  require 
further  information  that  will 
establish  Important  facts » 
clarify  important  "terms  in  one 
or  both  of  the  rules,  and/or 
provide  additional  rules  rele- 
vant to  decidinr  the  outcome. 
However,  these  issues  do  not 
require  a  choice  between  the 
rules;  they  establish  whether  a 
major  condition  of  a  rule  Is 
met. 

(C)  A  major  issue  that  is  readily  an- 
swered by  logical  reasoning  or  by  a 
reasoned   application   of   the  rules. 

Issues  of  this  type  can  be 
.determined  by  understanding 
the  facts  or  by  the  application 
of  the  rules  to  the  facts . 
This  determination  requires 
only  the  careful  use  of  common 
sense. 

(0)  An  i^sue  that  is  not  logically  rjilc 
vant  to  the  <Iispute  or  case  at  the 
end  of  the  facts  or  that  raises 
remote    and    unlikely  possibilities* 

Issues  of  this  type ,  though 
^  they  may  be  significant  in 
other  contexts,  do  not  bear  on 
the  outcome  of  the  dispute  or 
case  as  governed  by  the  given 
rules. 

^  Some  questions  only  raise  Issues; 
some  questions  supply  new  information  as 
about  facts  and/or  rules  as  well.  Each 
question  must,  however,  be  considc**cd 
independently,  in  terms  of  any  new 
information  the  question  may  contain  and 
the  given  set  of  facts  and  rules. 

Do  not  assume  that  there  will  be  a 
single  right  outcome  for  the  dispute  or 
case*  The  rules  can  conflict  with  what 
seems  right  or  Just  to  you.  Precon- 
ceived notions  of  how  the  law  works  or 
ought  to  work  should  not  be  considered 
in  classifying  the  issues.  The  Issues 
must  be  classified  on  the  Basis  of  what 


is  stated  in  the  facts  and  the  rules,  and 
what  may  be  logically  inferred  from  the 
facts  and  the  rules and  common  sense. 

Suggested  Approach  

JRead  the  facts  carefully.  Determine 
accurately  and  completely  the  kinds 
of  relationships  that  arc  established 
between  or  among  the  people  or 
institutions  described*  Determine 
what  the  dispute-  or  case  is  about* 
who  the  parties  involved  in  the 
dispute  or  case  are,  and  how  the 
dispute  or  case  defines  the  conflict* 

5Read  the  rules  carefully.  Deter- 
mine what  requirements  and  respon- 
sibilities are  established*  Determine 
specifically  and  in  detail  what  the 
differences  are  between  the  two 
rules.  Pay  particular  attention  to 
such  words  as  if,  and,  '  or,  all, 
cannot,  and  only  when.  These 
words,  and  words  like  them,  are 
very  Important  In  establishing  how 
the  rules  are  related  to  each  other 
and  how  the  rules  will  govern  the 
outcome    of    the    dispute    or  case* 

tCorrolate  the  terms,  requirem'ents, 
and  responsibilities  established  by 
the  rules  with  the  persons,  Institu" 
tlons,  and  actions  given  in  the 
facts* 

tRcad  each  question  carefully.  The 
task  is  to  identify  the  is'sue* 

«  5 Ask  the  following  questions:  Docs 
the  issue  concern  information  that 
is  relevant  and  important  to  the 
dispute  or  case?  If  it  does  not, 
classify  the  Issue  (D). 

tif  the  issue  is  rel(^vant  and  Impor' 
tant  to  the  dispute  or  case,  ask  the 
jCbliowing  question:  Docs  the  Issue 
make  it  necessary  to  choose  between 
the  two  rules,  both  of  which,  as 
far  as  can  be  determined,  apply  to 
the  case?  In  these  problems,  you 
must  not  automatically  suppose  that 


lOi 


94 


one  of  the  iwo  rules  lakes  prece- 
dence over  the  other.  You  must 
accept  that  the  rules  arc  of  equal, 
importance.  If  you  must  choose 
between  the  given  rules  lo  resolve 
the  i«'ie,  then  'classify  the  issue 
(A). 

tOoeS,  the  Issue  concern  missing 
information,  ^Juch  as  facts  or  rules, 
that  w  Important  in  determining  how 
to  apply  the  given  r^les  but  that 
docs  not  require  you  to  decide 
which  of  the  rules  takes  prece- 
dence?    Classify  such   issues   (Bl . 

50oes  the  issue  concern  matters  that 
can  idcquately  be  determined  by 
understanding  the  facts,  by  logical 
inferences  -  from  the  facts,  or  by  a 
logic il  and  Justified  application  of 
the  rules  to  the  facts'  If  so, 
classify  the  issue  (C). 


Sample  Qtte>tiODJ 


Kach  of  the  sets  in  this  section 
contains  a  statement  of  facts  .,and  two 
rules.  These  rules  may  b<x.  either  real 
or  imaginary,  but  for  purposes  of  this 
test  you  are  to  assume  them  to  be  valid. 
The  rules  are  followed  by  questions 
raising  issues  thkt  may  pertain  to  the 
application  of  one  or  both  of  the  rules  to 
the  dispute  or  case  presented  at  the  end 
of  the  facts.  Classify  the  issue  rftised 
Ky  ^h"q^stIon  according  to  the  follow- 
ing choices  and  blacken  the  correspond- 
ing space  on  the  answei-  sheet. 

(A)    A     major    issue    whose  resolution 
^  ^requirc^  a  choice  between  the  rules 

(nr<'\  T^ajor  issue  whose  resolution 
requires  additional  facts  or  nlles 
but  does  not  require  a  choice 
between  the  rules 

(C>  A  major  i»su*»  that  is  readil/  an- 
swered by  logical  reasoning  or  by  a 
reasoned    application    of    the  rules 


(O)  An  issue  that  Is  not  logically  rele- 
vant to  the  dispute  or  case  at  the 
end  of  the  facts  or  that  raises 
remote     and     unlikely  possibilities 


Facts: 


Rules: 


Andy  and  John  had  been 
partners  for  twenty  years 
wnen  Andy's  wife,  Beth, 
divorced  him  and  married 
John.  Andy  decided  to  get 
even  with  John  by  arranging 
the  theft  of  a  gold  ncckla':e 
that  John  had  given  to  Beth. 
Andy  was  afraid  that  if  he 
tried  to  take  the  necklace 
himself  he  would  be  recog- 
nized, so  he  told  Oscar,  his 
younger  brother,  that  if  Oscar 
did  not  steal  the  ncfcklace  and 
keep  It  for  himself,  he,  Andy, 
would  kill  him.  Andy  knew 
that  he  could  not  kill  his 
brother,  but  Oscar,  who  had 
been  afraid  of  Andy  since 
childhood,  was  frightened  and 
so  he  decided  to  take  the 
necklace.  The  night  that 
Oscar  took  the  necklace  from 
Beth's  dresser,  Beth  wakened 
and  recognized  Oscar.  Oscar 
was  charged  with  the  crime^  of 
grand  larceny. 

I.  One  who  takes  personal 
prop'jrty  with  a  value  of 
over  one  hundred  dollars 
from  the  possession  of 
another  with  the  intent  to 
steal  the  property  is 
guilty  of  the  crime  of 
grand  larceny. 

II,  A  person  who  commits 
what  would  otherwise  be  a 
crime  concerning  property 
because  he  believes  that 
his  life  will  be  endan- 
gered if  be  does  not  do 
so  has  not  committed  a 
crime. 


How  did  Oscar  get  into 
home  of  -John  and  Beth? 


the 
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If  the  ni^klacc  was  worth  Hvc 
hundred  <K)!!ars  and  If  Oscar 
intended  to  steal  the  necklace 
because  he  believed  that  he 
would  be  killed  Jf  he  did  not 
do  as  Andy  said,  has  Oscar 
committed  grand  larcency? 

If  the  necklace  was  worth 
eighty-five  dollars  and  if 
Oscar  believed  that  Andy 
would  kill  him  if  he,  Osca^,  ;i 
did  not  steal  it,  has  Oscar 
committed  grand  larcency? 


4.  What  was  the  value  of  the 
necklace  taken  from  Beth's 
dresser? 

1.  How  did  Oscar  get  Into  the  home  of 
John  and  Beth? 

This  very  easy  question  focuses  on 
the  distlA<^tion  between  a  major 
*  issue  and  an  issue  that  is  not 
logically  relevant  to  the  case. 
Oscar  is  b«ing  charged  with  grand 
larceny,  and  the  two  rules  establish 
conditions  that  determine  whether 
or  not  grand  Marceny  has  taken 
place.  The  conditions  have  nothing 
to  do  with  the  way  in  which  Oscar 
entered  the  house.  Thus,  the 
credited  answer  is  (D). 

2.  If  the  necklace  was  worth  five 
hundred  dollars  and  if  Oscar  in- 
tended to  steal  the  necklace  because 
he  believed  that  he  would  be  killed 
if  he  did  not  do  as  Andy  said,  has 
Oscar     committed     grand  larceny? 

In  order  to  classify  the  issue  raised 
^  by  this  question,  you  must  first 
apply  the  new  information  In  the 
question  to  the' situation  created  by 
the  facts  and  the  two  rules.  In 
order  for  Huie  I  to  apply,  two 
conditions  have  to  be  met:  first, 
the  necklace  has  to  be  worth  f7»re 
than  one  hundred  dollars,  and 
second,   the  person  who  takes  the 


property  has  to  take  the  property 
with  the  intention  of  stealing  it.  If 
the  necklace  was  worth  five  hun- 
dred dollars  and  if  Oscar  intended 
to  steal  the  necklace,  then  Rule  I 
does  apply.  If  Oscar  believed  that 
he  would  be  killed  if  he  did  not  do 
Andy  said,  then  Rule  II  also 
applies  to  the  case.  Note  th^t  both 
'uies  apply  but  that  there  is  no 
logical  basis  for  choosing  one  rule 
over  the  other.  Moreover,  the 
outcome  would  be  different  under 
the  two.  rules:  the  issue  "has 
Oscar  committed  grand  larceny?"  is 
a  major  Issue  that  cannot  bo  re- 
solved without  choosing  between 
Rule  I  and  II.  The  credited  answer 
to  this  question  of  moderate  diffi- 
culty is  (A). 

If  the  necklace  was  worth  eighty- 
five  dollars  and  if  Oscar  believed 
^hat  Andy  would  kill  him  if  he, 
Oscar,  did  not  steal  it,  has  Oscar 
committed  grand  larceny? 

The  issue  raised  by  this  question  is 
one  that  can  be  answered  by  logical 
reasoning.  If  the  necklace  Is  worth 
less  than  one  hundred  dollars,  then 
Rule  I  does  not  apply,  regardless 
of  whether  Oscar  intended  to  steal 
tKe  necklace.  If  Oscar  bellevecl 
that  he  would  be  killed  if  he  did 
not  take  the  necklace,  then  Rule  II 
does  apply.  The  conditions  that 
would  make  Oscar  guilty  of  grand 
larceny  do  not  apply  to  the  case, 
while  the  conditions  that  would 
establish  his  innocence  do  apply; 
therefore,  Oscar,  has  not  committed 
_grand.  larceny  as  A  is  defined  by 
the  rules.  The  issue  raised,  then, 
should  be  classified  as  (C) .  This 
IB  a«,fairly  difficult  question. 

What  was  the  value  of  thq  necklace 
taken  from  Beth's  dresser?  ' 

Before  classifying  the  Issue  raised 
by- this  question,  you  should  review 
the    facts.     The    facts    state  that 
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.  Bclh'9  necklace  is  gold*  which 
suggests  thai  the  neckiace  might  be 
of  great  value.  However*  since  it 
is  not  known  how  much  gold  is  in 
the  necklace  or  what  c;mdition  the 
necklace  is  in,  it  is  fimpossibte  to 
infer  the  necklace's  vilue^  from  the 
facts.  The  value  of  the  necklace, 
*  however,  is  a  major  issue*  since 
■  Rule  I  applies  only  if  the  value  o( 
tbe  necklace  exceeds  one  b^ndrcd 
dollars.  The  credited  answer  to 
this  question  of  average  difficulty 
is  (B).  Note  that  the  classification 
of  the  issue  raised  by  this  question 
should  be  made  independently  of 
the  nc*,  information  supposed  in 
questions  Z  and 

Question  Type  IV 

The  purpose  of  this  type  of  question  Is 
to  evaluate  aptitude  for  understanding, 
analyring,  using,  and  critiring  a  variety 
of  argifmcnts.  The  questions  arc  based 
on  short  arguments  that  arc  drawn  from 
philosophical  treatises »  literary  works 
and  criticism,  »nd  other  materials  from 
Ihc  humanities,  frofn  the  social  sciences  * 
from  scientific  articles,  and  from  sources 
such  as  political  speeches,  advertise- 
ments, and  informal  discussions  or 
conversations. 

The  questions  sample  a  variety  of  abili- 
ties that  can  be  considered  subtypes  of 
the  ability  to  -^ason  logically  and  criti- 
cally. Ouestio.^  measuring  this  ability 
require  that  you  be  able  to  (1)  -recognize 
the  point  of  an  argument,  (2)  perceive 
presuppositions  essential  to  or  support- 
ing an  argument  Qr  chain  of  reasoning, 
(y)  diaw  conclusions  from  given  evidence 
or  premises.  (4)  infer  missing  material 
(such  as  implied  arguments  or  antecedent 
and  follow-up  statements),  (S)  apply 
principles  that  govern  one  argument  to 
Uother  argument  (6)  ident  fy  methods 
of  argument  and  persuasion,  (7)  evaluate 
arguments,  («)  differentiate  between 
fltatcwents    of    fact    and    opinion,  (9) 


analyze  evidence  and  (10)  assess  claims 
critically.  , 

It  should  be  emphasized  that  the  ques- 
tions do  not  pre^ppose  knowledge  of 
the  terminology  of  formal  k>gic.  You 
would  not  be  asked,  for  example,  to 
evaluate  an  argument  b/> describing  it  as 
..gumcntum  ad  hominem  but  would  be 
rxpected  to  recognize  the  unreasonable- 
ness of  an  attack  on  a  person  when  an 
attack  on  an  idea  is  more  appropriate. 


Suggested  Approach 


5Read  each  question  carefully.  This 
type  of  question  does  not  require 
any  formal  background  in  logic, 
All  that  each  question  requires  is  a 
close  and  careful  evaluation  of  the 
reasonableness  of  the  f"*^*^^*) 
given.  This  evaluation  can  be  based 
completely  on  common  sense. 

5Makc  sure  that  you  understand  the 
meaning  of  each  part  of  the  ques- 
tion. What  relationships  are  esta- 
blished? What  steps  in  the  argu- 
ments are  given?  Arc  any  seeming- 
ly necessary  relationships  omitted? 
Are  any  steps  in  the  argument 
omitted? 

5Read  each  choice  carefully,  Remem- 
ber that  you  are  basically  evaluat- 
ing  the   reasonableness  of  a  given 


argument  or 


Inference    or  being 


asked  to  reach  reasonable  con- 
clusions from  a  given  argument  or 
Inference  • 

IMake  sure  that  you  understand  the 
meaning  of  each  choice  and  the 
ways  in  which  it  may  or  may  not 
relate  logically  to  the  question 
asked. 

5This  type  of  question  does  not 
Involve  any  tricks  or  hidden  mean- 
ings. Simply  apply  common  Sense 
to  each  question. 


i 
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 SampU  Qaftioitf  

The  questions  in  this. section  require 
you  to  evaluate  the  reasoning  contained 
in    brief    statements    or   passages.  In 
some  questions,  each  of  the  choices  is  a 
^conceivable    $olution    to    the  particular 
.problem    posed.     However,    you    are  to 
^select  the  one  that  is  best,  that  is,  the 
'  one   that  does  not  require  you  to  make 
what    are    by    common'-sense  standards 
implausible,  superfluous,  or  Incompatible 
assumptions.    After  f:.^  haVe  chosen  the 
best  answer,  blacken  the  corresponding 
space  on  the  answer  sheet. 

1.  Since  all  rabbits  that  I  have  seen 
have  short  tails,  all  rabbits  proba- 
bly have  short  tails. 

Which  of  the  following  most  closely 
parallels  the  kind  of  reasoning  used 
In  the  sentence  above? 

(A)  Since  all  chemical  reactions 
^     that    I   have   seen  have  been 

undramatic ,  probably  only 
minor  changes  took  place  in 
the  substances  involved. 

(B)  Since  all  the  human  social 
systems  that  I  have  heard  of 
have  sexual  laboon,  all  of 
these  sexual  taboos  have 
probably  had  survival  value 
for  the  human  race. 

(C)  Since  all  of  the  plays  of  Jovita 
Maldonado  that  I  have  seen 
feature  a  spruned  lover, 
probably  all  of  her  plsiys 
feature    this    character  type. 

(D)  Since  all  eating  utensils  that 
I  have  seen  are  made  of  metaf, 
metal  is  probably  the  most 
desirable  material  for  eating 
utensils. 

(E)  Since  sight  Is  the  most  Impor- 
tant of  human's  five  major 
sense ,  its  failure  probably 
seriously  affects  an  indivi- 
dual's aptlU^de  for  all  formal 
education. 
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The  given  statement  reflects  inductive 
reasoning,  that  is,  a  generalization  about 
an  entire  class  based  on  specific  observa- 
tions. The  conclusion  reached  could  be 
criticized  because  of  the  limited  number 
of  observations,  but  the  question  asks 
only  for  a  ^recognition*'  ox  a  parallel 
example  of  the  ^ame  kind  of  reasoning. 
The  question  is  quite  easy. 

AU  the  answer  choices  are  similar  in 
some  ways,  .but  only  one  is  a  statement 
about  specific  observations^  followed  by  a 
generalization  based  on  those  observa- 
tions. In  (A),  (B),  and  (D),  the  second 
part  of  the  statement  is  not  a  generaliza- 
tion based  on  the  observations  mentioned 
in  the  first  part  but  is  an  explanation  or 
suggested  reason  for  what  was  observed. 
In  (E)  an  assumption  is  followed  by  a 
conclusion.  Only  (C)  refers  to  specific 
observations  (about  some  of  Maldonado's 
plays)  and  proceeds  to  generalize  (about 
all  of  Maldonado's  plays)  on  the  basis  of 
those  observations,  however  limited  they 
may  be.  Therefore  (C)  is  the  credited 
answer . 

2.  A  good  hotel  can  give  you  a  beauti- 
ful room  for  $30  a  dty,  with  three 
meals,  a'^d  make  a  profit  and  pay 
taxes.  And  yet  a  taxj*exempt 
hospital  operates  in  the  red  for  $65 
a  day.  X  say  it  must  be  bad  admini- 
stration. The  author's  argument 
would  be  considerably  weakened  if 
attention  were  drawn  to  the  fact 
that: 

% 

( A )  hotel  managers  receive  better 
training  than  do  hospital 
administrators 

(B)  the  quality  of  food  served  by 
hotels  exceeds  that  of  food 
served  in  hospitals 

(C)  hospitals  are  run  by  dishonest 
administrators  ^ 

(D)  hospitals  provide  other  ser- 
vices  besides   room  and  board 

(E)  hospitals  deficits  are  a  recent 
phenomenon 
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This  very  easy  question  focuses  on  the 
reasonablcnc&s  of  drawing  a  conclu|}on 
from  the  ^  evidence  prescnicd.  The 
author's  contention  is  based  on  some 
evidence— the  discrepancy  between  a 
hotel's  and  a  hospital's  ^  operation  ex- 
penses. The  question  asks  you  to  identi- 
fy additional  evidence  that  would  weaken 
the  argument  that  bad  administration  is 
responsible  for  the  discrepancy  in  ex- 
penses. (A)  and  (B)  cannot  be  that 
evidence  because  these  choices,  if  true, 
would  actually  strengthen  the  author  s 
argument.  (C)  is  slightly  altered  version 
of  the  a^jthor'stown  statement  of  a  reason 
fdl-  the  discrepancy.  IE)  coftld.  weaken 
the  argument,  but  only  If  more  Infojrma- 
^  lion  were  given.  Only  (D)  pr^-^ldcs 
evidence  that  cast^  doubt  on  the  argu- 
ment. If  hospitals  provide  J^rvlccs 
other  than  those  mentioned,  then  the 
costs  of  those  services  rather  than  bad 
administration  are  likely  tp  be  the  reason 
for  the  difference  between  hotel  and 
hospital  expenses.  Therefore  (0)  Is  the 
credited  answer.  ' 


Questions  V4  refer  to  missing  portions 
of  the  following  passage,  /o"-^*;*^;^ 
question,  choose  the  completion  that  is 
best  according  to  the  context  of  the 
«  passage. 

If.  a  hpok  dl;(gusted  everyone,  no  one  , 
would  read  it.  However,  one  can  be 
sure  of  selling  many  copies  of  a  book 
that  Is  publicly  proclaimed  obscene,  tor 
ihe  officially  held  standards 'of  propriety 
do  not  prevail  throughout  the  commu- 
nity. At  this  point  I  may  be  expected  to 
denounce  the  hypocrisy  of  the  age.  i 
•hall  not  do  so.  The  concept 'of  hypo-  , 
crlsy  applies  to  morals:  a  person  should 
be  good  and  not  rrcrdy  seem  so,  and  a 
bad  per-feon  Is  little  mended  by  pretense 
of  goodness.  But  propriety  Is  altogether 
a  matter  of  how  actions  appear,  so  that 
3.    If  a  person  seems  to  give  no  offense. 

L  gives  no  offense.  Why,/hen,  should 
a  society  not  hz^  public  standards  of 
propriety  different  from  those  applied  by^ 


each  citizen  to  his  own  private  conduct? 
U  would  be  no  more  absurd  to  advertise 
f:ithy  movies  by  decorous  posters  lhan  It 
Is  to  advertise  decorous  movies  by  filthy  ^ 
posters:  and  If  a  society  In  which  every- 
one avidly  reads  pornography  were  to 
forbid  Its,  public  sale,  that  would  mean 
only  that  It  combined  a  taste  for  such 
readlrfg  with  a  taste  for  4^. 

3.      (A)   bad   men  ^ rarely  Wcoede^l.  in 
appearing  good 
(B)    the  concept  of  hypocrisy  does 

-    not  apply 
(O*  actions'    appear     different  to 
'observers  with  different  stan-» 
.  dards 

(D)  the  Issue   is  basically  a  moral 

(E)  the  concepts  of  impropriety 
and  Immorality  are  Indistin- 
guishable 

Both  this  question  and  the  next  reqnlre  • 
that   you    follow  the   author's  reasoning 
well  enough   to  fill  in  missing  mai^-rlal. 
The  first  question  focuses  on  the  distinc- 
lion    thaf    the    author    makes  between 
l^?allty    and    propriety.      The  author 
suggests  that  proprletv,  unlike  morality.  • 
Is  entirely  a  matter   of  appearance  and 
has  nothing  to  do  with  what  is  rc«lly 
good  or  bad.     Because  the  autlior  con- , 
trasts  morality  and  propriety,   (0)  and 
(E)  can  be  eliminated.    (0)  as&umes  that 
proprlott  Is     moral  Issue.    (P^)  sugRe^ts, 
that  i?riproprlcty  and  Immorality  (and  by 
inference    propriety  and- 
indistinguishable.  Since  "bad"  and  "^ood 
in   (A)   refers  ■  t«  -iiorality,  (A)  ifoe^i  not 
follow    from   the   author's   idea  on  pro- 
prletv*     (C)    is  an  appealing  answer, 
since    it    focuses   on    the   way  action<i 
appear    In   public.     But    (^0    docs  not 
fillow  from  the  words  "so  that,"  le,uling 
from     the    first    clause    (-propriety  Is 
altogether  a  matter   of  how  actions  ap- 
pear-) to  the  second  clause.    Only  (B) 
Is  an  acceptable  answer.  It  follows  from 
ihe    author's    distinction    betwoon  pro- 
priety and  morality  because  It  states  that 
hypocrisy  (associated  with  i^e  concept  ot 
morality)  does  not  apply  to  the  question 
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of  propriety.    This  question  is  lilfficult. 

4,      (A)  obscenity 

(B)  hypocrisy  < 

^  (C)  oppression 

(D)  good  af-t 

,  (E)  decorum  ^ 

_The  answer  to  this  v/jry  difficult  ^uej- 
tion  must  ^  m^t  two  requirements.  It  * 
must  dsscribtf  something  that  Is  consis- 
tent, ^in  the  context  of  ihc  author's 
*  discussion,  'with  the  reading  of  {Jornb- 
^  graphy.  It  must  also  explain  the  para- 
dpx»  described  in  the  "J^eceding  linrsi  of 
a/ society  in  which  pornography  is  .read 
^ithpugh  public  sales  of^  pornography  is 
forbidden . ,  The  sense'  of  the  author's 
argument  is  that  it  1^^  possible  not  to  cali 


such  a  society  hypocritical  (lines  4-S) . 
Thereffre-  (B)  a  Is  a  poor  choice.  (A), 
"^obscenity  is  ^  Jlerm  similar  It)  "porno- 
graphy" and  does  not  suggest  any 
contrast  that  could  explain  the  paradox. 
"Oppression*  and  "good  art,*  though 
relevant  in  general  to  the  topic  of  porno- 
graphy*  are  «ot  relevant  tqlhe  author's 
discussion  h^re.  Thus  (C)  *nd  JD,)  can 
be  eliminated.  (E) ,  "decorum,"  a  Syno- 
nym of  "pVbpriety ,"  does  fit  into  the 
context.  It  explains*^  the  contrast  be- 
tween privately  reading  pornography  and 
publicly  banning  it.  according  lo  the 
author's  view  thai  propriety  has  to  do 
with  public  aQpearanvC  only  and  not  with 
private  actions.  Thus  (E)  is  the  cre- 
dited answer. 


Mr.' Weiss.  Thank  yoii,  Mn  Zimmer.  "     ,  ^ 

1  Mr.  Erdahl?  ^  .  .  • 

Sir.  Erdahl.  Thank  you  V3ry  much,  Mr.  Chairman.  . 

Thanks  to  both  of  you  for  what  \  thi^nk  has 'been*  an  especially 
reasonable  and  studied  approach,  almost  codicil iatory,  we  might 
say.  *       ^  !     .  • 

We  heard,  Mr.  Zimmer,  you  are  telling  us  go  slow  and  see  What 
happens  in  the  New  York  experience.  ^ 

Dr.^  Hanford,  would  that  be  your  similar  ^dvice? 

Mr.  Hanford.  Yes,  Sjr,  it  wodW.'      ^  '    . .  ^ 

J  Mr.  Erdahl. 'Also,  as  we  look  and  read  an(f  listen  to  the  testimo- 
ny of  both  of  you,  it  seems  apparent  that  you .  are  Uhderscoririg 
what  others  have  told  us  today  and  in  past  times,  that  some  type  of 
selection  process  is  bound  io  be  used,  the  exact  alternative  or  com- 
f  plete  opposite  alternative  would  be  to  put  everybody's  name. in  *a 
hat  and  draw  out  a  number. 

But  I  gather  from  what  both  of  you  have  said  that  these  tests  ^re  " 
a  supplement  to  other  things  that  go  int<fthe  selection.of  a  student, 
not  so  much  to  help  the  institution  to  select  students  that  might 
have  an  ability  to  succeed  and  achieve,  but  it  alsa  seems  to  me  that 
the  tests  are  a  very  valid  tool  that  identify  Supplicants,  and  that  stu* 
dents  can  vise  to  determine,  if  they  should  go  to  St.  Olaf  College  or 
to  the  University  of  Minnesota.  , 

Can  you  comment  on  that?  We  have  often  approached  this  from 
ho\y  they  are  used  by  the  institutions  and  by  the  testing  agencies, 
but  could  each  of  you  elaborate  a  bit  as  you  see  the  use  of  tests  for 
students?  ^ 

Mr.  IIanford.  I  mentioned  in  my  comments  that, when  I  joined 
the  board  students  were  not  allowed  to  know  their  scores.  That  de- 
cision was  reversed  by  the  members  of  the  board  in  1957,  and  the 
minute  we  began  making  the  test  scores  available,  we  committed 
ourselves  to  a  process  of  guidance  in  connection  with  college  admis- 
sions. \ 

We  developed  the  preliminary  scholastic  aptitude  test  as  a  guid- 
ance tool  for  young  people  to  use.  Sure,  practice  before  you  take 
the  SAT  test  for  real. 

O  „think  you  will  find,Jumping  ahead  25  years,  in  our  most  recent 
ERIC^^ture,  that  tl  ^  college  ad  mission^' process  is  no  longer  as  com- 
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petitive  a  process  that  it  was  some  >o<\rs  c^go,  that  it  is  more  a  • 
matching  process  and  that  new  testing  progranis,  and  new  services 
that  we  are  trying  to  develop,  are  as  much  if  not  more  to  help 
J^^rP^ple  makt  decisions  about  their  higher  education  opportu- 
nities than  to  help  institutions  make  choices  .among  candidates. 
There  aren't  very  many  of  them  that  have  that  opportunity.. 

iVU,  Erdahl.  Thank  you.  ,      .  . 

MI  ZiMMER.  There  is  a  slightly  different  coloration  in  our  case 
because  of  the  fact  that  law  school  admission  remains  intensely 
competitive,  only  slightly  more  than  60  percent  of  those  persons  ap- 
plying to  the  ABA  credited  law  schools  last  year  were  admitted 

I  think  that,  so  that  our  test  has  rather  moie  force  in  the  fair 
allocation  of  those  places  than  it  has  in  the  guidance  of  niaiw 
people.  I  think  it  helps  people,  particularly  at  the  margins,  develop- 
ing disadvantagSJKpeople  in  particular.     .    ,    .     .    ,  ,      .  •  » 

That  is  the  greatest  use  as  a  diagnostic  device  in  determining 
readiness  for  legal  study,  but  for  very  many  of  our  people  if  is  oper- 
ating far  above  the  threshold  of  minimum  competence,  so  it  is  help- 
ing the  individuals  select  a  law  school  at  which  they  would  do  best 
and  it  is  helping  iiU  of  the  law  school?  to  allocate  their  places  in  . 

''^M^'erdIh?  Thank  you  very  much  and  again  th9nks  for  some 
very  well  thought  out  testimony.  '  . 

Thank  you,  Mr.  Chairman.  \  ^  . . 

Mr  Weiss.  Mr.  Zimmer,'  let  me  see  if  \/e  can\follow  up  a  ittle  bit 
on  the  last  question  Mr.  Erdahl  asked,  that  in  ihis  context  of  con- 
tSiued  competitiveness  for  positions  within  th\  law  schopls,  the 
Law  School  Admissions  Council  has  decided  that'the  validity  of  its 
tests  would,  not' be  compromised  by  full  total  disclosure;  is  that 

M?  Zimmer.  Idon't  think  we  can  know  that  in  advance.  I  think 
that  this  is  a  situation  not  free  bf  ambiguity.  It  is  a  question  of 
trading  off  values  in  a  rather  complex  way.  We  as  lawyers  and  per-  i 
sons  who  are  primarily  consumers  of  tests  have  had  a  great  deal 
iSwsted  in  our  own  value  structure  in  the  concept  of  openness  and 

''?lr?rrr£|rveS^^^^^^^^  our  te.^  developers  ar, 

doing  what  they  can  to  assure  that  there  won't  bo  a  coftipromise  in 
Jalldity,  but  I  ^on't-know  th^^t  I  would  tell  you  that  jf  I  though  ■ 
there  was  a  compromise  of  one  or  two  numbers  in  the  hundreds  or 
tSou'rds  places,  that  I  wouldn't  be  willing  to  '"ake  that  tradeoff 

Mr  Weiss.  The  decision  th^t  you  have  made,  that  ife,  the  council 
has  made,  is  to  disclose  automatically  now  the  test  results  and  he 
que^ions  to  all  those  who  take  the  law  school  adniission  test;  is  ■ 
that  .right?  .       ,  .  ■ 

Mt".  Zimmer.  Yes,  sir.    -  '  *  > 

Mr,  Weiss.  So  that  when  you  are  saying  wait  and  see,  you  your- 
selves have  in  fact  gone  beyond  the  waiting  and  the  seeing,  you 
have  come  to  a  judgment  and  are  following  through  on  action  on^ 
that  iudgment  and  making  full  disclosures.'  ,  .  ,  ,  ,  r  ^u• 
.  Mr.  Ser.  In  our  program  ^Ith  proven  high  demands  for  this 
service  much  of  the  derision  is  a  practical  business  decision,  that 
to  rospoS  to  and  answer  orders  from  60  percent  of  tne  people  u, 
Sr  example,  more  costly  than  simply  to  send  it  out  automatically, 
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so  at  a  certain  level  there  is  a  simple  business  judgment,  a  test  of 
the  marketplace  in  our  area  which  has  shown  that  law  school  ap- 
plicants in  a  competitive  environment  want  this  service  has  led  us 
to  make  that  decision. 

Mr.  Weiss.  Dr.  Hanford,  you  have  indicated  that  you  have  had  a 
feedback  of  only  3  percent  of  those  who  take  the  SAT  or  took  it 
this  past  year  asking  for  their  test  results.  j 

Mr.  Hanford.  That  was' the  average  in  1981,  yes. 

Mr.  Weiss.  Right;  now,  I  understand,  and  you  two  gentlemen  cor- 
rect me  if  I  am  wrong,  that  there  is  a  difference  in  the  form,  the 
method  of  request  for  disclosure,  between  the  LSAT's  and  the 
SATs.  . 

Would  you  each  explain  how  a  person  has  to  request  their  test 
results  and  the  questions? 

Mr.  ZiMMER.  There  is  no  request  necessary.  It  is  an  automatic 
part  of  our  service. 

Last  year  it  was  a  part  of  our  registration  form,  a  person  could 
di&slgnate  the  request  for  this  service  by  checking  a  box  on  the  ap- 
plication form  and  paying  the  fee. 

Mr.  Hankord.  In  our  program  we  have  a  National  Bulletin  that 
goes  to  all  students  to  register  for  the  SAT,  and  it  has  at  the 
bottom  special  information  for  students  who  plan  to  register  in 
New  York. 

We  have  to  have  a  special  section  because  of  the  particular  re- 
quirements of  the  La  Valle  Act,  in  any  event.  There  is  a  form 
which  is  right  here  which  is  no  more  complicated  to  fill  out  than 
the  registration  form  itself,  right  next  to  the  envelope  in  which  you 
send  it  with  a  description  of  the  procedures  for  requesting  your 
SAT  questions. 

The  law  schools  last  year  had  a  checkoff;  this  year  it  is  automat- 
ic. Ours  is  a  form  that  the  student  has  to  write  his  or  her  name 
and  address  and  submit  it. 

Mr.  Weiss.  A  separate  form? 

Mr.  Hanford.  A  separate  form,  right. 

Mr.  Weiss.  It  doesn  t  go  in  the  same  envelope  as  the  registration? 
Mr.  Hanford.  Right  here;  the  same. 

Mr.  Weiss.  Is  it  the  same  envelope  in  which  the  person  files  the 
registration?  -  ^ 

Mr.  Hanford.  It  can  be;  it  doesn't  have  to  be. 

Mr.  WeisS;  Is  there  a  box  on  the  envelope  which  says  check  this 
off  if  you  want  your  test  results? 

Mr.  Hanford.  No. 

Mr.  Weiss.  Has  any  thought  been  given  to  making  it  really 
simple  for  an  applicant  to  check  off  a  box? 

Mr.  Hanford.  We  thought  very  seriously  about  it.  We  felt  it  was 
jmporcant  to  test  the  demand. 

Second,  we  still  question  the  educational  value  of.disclosure.  One 
of  the  telling  comments  made  to  me  by  Senator  La  Valle  in  talking 
about  his  son  who  wasn't  much  interested  in  the  law  until  he  took 
the  tests,  and  when  the  scores  came  he  was  kind  of  curious  as  to 
where  he  had  gone  wrong.  For  .that  reason,  if  someone  wants  to 
know  where  they  made  a  mistake,  this  kind  of  service  is  available, 
but  we  didn't  feel  that  it  was^educationally  sound. 
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We  still  don't  believe  disclosure  is  educationally  useful.  For  that 
reason  we  felt  it  was  perfectly  appropriate. 

Mr.  Weiss.  Are  you  trying  to  discourage  people  from  asking;^ 

Mr.  Hankord.  No.  sir;  I  do  not  think  you  will  find  this  format 
and  procedure  discouraging.  I  think  any  young  student  in  New 
York  today  is  aware  from  the  bulletin,  from  the  press,  from  a  gmd- 
nnce  counselor,  that  this  service  is  available.  There  is  a  real  differ- 
ence, between  our  situation  and  the  law  schools.  QAT 

By  the  time  the  young  person  sits  down  to  take  the  &Ai  tnat 
young  person  has  probably  had  a  chance  take  what  we  call  the 
PSAT  which -is  a  pract  ce  test  for  taking  the  SAT  Then  they  re- 
'Sv^  ''Taking  the  SAT"  and  then  they  take  the  SAT  itself  So  they 
have  three  bracks  at  a  test  like  the  SAT  and  I  think  that  3  percent 
;<;*  nrobablv  a  reasonable  measure  of  the  demand. 

Mr  wl^sriut  you  don't  really  want  to  find  out  for  sure  by 
making  it  very  simple  for  them  to  ask.  , ,  .  j 

mJ  Hanford.  We  don't  think  at  this  point  that  would  be  educa- 

Mr^Eiss"  Well,  I  must  tell  you,  I  am  impressed  and  at  the  same 
time  sort  of  disappointed  by  ETS  and  the  College  Board  I  think 
hat  it  is  true  that  the  College  Board  and  the  Educational  Testing 
Service  people  have  come  a  long,  long  way  m  a  very  few  short 
vears  and  that  is  because  for  being  proud  on  your  part  that  you 
are  resJSnsive  to  what  American  society  seems  to  be  asKing  of  you. 

M  the  same  time.  I  think  that  your  attitude  this  particular 
instance  sort  of  typifies  how  you  came  to  the  PO>"t  whiQl?  yea 
are  so  proud- now,  you  came  more  or  less  being  dragged  by  your 
heels  when  in  fact,  you  had  no  choice  anymore,  you  said  UK,  you 
will  do  it  and  that  seems  to  be  what  you  are  doing  at  this  Pomt  and 
in  a  couple  of  years  you  will  probably  come  around  to  at  least 
making  it  simple  for  people  to  ask  for  their  forms  and  take  great 
^ddeTn  the  Set  that  you  are  doing  it,  even  though  you  are  commg 
to  it  with  the  most  extreme  reluctance,  and  I  don  t  understand 
why  because  it  undercuts  some  of  the  very  major  accomplishments 
that'you  have  achieved  in  the  last  couple  of  years. 

You  may  comment  on  that  but  that  is  the  way  it  seems  to  me 
sitting  on- this  side  of  the  table.  .        m-  runir 

Mr  Hankord.  It's  a  very  honest  difference  of  opinion  Mr,  Chair- 
man We  feel  we  have  made  an  honest  effort  here;  still  don  t  be- 
Ueve  that  anybody  can  say  we  have  been  trying  to  hide  anything.  I 
hhfk  3  percent  a  perfectly  reasonable  response  a  good  measure 
of  interest  on  the  part  of  the  students,  for  reasons  I  have  suggested 
and  all  the  more  reason  not  to  try  to  con  some  kids  into  buying  a 
service  they  don't  really  nead  or  want  by  providing  a  checkoll. 

Mr  Weiss,  bo  vou  have  any  information  on  any  of  the  other 
postsecondary  institutions  admissions  tests,  higher  education  insti- 
tutions admissions  test  results  on  any  of  the  graduate  schools? 

Mr  fIanford.  The  College  Board  is  responsible  and  concerned 
on^  with  the  tests  for  undergraduates.  While  I"  know  something 
about  the  others  I  .should  not  comment.  It  would  be  inappropriate. 

Mr  WE.S  OK.  Are  you  familiar  at  all  with  what  the  Amencan 
Council  on  Testing  has  been  doing  and  how  at  all  does  that  fit  m. 
with  any  of  your  programs  as  far  as  their  disclosure  policies  are 
concerned? 
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Mr.  Hanford.  The  American  College  Testing  program? 

Mr.  Weiss.  I  am  sorry. 

Mr.  Hanford.  I  am  really  unfamiliar. 

Mr.  Weiss.  Information  that  we  have  is  that  in  fact  they  have  up 
to  this  point  refused  to  disclose  at  all,  and  in  essence  it  is  part  of 
the  problem  that  we  face  in  a  situation  where  some  of  the  testing 
companies  have  gone  forward  at  least  a  significant  portion  of  the 
way  and  then  they  say,  well,  wait  and  see  when  in  fact  there  are 
still  large  portions  of  our  set  out  there  which  have  tests  adminis- 
tered by  other  people  where  there  is  no  disclosure. 

Mr.  Hanford.  You  point  to  another  interesting  difference  be- 
tween the  law  school  circumstance  and  the  College  Board  circum- 
stance which  is  that  people  occasionally  tend  to  think  of  the  Col- 
lege Board  or  Educational  Testing  Service  as  a  monoply,  and  we  do 
have  competition. 

Mr.  Weiss.  Limited  though  it  may  be. 

Mr.  ZiMMER.  We  are  for  openness  but  we  don't  tolerate^competi- 
tion. 

Mr.  Weiss.  I  gather,  Mr.  Hanford,  that  there  has  been  some 
change  now  in  the  attitude  of  the  College  Board  as  to  the  effective- 
ness, if  not  desirability,  of  coaching,  of  preparation  schools. 

Could  you  comment  on  that? 

Mr.  Hanford.  I  would  like  to  associate  myself  with  the  com- 
ments that  Dr.  Johnson  made  earlier.  I  tend  to  put  it  in  my  own 
context.  It  all  depends  on  how  you  define  coaching  on  the  one  hand 
and  instruction  on  the  other,  and  the  problem  gets  to  be  a  semantic 
one  in  the  middle. 

When  does  coaching,  cramming,  drill  on  item  types  stop  being 
cramming  and  coaching  and  when  does  it  become  good  instruction? 

Our  statements  over  the  years,  I  think,  have  been  consistent  if 
one  takes  the  very  narrow  definition  as  we  always  did  of  coaching, 
as  the  drill  practice  and  so  forth  on  test  items. 

You  called  attention  in  your  comments  to  the  FTC  study.  I  would 
invite  the  committee  to  read  very  carefully  the  caveats  and  demur- 
rers that  accompany  both  the  initial  report  and  the  subsequent  one 
that  was  just  recently  released,  because  they  do  suggest  that  there 
are  problems  having  *^o  do  with  the  nature  of  the  technical  quality 
of  the  research,  and  with  what  is  known  as  the  self-selection  factor. 

The  young  people  who  go  to  commercial  coaching  schools  tend  to 
be  students  who  are  highly  motivated  perhaps  and  so  please  read 
carefully  the  demurrers  that  are  at  the  beginning  that  cover  the 
release  of  the  latest  FTC  study. 

We  still  bflieve  that  what  we  do  for  young  people  in  getting 
ready  for  the  PSAT  and  taking  the  SAT  is  all  that  young  people 
really  need  to  get  themselves  familiar  with  that  type  of  instru- 
ment, that  commercial  coaching  that  emphasizes  simply  drill  and 
so  forth  really  does  not  work. 

But  when  you  get  over  toward  the  other  end  of  ihe  spectrum  to 
studies  that  go  on  for  a  year's  time  you  may  have  something  else. 
After  all,  seniors  do  better  than  juniors  on  the  SAT,  and  we  expect 
them  to  because  we  expect  tHe  SAT  scores  to  be  influenced  by  edu- 
cation. That  is  what  it  is  supposed  to  measure. 

Mr.  Weiss.  Of  Qourse,  as  you  know,  part  of  the  criticism  that  has 
been  directed  at  testing  agencies  was  that  by  creating  the  impres- 
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sion  oerLaos  unintended,  that  you  could  not  really  study  for  the 
sS'ftharthe  people  felt  in  fact  it  did  not  test  what  they  were 

ItTested  some,  vague  undefinable  aptitude,  if  you  will. 

Mr  Hanford  One  of  the  things  .that  is  happening  in  the  psycho- 
metrfc  worjj  and  I  should  say  to  you  both  that  I  don  t  have  that 
Tctor  in  front  and  my  training  was  in  business.  I  am  not  a  psy- 
chologist or  psychometrician,  but  I  know  a  little  no ^  ."^nhT 
S  a nd  I  think  we  have  tended  to  emphasize,  we  have  not jmpha- 
Szed  but  as  you  Suggested  the  context  in  which  we  thought  about 
fhp  tP=!f  has  misled  people  to  equate  it  with  the  old-fashioned  IQ, 
which  has  never  beeS  oSr  intention.  It  is  in  the  record  that  this  is 
^ot  whafwe'a're  talking  about.  Schooling  has  an  dTect  bu  I  think 
n  Pmnhasizine  that  cramming,  drill,  and  so  forth,  was  not  reaiiy 
goorelcl3andUmg  that  it  did  not  --k,  we  may  very  m 
vprtentlv  have  left  the  mpression  that  the  SAI  was  not  suscepume 
to  educadon  Bu  that  simply  could  not  be  the  fact  because,  again 
as  I  said,  seniors  always  have  done  better  than  juniors  because  it  is 

'wSs^'Sfo^Sr^pSfirthe  universe  we  are  discussing  that 
thfleeiSion  address  as  itself  to  is  not  simply  the  educational 
J.pLm<,  to  the  students  who  take  the  test,  but  of  improving  the  va- 

^"flm  wondering  whether  in  fact  the  College  Board  sees  merit  in 

its  work  product  than  if  it  were  subjected  to  ,'^eg";ffJ'^^'*lVf  ."J 
outside  experts  who  are  interested  in  the  whole  testing  world  and 

%7"B7uZointieLoe  that  I  draw  from  your  question  is 
Mr.  WANFORa  an  in'^r*^      secretive  about  the  tests  and  avoid- 
^Irfticism^o  the  SAT    nlaa  the^^^       been  a  policy  of  making 
co£  S  the  tests  aval  able  to  researchers  so  long  as  they  agreed  to 
maintain  the  security  of  the  tests  and  not  publish  items,  so  to 

'^U  has  not  been  a  matter  of  not  making  it  available  to  research- . 
the  people  he  wanted  to  have  review  them.  2°  I  b^ve  to  say  we 

sufveV  tKew  YoS^  commissioner  to  see  how  many  re- 

quests^ have  cle  from  researchers  to  review  the  materials  that 


have  been' filed  there. 
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I  think  you  would  find  that  it  is  surprisingly  few.  There  is  a  need 
here  to  focus  on  the  aptness  of  the  remedy  for  the  perceived  prob- 
lem. 

There  are  just  not  people  breaking  down  the  door  of  the  New 
York  commissioners  to  get  stuff  that  is  filed  there. 

Mr.  Weiss.  You  notice,  we  have  had  testimony  in  the  course  of 
the  2  years  during  which  we  havt  had  the  legislation  under  consid- 
eration, coming  from  people  with  knowledge  in  the  field,  as  to  the 
difficulties  they  have  had  in  getting  not  the  test  results  necessarily, 
but  the  in-house  studies  and  surveys  and  critiques. 

We  had  testimony  which  indicated  people  had  to  go  to  court  to 
try  to  get  some  information.  We  had  testimony  from  a  couple  of 
Harvard  psychologists  and  sociologists  in  a  panel  we  had  a  year 
ago  in  which  we  had  indications  that  the  ETS  had  in  fact  omitted 
certain  studies  from  some  of  its  conclusional  reports. 

We  have  Dr.  Burrow's  statement  as  to  the  difficulty  of  really  get- 
ting trustworthy  information  of  adequate  Supply.  So  there  seems  to 
be  sufficient  basis  for  our  concluding  that  the  people  in  the  field 
feel  less  than  happy  about  the  openness  of  ways  an  academic  field 
really  and  should,  in  fact,  be  subjected  to  the  rigorous  testing  and 
challenging  of  other  experts  within  that  field. 

I  don  t  know  what  there  is  to  be  lost  by  becoming  more  open  in 
that^rea. 

Mr.  Hanford.  Let  rjie  say  that  you  may  recall  our  chairman, 
Fred  Hargadon,  said  in  his  testimony  before  yoii  2  years  ago  that 
we  would  like  every  person  to  be  able  to  take  home  the  test  after 
their  administrations.  ,  . 

What  you  have  to  balance  off,  and  what  we  are  trying  to  do  is 
balance  off  questions  of  quality,  cost,  fairness,  and  convenience  for 
students. 

As  I  said,  if  we  have  to  disclose  more  than  five  SAT's,  given  the 
current  state  of  the  art,  and  the  current  availability  of  people,  we 
will  have  to  restrict  the  number  of  administrations  down  to  some- 
thing on  that  order. 

It  is  a  matter  of  training  people  to  write  items.  It  is  a  matter  of.  ^ 
pretesting  items;  it  is  a  matter  of  putting  the  forms  together.  These 
are  processes  that  take  time.  We  can't  do  this  overnight. 

I  just  don't  think  that  is  what  you  want  to  do,  to  restrict  the  op- 
portunity for  young  people  to  help  themselves  get  into  college. 

Mr.  Weiss.  Of  course  I  don't  and  nobody  here  does,  but  two 
things:  First,  Dr.  Irby,  who  is  in  the  audience,  was  good  enough  to 
invite  a  number  of  us  down  to  ETS  headquarters  outside  of  Prince- 
ton—I guess  about  1  year  or  IV2  years  ago— and  it  was  a  very  edu- 
cational and  informational  experience  for  all  of  us. 

One  of  the  things  that  I  learned  was  that  some  80  percent  of  the 
questions  that  anyone  in  the  administration  asked  we're,  in  fact, 
not  new  material. 

It  is  not  as  if  we  are  asking  people  to  ^tart  from  square  1.  They 
were  able  to  use  95-percent  old  material.  • 

The  second  thing  is  that  apart  from  the  benefit  and  the  role  of 
the  individual  students,  what  we  are  addressing  ourselves  to  in 
part  of  the  legislation  is  the  sharing,  the  openness,  if  you  will,  of 
information  that  goes  into  the  test  makeup,  the  test  validation,  the 
critiques  of  experiences  with  the  test^all  the  things  which  social 
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scientists  in  the  field  would  be  interested  in,  not  part  of  curiosity's 
sake  but  so  they  cl  make  the  field  of  testing  a  more  valid  and 
morp  reliable  and  more  accurate  one.  ,  ,  , 

Alafn  I  don"  understand  why  ETS  college  boards  have  been  so 
rpliiptant  to  orovide  that  kind  of  access.  -  i  .  ^ 

Mr  HANF^Ra  Mr.  Chairman.  I  insist  that  we  have  been  making 
studies  avaifable  about  the  SAT.  In  my  office,  we  have  what  we 
call  a  g?een  Bible  which  describes  the  niechanism  by  which  the 

'1T?^"al%'Sdt^l70"  We«       making  information 
availawl  Sarly  to  young  people,  to  colleges,  about  how  tes^ 
qhould  he  used,  that  they  should  not  be  used  alone,  that  tney 
be  used  with  other^riteria  in  the  administrations  process. 
Mr  Weiss  Do  you  object  to  it  being  used  as  a  cutoff 
Mr      NFORD  Not  exclusively;  no,  sir.  I  think  there  are  times  in 
our  society  when  it  is  necessary  to  use  gross  {^eanf  to  reduce  a 
large  pool  to  some  size.  But  in  most  cases,  I  would  certainly  not  tol- 

^'if  I  may  I  would  like  to  take  a  brief  minute  because  the  purposes 
as  set  forth  in  section  3  about  test  information-and  it  relates  to 
Mr  Simon's  ^aestions-that  I  just  want  to  cite  for  the  record  that 
we  will  respond  in  detail  to  his  concerns  and  questions  about  the  10 

''rsSrsaraSis  point  that  I  note  in  the  third  article  the  dis- 
tincSSi  made  between  tests  used  in  baccalaureate  and  postbacca- 
laureate  Emissions.  As  1  read  this,  I  am  not  sure  whether  you  are 
talking  about  success  in  careers  as  related  to  cne  &Ai . 

if  sfems  to  me-and  I  would  echo  indeed  Dr.  ^^^^fj^^l^^^- 
that  I  know  of  very  few  studies  in  which  success  iR  careers  has 

%"r"wl,ss'The  reason  that  is  in  there  is  because  a  number'  of 
thf  tesUnrcompanies  and  tests,  if  you  will,  in  .their  promotional 
-  materia  sfuggTst  or  state  to  the  would-be  test-taker  as  to  the  corre- 
S  the'Sve  and  affirmative  correlation,  between  the  results 
of  those  tesTs  and  how  they  will  do  either  in  school  or  how  they 

"  What"w?hLvrsaTin  here  is  that,  '.'OK  friend,  if  you  are  going 
to  make  that  kind  of  statement,  prove  it-  Show  it 

Mr  Hanford.  I  wanted  to  make  sure  it  did  not  relate  to  the  OAi 
because  it  would  not  seem  to  me  to  be  applicable. 

Tn  4(A)  I  lust  have  to  say  that  the  expression  of  predictions  as 
expressed  as^ a  percentage  is  not  usefuK  Wc  i.ave  encouraged  ins  i- 
.  tSfions  tS  try  to  have  a  validity  study  and  make  sure  that  they  put 
the  SAT- in  its  proper  balance  and  perspective.  I  would  say  the 

Tn'No"5^ft^say?;''the  test  agency  will  use  the  score"-I  must 
DO  St  out  that  we  don't  use  the  score.  Institutions  use  the  score. 
But  n  generS,  my  response  .o  your  questions  in  terms  of  section  3 
S  that  we  feel  we  have  been  doing  this  and  are  dping  it  now. 
"  Mr  WfVs  Wriook  forward  to  your  response  and  may  I  just  indi- 
cate'bot^  to  Sis'panel  and  to  tie  Previous  panel  that  we  wo^ld 
nppd  to  have  your  wr  tten  responses  in  to  us  within  10  days- /ne 
Record  will  be  kept  open  for  that  10-day  period  and  then  will  be 
closed  so  we  can  get  it  printed. 
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If  there  are  no  further  questions,  I  want  to  express  my  apprecia- 
tion on  behalf  of  both  of  the  subcomn\ittees  and  we  will  go  on  and 
we  will— we  are  again  appreciative  of  your  participation  in  the 
process. 

The  committee  stands  adjourned  until  tomorrow  morning  at  9:30. 
[Whereupon,  at  1.50  p.m.,  the  subcommittee  was  adjourned,  to  re- 
convene at  9:30  a.m.,  Wednesday,  July  22, 1981.] 
[Material  submitted  for  inclusion  in  the  record  follows:] 
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AUG  4 


MICHIGAN  STATE  UNIVERSITY 


CXMllCe  or  tDUCATlON 

DffAHTXCrt  or  COlASrilNC  ANO  EDCCATIONAI  WlfCHCtOCV 


tAST  t^sasG  •  MtCUICAV  •  4«i* 


July  27,  1981 


Mr.  Paul  Simon  ^  "  *^ 

Coflinittee  on  Education  and  Labor 
2181  Rayburn  House  Office  Building 
Washington,  DC  20515 

Dear  Mr.  Simon:  •» 

'  When  I  testified  on  July  21  on  H.R.  1662  you.asked  me  to  respond  to  Section 
3  of  that  bill  in  writing.   My  response  follows: 

Section  3(a)  (1)  and  (2) 

These  two  subsections  are  unnecessary  sinre  every  test  agency  already  pro- 
vides- such  materials. 

Section  3(a)  (3). 

The  first  part  of  this  section  is  unnecessary  since  such  data  are  already 
provided.   The  subsection  requesting  the  correlation  between  test  scores 
and  success  in  a  career  is  very  unwise.    Tests,  by  and  large,  are  not 
designed  to  predict  success  in  a  career.  They  are  designed  to  predict 
success  in  an  educational/training  program.   While  it  is  true  that  there 
is  an  empirical  relationship  between  admission  scores  and  success  in  a 
program  and  there  must  b*  some  logical  relationship  between  success  in  a 
training^program  and  success  in  a  career  (e.g.  knowledge  of  anatonomy  and 
success  as  a  physician),  it  is  extremely  difficult  to  empirically  show  a 
relationship  between  the  first  and  third  variables.   This  is  primarily 
due  to  the  difficulties  of  defining  and  measuring  career  success  le.g. 
income  does  not  define  success  aj  a  physician). 

Section  3(a)  (4)  (A) 

To  conmunicate  pre^liction  "expressed  as  a  Percentage"  is^  "5*^2^15^ l^III^?!!^"^' 
less  and  certainly  not  comprehensible  to  most  candidates.   A  good^example 
of  how  misleading-this  can  be  is  found  in  the  Nairn/Nader  report  (see  my 
critique  of'  this  report  appended  to  my  July  21  testimony). 

Section  3(a)  (4)  (B) 

This  information,  if  gathered,  would  be  misunderstood  by  maiv  people  Weiss 
himself  does  not  understand  the  meaning  of  such  data  (see  his  July  31,  197^ 
testimony)  and  he  has  been  Informed  many  times  of  its  meaning  in  previous 
testimony. 
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Mr.  Paul  Sinon 
July  27,  ^981 
Page  two 


Section  3(a)  (4)  (C) 

No  one  really  knows  this  and,  if  so,  one  certainly  would  not  ititerpret 
it  as  a  percentage! 

Section  3(a)  (S) 

The  test  agencies  provide  data  to  colleges  where  the  data  get  used.  A 
test  agency  simply  does  not  know  how  every  college  will  use  the  data. 

Section  3(a)  (6)^_to  3(a)  (9)  ^ 

These  sections  are  not  terribly  bad  nor  at  all  necessary. 

Since  I  don't  feel  the  section  5(a)  (2)  is  advisable,  I  can't  approve  of 
this  section  either. 


Obviously  I  am  opposed  to  Section  3  just  as  I  am  to  other  sections  of  the 
bill.  It 'simply  does  not  appear  to  be  written  by  a  person  with  aryy  expertise 
in  measurement. 

Thank  you  for  requesting  the  above  corments. 

Sincerely, 


WM:cd 


William  KehrenS 
Professor 

Measurenxjnt  and  Evaluation 
462  Erickson  Hall 
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I The  College  Board 
(2!2)S»2-62JO 


<ync*o*^f^*0'^<i«r^     '  July  31  ^  1981 


Honorable  C^rl  0.  Perkins 
Chalnnan 

Subcomnlttee  on  Elementary,  Secondary 
and  Vocational  Educatlwj  .  _  . 

Committee  on  Education  arid  Labor 
U   S.  House  of  Representatives 

Washington,  D,C.    20515  ^ 

Honorable  Paul  Simon 

Chairman  .      .-j    *i  « 

Subconroi ttee  on  Postsecondary  Education 

Conroittee  on  Education  and  Labor 

U.  S.  House  of  RepresenUtlves 

Washington,  D.C.  20515 

Dear  Sirs;  v        -  * 

I  waat  to  thank  you  for  the  opportunity  to  testify  before  your  subcorrmit- 

tees  last  week  on  HR  1662,  the  Educational  Testing  Act  of  1981. 

During  the  course  of  the  testimony,  Mr.  Simon  requested  that  witnesses 
later  submit  conments  for  the  record  on  the  provisions  of  Section  3  of 
HR  1662  which^cifies  the  information  test  agencies  would-be  required 
to  orovide  to  test  takers  and  to  educational  institutions.   Our  corrn«ntary 
\n  rJ?Jonse  to  this  request  is  enclosed,  indicating  which  types  of  infor- 
mStiSn?he  College  Boa?d  now  provides  and  in  what  form  and  noting  where 
^elr^qSirem^nUof  Section  3  would  be  impractical  or  inappropriate  with 
respect  to  the  SAT  and  other  tests  we  sponsor. 

The  enclosed  supplemental  statement  also  clarifies  our  answer  to  a  ques- 
[?on  raised  durilig  the  hearing  by  R^Pr^^ntat  ve  W^^"/^,^,  J^JI^f  ,,3. 
College  Board's  procedures  for  enabling  students  to  see  their  test  ques 
tions  and  answers. 

I  am  by  copy  of  this  letter  providing  the  same  supplemental  materials  to 
Mr.  Weiss  for  his  information. 

I  hope  this  additional  infonnation  is  helpful.  Please  let  me  knoWMf  the 
College  Board  might  be  of  further  assistance.'- 


GHH/dce 
Enclosures 
cc:   Rep.  Ted  Weiss 
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Suppioirental  Statement  for  the  Record*" 
^  The  College^Board 

Cottroents  on  Section  3  of  n.R,  1662        *  o 

H.R.  1662  would  require  test  agencies  to  provide  certain  information  to 
test-takers  and  to  educational  institutions  that  receive  test  scores.  Section 
3(a)  of  the  bill  specifies  the  types  of,information  which  each  test  agency 
would  be  required  to  "provide  to  any  test  subject  in  clear  and  easily  under- 
standable^ anguage,  along  with  the  registration  form  for  a  tes't\..r**  Section 
3(b)  requires  that  the  same  information  be  provided  to  any  institution  "prior 
to  or  coincident  with  the  first  reporting  of  a  test  score  or  scores"  ^for  a 
test  to  the  institution.    Section  3(c)  requires  test  agencies  to  notify 
students  and  institutions  "if  the  test  subject's  score  is  delayed  ten  calendar 
days'*  beyond  the  date  it  is  due  to  be  mailed.  ^  ^ 

H.R.  1662  would  apply  to  three  testing  programs  sponsored  by  the  College 
Board—the  Scholastic  Aptitude  Test  (SAT),  the  Achievement  Tests,  and  the 
Preliminary  Scholastic  Aptitude  Test/Natipnal  Merit  Scholarship  Qualifying 
Test  {PSAT/N^5SQT).    The  results  of  the  SAT  and  Achieveinent  Tests  are  used 
by  colleges  and  universities  as  part  of  the  admissions  process  for  undergraduate 
programs.    The  PSAT/fiMSQT  is  a  guidance  instrument  that  helps  high-school  juniors 
make  plans  for  college  and  prepare  for  taking  the  SAT,  it  is  also  used  as  the 
qualifying  test  for  students  who  wish  to  participate  in  the  scholarship 
competition  conducted  by  the  National  Merit  Scholarship  Corporation. 

^he  College  Board  now  publishes  and  widely  distributes  naterials  con- 
taining mosit  of  the'  information  specified  in  Section  3  of  H.R.  1662.  Copies 
of  most  of  these  publications  have  already  been  submitted  to  the  'subcomnittees; 
another  set  is  enclosed  with  this  statement. 

hearings  on  H.R.  1662,  the  Educational  Testing  Act  of  1981,  before  the 
Subcormittees  on  Elementary,  Secondary  and  Vocational  Education  and 
Postsecondary  Education,  July  21-22,  1981 
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These  regular  program  publications  cover  the  purposes  and  content 

of  the  tests,  score  reporting  procedures,  infonnation  to  aid  in  score 

interpretation,  confidentiality  of  data,  and  description  of  special 

arrangements  for  handicapped  students.    Thus,  information  that  would  be 

required  by  Subsection  3(a)  paragraphs  1,2,3,6,8,  and  9  is  incorporated 

in  College  Board  materials  provided  routinely  to  test  takers  as  well  as 

♦  f 
test  users  (institutions).    Information  is  also  provided  about  the 

College  Board's  voluntary  question-and-answer  disclosure  service, 

privacy  of  TesricorS7"aMTtn?-^vd44^bi^  for  appeal 

of-  review  of  a  test  score  [Section  3(a)(l0)3.    In  addition,  theToTTegT  ~- 

Board  already  follows  the  procedures  that  include  notification  of  delays 

m  score  reporting  to  test  candidates  and  institutions  as  would  be  required 

by  Section  3tc).  <* 

Not  all  of  thCi publications  containing  this  information,  however,  are 
provided  to  test  Candida ta?  along  with  registration  forms.    (In  fact, 
for  the  PSAT/NMSQT  there  is  no  student  reai strati  on  form,  since  the  answer 
sheet  completed  at  the  time  of  testing  gathers  the  necessary  information 
from  individuals.    School  officials  merely  order  the  number  of  tests  they 
will  need  to-  satisfy  the  demand  from  interested  students  in  their  schools.) 
College  Board  practice  has  been  to  provide  information  at  the  time  it  is 
most  likely  to  be  useful  to  and  of  interest  to  test  candidates:  some  before 
the  test  is  given,  soir«  at  the  test  administration,  and  some  when  scores 
are  sen-  to  students.    H.R.  1662  would  restrict  the  College  Board's  ability 
to  continue  to  provide  information  in  the  most  timely  manner  throughout  the 
entire  testing  process. 

Another  general  concern  we  have  about  Section  3  is  simply  practical. 
While  there  is  no  reason  test  candidates  should  not  have  access  to  any 
available  material  about  College  Board  tests,  a  requirement  that  all  of  ' 
it  be  included  in  program  publications  (".. .along  with  the  registration 
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fom  for  a  test...")  creates  <s  problem  of  size  and  volume.    The  main 
registration  booklet  for  the  SAT  and  Achieverrtint  Tests,  the  Student  Bul.1etin, 
already  attempts  to  convey  a  large  amount  of  procedural,  theoretical  and 
background  information.    The  current  edition  contains  15  pages  of  text  as 
well  as  15  pages  of  regional  codes  for  reference.   We  have  found  that  many 
test  takers— the  overwhelming  majority  of  whom  are  high-school  students  — 
have  sone  trouble  reading  through,  let  alone  fully  understanding,  all  of 
the  material  provided  m  this  publication.    A  law  of  diminishing  returns 
tends  to  operate:  the  more  information  the  Board  must  incorporate  in  the 
text,  especially  infonration*  of^a  technical,  legal,  or  excessively  detailed 
nature,  the  less  likely  students  will  be  to  grasp  it  fully  and  the*  less 
inclined  (hey  will  be  to  try.    (A  student  intern  wh?o  has  spent  the  summer 
reviewinq  our  publications  has  reached  the  same  conclusion  and  has  corroberated 
our  STJft^tLlnat  more  is  not  always  better.) 

The  College  Board*s  goal  is  to  explain  tests  to  students  as  clearly, 
comprehensively,  and  concisely  as  possible.   We  con.tinually  review  and  revise 
our  publications  to  try  and  make  them  more  relevant  and  useful.    Some  of 
the  requirements  under  paragraphs  5  and  7  of  Section  3(a)  of  H.R.  1662  are 
examples  of  information  that  we  do  not  currently  provide,  exactly  as  specified, 
t^  all  test  takers. 

Although  the  College  Board  already  doas  or  could  comply  at  least  ii^ 
spirit  with  most  of  the  provisions  of  Section  3,  the  requiremenU  of  3(a)(4) 
would  be  especially  problematic  and  their  enforcement  would  add  little,  if 
anything,  to  public  understanding  of  the  tests. 

Section  3(a)(4)(A}  requires  publication  of  statements  o"  "the  extent, 
expressed  as  a  percentage,  to  which'^he  use  of  Cthe3  test  score  improves 
the  accuracy  of  predicting  future  grade  point  average,  over  and  abovp  all  • 
other  information  njsed."   The  tolleoe  Board  now  describes  i/i-lts  publi- 
cations the  ways  in  which  sAT  scores  are  typi';all7  used  by  institutions. 
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in  combinatiort  with  infonnation  about  the  student's  hijh-school  record, 
to  help  pr/wict  freshman  grade  point  average.    It  would  be  misUading, 
however,  to  attempt  to  attr'ibute  a  generalised  percentage  increase  in 
predictive  validity  to  SAT  scores  alcne.   Even  if  it  were  possible  for  the 
College  Board  to  know  to  what  extent  SAT  sco.es  alone  improved  the  fore- 
casting of  college  grade  point  average  at  every  postsecondary  institution 
in  the.  country^  such  data  would  vary  widely  from  one  institution  to.  another. 
The  Col^^j>^Bo4rd  and  ETS  have  pubUshed  considerable  informatioiji  about  the 
predictfve  va'idity  of  test  Scores,  much  of  which  is  summarized  in  the 
encased  booklet.  Test  Use  and  Validity.  . 

Section  3{aH4){B)  would  require,  providing  all  test  takers  information 
about  the  *miitkal  relationship  of  test  scores  an?i  family  income.  Such 
data  are  widely  available  Ihr.ough  other  publications  of  the  College'  Bo.^rd  and 
ETS  (see  the  enclosed  ,iamphlet  on  Test  Scores  ^nd  Familv  Income);  howeveV^ 
we  fiave  serious  reservation:*  about  *.h9  Jc:iirability  of  inco'^porating  this 

r 

material  in  routine  progt*ain  publications  tor  distribution  to  all  test' 
tf.kers.   While^scores  are,  on  the  Average,  hijjher  for  students  f.om  families 
with  higher  incoirjs,  students  from  each  incjoe  Itivel  obtain  the  full  range 
of  SAT  scores!   Nearly  one-third  of  the  '.tud^nts  with  family  incomes  below 
$6,000  rank,  in  the  top  half  of  the  total  group  in  .terms  of  SAT  scores. 
One  cannot  forecast  SAT  scores  from  famMy  tncome.   Thus,  the  College  Board 
avoids  making  statements' which  might  discourage  low-income  students  from 
'aspiring  to  higher  educafejon  or  from  taking  the  SAT  fcr  fear  that  their 
scores  will  be  low. 

♦Section  3(a)(4)(C)  would  require  providing  test  takers  with  informatics 
on  the  "extent  to  which  tes^t-preparation  courses  Improve  test    subjects'  scor.es 
*on  average,  ex'pres&ed  as  a  percentage."   Over  the  years  the  College  Board 
and  ETS  have  published  numerous  studies  an  the  effects  of  various  types  of 
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special  preparation  and,  more  recently,  the  Board  has  distributed  to  students  ^ 
a  statement  about  special  preparation  for  the  SAT.   A  copy  of  the  most  recent 
summary  of  research  on  this  subject.  The  Effectiveness  of  Coaching  for  the 
SAT:  RevieH  and  Reanalysis  of  Research  frocnVthe  Fifties  to  the  FTC,  is 
enclosed.  The  .text  of 'the  statement  for  students  about  special  preparation 
is  included  on  the  back  cover  of  Taking  the  SAT,  which  is  provided  to  all 
students  who  plan  to  take  this  test. 

Presumably  the  intent  of  Section  3(a)(4)(c)  ts  to  suirwarize  all  available 
data  about  special  test  preparation  courses  in  a  single  number.    Since  such 
activities' vary  widely  in  their  quality,  intensity  and  duration,  the  average 
score  change  that  might  be  attributable  to  test  preparation  courses  will 
also  differ.    Furthennore,  studies  on  the  effects  of  special  preparation 
cannot  separate  the  actual  effects  of  the  course  itself  from  the  rol^  played 
b>^ motivation,  interest,  effort,  and  other  individual  attributes  on  any  possible 
score  change.    Oversimplification^of  the  results  of  the  numerous  studies  on 
this  topic  would  be  misleading  and  a  disservice  to  many  test  Candidates  who 
may  conclude  that  any  test  preparation  course  will  yield  the  stated  average 
percentage  increase.  - 

Host  of  Che  ab(5ve  corments  regarding  Section  3  of  H.R.  1662  relate 

specifically  to  th^  SAT;  many  similar  concerns  would  apply  to  the 

Achievement  Tei»ts  and  .the  PSAT/NMSQT.    Some  of  the  required  information  as 

it  relates *to  the  lattec  two  programs  is  not  readily  available  or  would  not 

be  particularly  meaningful.    For  example,  there  is  no  recent  reliable  data 

00  special  preparation  courses  for  the  A'chievement  Tests. 

•  In  sufimary,  the  College  Board  routinely  provides  to  students  most  of 
* 

the  information  called  for  by  Section  3  of  H.R.  1662  at  some  point  during 
the  testing  process,  wKich  extends  from  registration  through  receipt  of 
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scores.    Other  information,  while  not  provided  to  test  takers  in  exactly 
the  form  specified  by  H.R.  1662,  is  either  coveted  in  general  in  the 
regular  student-oriented  program  publications,  is  in  the  public  domain  or 
is  available  on  request. 
Procedures  for  SAT  Quest ion-and-Answer  Service 

For  the  record,  the  College  Board  would  also  like  to  clarify  the  procedures 
under  which  students  may  request  to  see  test  questions  and  answers  on  the 
SAT,  both  in  New  York  State  and  nationally.   The  New  York  State  Standardized 
Testing  Law  requires  that  students  taking  the  test  in  New  York  be  given  the 
option  of  disclosure.    Beginning  in  the  1981-82  testing  year,  the  College 
Board  had  voluntarily  adopted  a  national  SAT  question-and-answer  service 
at  five  administrations  of  the  SAT,  giving  students  the  opportunity  after 
taking  the.test  to  order  copies  of  their  answer  sheets,  the  correct  answers, 
an'd  the  questions  that  counted  towards  their  SAT  scores. 

During  this  past  year.  New  York  students  received  a  special  edition  of 
the  Student  Bulletin   and  a  New  York  State  Supplement  which  contained  the 
order  form  for  disclosure  materials.    (See  page  7  of  the  enclosed  1980-81 
New  York  State  Supplement.)   Cecause  of  the  large  number  of  students  who 
take  the  SAT,  it  was  necessary  to  have  a  procedure  that  would  match  a 
particular  request  for  disclosure  material  with  the  correct  records.  The 
most  reliable  niethod  to  acc(xnpli3h  this  was  to  have  students  provide  their 
test  registration  numbers.    Although  students  could  send  in  their  requests 
'  prior  to  receiving  their  scores,  they  did  need  to  provide  their  registration 
number  which  they  received  on  the  admission  ticket,  the  form  sent  to  them 
upon  receipt  of  their  registration  form.    Incomplete  requests ,  including 
those  without  this  number,  were  generally  returned  to  the  test  pndidate. 
However,  no  rwjor  problans  were  encountered  with  this  system  .and  most  students 
^had  no  difficulty  in  completing  the  form  as  instructed. 
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Fop  the  national  disclosure  service  of  the  SAT  being  introduced  in 
1581-82,  the  general  system  is  similar.   Large  quantities  (nearly  four 
million  copies)  of  the  enclosed  Special  Announcement  about  the  SAT  Question- 
and-Answer  Service  are  being  shipped  this  summer  to  secondary  schools  for 
distribution  to  students  along  with  the'student  Bulletin.    An  order  form  is 
part  of  this  announcement.    The  Board  of  Trustees  of  the  College  Board'^ade 
the  decision  to  offer  this  jervice  after  most  of  the  revisions  had  been  made 
in  "the  regular  program  publications  for  1981-82,  therefore  precluding 
incorporation  of  all-  this  information  in  the  Student  Bul^let in  and  other 
publications.    It  was  possible,  howevei:*  to  call  attention  to  the  service  by 
means  of  special  notices  on  the  covers  of  most  of  the  publications.  Staff 
are  currently  investigating  other  methods  to  offer  the  SAT  Quest ion-and-  ^ 
Answer  Service  to  the  more  than  1.5  million  candidates  who  are  expected  to 
take  the  SAT  in  1982-83. 
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The  Committee  for  Fair  and  Open  Testing 

5  Bcckman  Sire«.  Room  1000.  New  Yoric.  N.Y.  10038  (  212)  349  6460 


CO'DUECTOIIS: 
John  Weii^ 
SicvC  Solomon 


'  TSSTDlOKlf 
of 

STCVE  SOtOMOH 
b«for»  tht 

U.S.  HOUSE  OP  REreESENTAnvES 
SUBCOMMlTre^^ON.EUEMEirrARY,  SSCONDARY,  AKD  VOCATIONAL  BDUCAnON 
arri 

SUBCCMMITfEE^QII  POSTSECOlfDARY-EDUCATION 

July  21,  1981 
VAsMngton,  D.C* 


Good  day.   My  nw*  is  St»v»  Solomon.    I  an  Co-Dlr«ctor  of  the  CorwitU* 
for  Fair  a«l  Op«n^»stlr«,  a  non-profit  reatarch  onsanlzttloR  afflUattd  with 
th«  C»ntor  for  the  Study  of  PoUtlcs  and  Education,  Inc.    I  was  previously 
th©  Director  of  the  New  York  Public  Interest  Reaoarch  Croup' •  (NyPIBG)  Testing 
Project.    My  goal  here  today  la  to  provide  thla  Counlttee  and  the  public  with 
the  Cojwitteo  for  Fair  and  Open  Teatlr^'a  vlewa  toward  dlacloaure  l«gllatlon, 
the  CojMilttoe'a  concern   that  standardized  federal  leglalatlon  would  be  better 
than  atate  atatuteo  for  the  teatlr^  Industry,  and  an  ul>-to-date  progreaa  re- 
port on  how  well  the  law  is  wox^clng  In  New  Yoric.   Lawrence  Kronlck  and  De^ra 
Sttlnger,  Acsoclatea  of  the  Comulttte,  asalated  In  the  writing  of  this  testl- 
Mony*  " 

the-Aaerlcan  public's  proclivity  to  believo^  in  conctpta  adorned  with 
numbers,  the ^politician's  need  for  soae  objective  method  of  making  our. educa- 
3  tional  Structure  accountable  anl  the  testing  irauatxy's  Pf-jjioj*!  ' 
all  help  to  axplain  why  each  y«*r  over  fifty/million  standardized  •ultlple- 
choice  tests  are  administered  to  America's  students  and  workers,    indeed,  ^ 
the  atarriardized  testing  industry  has  grown  Xo  Income  ihe   cradle  to  grave 
arbitrator  of  aocial  mobility  anl  one  of  the  most  power£\il  corporate  entities 
in  the  United  Siates.    These  tests  influence,  among  other  things,  whether  or 
not  one  is  placwi  in  elementary  school  programs  for  the  mentally  retarded  or 
for  the  gifted,  awarded  a  high  school  diploma  in  over  a  dozen  states,  »cc«Pt«d 
•     into  most  American  undergraduate  programs,  75^  of  all  graduate  school  programs, 
arri  10«<  of  the  nations  law  schools.    Standardized  tests  also  pljy  *  P*^);.^" 
determining  who  is  given  the  opportunity  to  sell  insurance  in  Illinois,  fight 
fires  or  waDc  a  police  beat  in  Philadelphia,  fix  cars  In  Massachusetts, 
design  buildings  In  Ohio,  practice  law  In  fttj^y-two  states,  or  receive  a 
scholarship  from       State  of  Georgia,  Union  CarbJde,  or  the  Brotherhood  of 
Steam  Fitters.', 
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Yet  despite  the  importance  of  these  tests,  the  testing  process  has  been 
shroided  in  secrecy.    Vital  information  concerning  tests  as  well  as  test 
questlchw,  have  been  shielded  from  public  scrutiny  by  the  testing  industry. 
In  1978  the  late  Dr.  Oscar  K.  Buros,  winner  of  the  Educational  Testing 
Service  (STS)  Distinguished  Ser/lce  Award  and  editor  of  the  .authoritative 
Mental  Measurements  Yearbook ,  laaented,  "It  is  practically  Itopossible  for 
a  competent  test  technician  or  test  consuner  to  make  a  thorough  appraisal  of 

the  construction,  validation,  and  use  of  standardized  tests  because  of 

the  liBlted  aaount  of , trustworthy  inforaation  supplied  by  the  test  pub- 
lishers > 

Vith  the  enaction  of  New  York's  "Truth-ln-Teating"  law  on  July  13,  i979i 
the  secrecy  surrounding  the  testing  process  has  begun  a  slow  netamorphisis. 
New  York's  "Truth- in-Testing"  law,  which  the  Federal  bill  is-modeled  after, 
is  primarily  disclosure  legislation,  requiring  the  testing  industry  to 
provide  students  and  researchers  with  soae  basic  infomation  about  how 
stetndardized  tests  eire  constructed  and. scored.    Specifically,  the  law  mandates 
that  the  put^Hshers  of  college  and  professional  school  tests t 

*  Provide  test-takers,  upon  request  and  at  cost,  with  a  copy  of  the 
questions  scored,  their  individual  answer  sheets  and  the  correct 
answers I 

*  nie  with  the  Commissioner  of  Education  a  copy  of  the  test  questions, 
the  acceptable  answers  and  all  studies  relating  to  their  tests' 
reliability,  validity  and  possible  cultural  biasi  and, 

*  Inforp  test  takers  of  the  purpose  of  the  test,  policies  concerning 
scoring  errors,  length  of  tlao  that  test  scores  are  kept  on  file  and 
the  relationship  between  test  scores  and  predicted  performance. 


VHY  IS  A  PREEMPnVS  FEDERAL  BILL  NBGESSARY  ? 

Despite  the  claims  of  the  testing  industry,  "Trttth-in-Testing"  in  New 
York  State  and  on  the  Federal  level  is  not  regulation.    The  bill  is  simple 
,  infomation  legialatio|r;  similar  in  concept  to  Truth-in-Labeling  and  Truth- 
in-Packaging  laws.   1^  no  way  does  it  regulate  the  content,  administration 
or  development  of  these  tests,  it  only  requires  that  the  testing  process  be 
open  to  the  public. 

Now  that  Jtwo  states  have  enacted  their  own  Truth- in-Testing  measures 
anl  twenty- four  other  states  are  considering  similar  measures,  it  makes  sense 
to  have  a  5ir«le  preemptive  national  statute.    The  Law  School  Admissions 
Cduncil  anl  the  American  College  Testir^  Program  have  testified  at  the  state 
level  that  a  federal  bill  would  be  preferable  to  having  more  states  enact 
their  own  Truth-in-Testing  laws.    Bruce   Ziomer,  Executive  Director  of  the 
ISAC,  in  his  testimony  before  the  New  Jersey  State  legislature  on  February  11, 
1981,  asked  the  following  rhetorical  questions  referrir^  to  the  difficulties 
the  testir^  companies  face  if  a  variety  of  schemes  of  disclosure  are  enacted  1 
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Vhat  will  happen  if   a  state  enacts  as  law  the  provision  introduced 
in  Texas  in  1979  that  even  equating  and  pretest  questions  be 
disclosed?    Or  if  conflicting  time  deadlines  and  notice  requirements 
are  introduced  In  Massachesetts,  Maryland,  New  York,  and 
Connecticut?  Vhat  are  our  member  institutions  to  do  if  one 
state  protects  user  institution  privacy  and  another  does  no,t? 
Vhat  shaia  we  do  if  a  state  enacts  a  provision  that  provides 
o  some  benefit  to  local  test  candidates  "without  an^  fee  or 

charge?"   Shall  we  recoup  our  costs  only  outside  of  that  state? 
Or  shall  we  add  these  costs  to  our  basic  fees  for  everyone 
across  the  nation  automatically? 

Clearly  Mr,  Zimner  has  a  legitimate-concern.    There  is  a  great  need  for  a 
preemptive  federal  statute  that  will  standardize  the  disclosure  process  making 
compliance  reasonable,  practical,  beneficial  and  economical  for  all  parties 
concerned.    In  addition,  it  seems  logical  that  due  to  the  traditionally  interstate 
nature  of  post- secondary  education  that  ar\y  law  dealing  with  this  process 
should  be  enacted  by  the  federal  government* 


Last  year,  before  this  committee  the  testing  Industry  successfully 
argued  that  before  ai\y  federal  action  be  taken,  the  ramifications  of  th. 
law's  enaction  in  New  York  must  be  assessed i 


The  testing  companies  clalaed  that  test  quality 'would  be  threatened 
if  they  were  required  to  release  the  questions  for  public  inspection. 
Truth-in-Testing  proponents  predicted  an  improvement  in  test  quality, 
Now  that  two  years  have  elapsed  since  the  New  York  law  was  passed, 
marry  testing  companies  and  their  employees  have  acknowledged  that 
test  quality  has  improved  due  to  disclosure,    Students  have  discovered 
errors  affecting  over  half  a  nillion  test-takers  as  a  result  of  New 
York  State's  "Truth-in-Testing"  law,  many  of  them  being  faulty 
questions.    Bruce  Zlnmer,  of  the  IS  AC,  explained i 

"Test  disclosure  promotes  confidence  in  the  integrity  of  the 
test  instrument  and  the  testing  process.   It  is  symbolic  of 
our  public  accountability.    Indeed  it  helps  us  in  our  quality 
control  efforts," 

The  testing  industry  clalffled  that  the  law  gave  students  rights  they 
didn't  want  and  wouldn't  use.    Truth-in-Testing  proponents  stated  ^ 
that  students  were  very  Interested  in  their,  performance  on  these 
tests  and  would  take  advantage  of  \hi8  opportunity  if  Pfoperly 
infoimed.    On  the  May  1980  Uw  Sdhool  Admissions  Test  (15 AT)  over 
65JC  of  the  test  takers  requested  a  copy  of  their  questions 
answer  sheets.    As  a  result,  the  L5AC  decided  that  next  year  I5AT 
'test  takers  will  automaticaiy  receive  a  cory  of  their  test  questions 
aixi  answer  Sheets  (see  section  on  How  the  Bill  is  Vorking  in  New 
York) . 
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Hot  only  is  the  New  Xork  law  working  well,  it  has,  in  conjunction  with 
tho  possibility  of  other  states  and  confess  enacting  similar  statutes  and 
the  discovery  of  so  nany  errors,  caused  nany  of  the  testing  companies  to 
extend  nationwiie  soae_of  the  benifits  the  law  provides  to  New  York  test 
takers*    Despite         seeaingly  altruistic  change  in  policy,  test  publishers 
are  still  opposed  to  Truth-in-Tosting  in  concept  and  have  only  implemented 
their  national  disclosure  policies  to  hinder  tho  efforts  of  other  states  and 
Congress  to  enact  their  own  laws*    One©  the  possibility  of  new  laws  is  removed, 
the  test  companies  could  very  easily  resind  their  national  disclosure  policy* 
It  is  imperative  that  statutory  guarantees  be  provided  so  that  test  takers 
now  and  in  the  future  can  bo  sure  that  the  teat  which  they  have  taken  is 
scored  correctly,  reported  correctly,  and  contains  no  faulty  questions* 


In  addition,  federal  legislation  can  bo  used  to  improve  upon  the  New  York 
law.    Nov  Yoric  is  working  well,  but  more  needs  to  bo  done.    The  following  are 
several  anondaonts  that  should  bo  added  to  the  bill,    They  require  tho  test 
publishers  to  provide  uore  comprehensive  information,  which  will  increase  public 
understanding  of  tho  testing  process i 


1,    Test  publishers  should  bo  required  to  report  their  scores  in  a  95^ 
"true  score  range  "  (i*o.,  tho  ran^o  of  scores  that  95^  of  tho  test 
takers  who  take  tho  tost  once  and  thon  retake  the  tcfst  without 
taking  a  coaching  course  or  learning  of  any  kind  would  receive*  For 
nosfc  ETS  tests  this  is  a  120  to  1^  point  range  —  a  500  would  be 
reported  a  W^O  -  560)  * 


Z,  The  test  publishers  would  have  to  provide  tho  Department  of  Education, 
for  public  review,  a  description  of  every  complaint  thoy  have  received 
from  students  who  believe  that  there  was  an  error  made  on  their 


3*    That  if  a  test  publisher  incorrectly  scores,  reports  or  administers 
a  student's  test,  the  test  taker  should  receive  his/her  money  back 
plus  the  right  to  ro-tako  tho  test  at  ho  extra  cost  within  '^0  days 
of  the  error  being  discovered* 


AMHStOMSinS  TO  TIE  BILL 


s 


examination* 
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TOE  HEW  YORK  SXPSRISKCS 


The  New  York  Stmte  legislature  enacted  Truth-ln-Testln«  because  Nw  Yorfc 
Congress  of  Parents  and  Teachers  (PTA),  New  York  Educators  Association,  New 
York  Public  Interest  Research  Croup  (NYPIRC),  New  York  Personnel  wd  Cuidanco 
Association,  National  Association  for  the  Advancenent  of  Colored  Peopl^KNAACP;, 
Puerto  Rlcan  Legal  Education  and  Defense  Fund,  New  York  State  Consumer  Pro- 
tection Board,  New  Yoric  State  English  Council,  National  Conference  of  Black 
lawyers.  New  iork's  Attorney  General's  Office,  dozens  of  research  scientists, 
Including  three  former  ETS  employees,  joined  every  major  New  York  student 
group  In  enthusiastically  supporting  the  measure. 

These  individuals  and  organizations  supported  tlie  measure  because- they 


were  I 


*  Concerned  about  test  publishers »  claims  that  they  did  not  n^ftak^^, 
when  nearly  everyone  seemed  to  know  someone  who  had  trouble  with  Elb 
processing  or  scoring  their  tests.   Documentation  of  fourteen  separate 
errors,  affecting  200,000  students'  test  scores,  prior  to  the  enaction 
of  the  New  Yoric  law  is  in  Appendix  B  (An  in-depth  explanation  of  the 
eight  errors  discovered  due  to  the  law  and  their  effects  on  the 

"testing  industry  is  discussed  in  the  Error  section), 

*  Concerned  about  the  fact  that  ETS  and  other  publishers  awarded  students 
precise  aptitude  scores  when  their  own  statistical  studies  Indicated 
that,  due  to  test  error  there  is  a  one  in  ten  chance  that  a  student 
who  retakes  a  test  will  have  a  score  which  will  fluctuate  by  over  100 
points  (fifty  points  in  either  direction).    This  fluctuation  is  important 
because  on  most  ETS  tests  a  500  is  in  the  50th  percentile,  whereas  a 

600  is  in  the  8^lth  percentile. 

*  Concerned  that  ETS  has  denied  independent  researchers  access  to  the 
data  necessary  to  evaluate  their  test's  validity,  reliability,  and 
culture-biasei^  (for  one  example  of  this,  see  the  artical  by  Tamar 
Pacher  in  Appendix  C), 

*  Concerned  about  the  fact  that  in  the  one  case  prior  to  the  enactment 
of  New  York's  Truth- If -Testing  law  where  ETS  released  a  test  form  — 
the  February  1973  Multi-State  Bar  Exam,  law  professors  from  four 
faculties  disagreed  on  over  3^- of  the  correct  answetra.^ 

*  Concerned  about  the  fact  that  researchers  from  the  National  Conference 
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of  Black  Lawyers  reported  that  black  law  applicants  who  had  comparable 
.grades  (±  ,01  CPA),  Identical  majors,  auid  attended  the  same  undergraduate 
'institutions  as  their  white  counterparts  scored  over  109  points  lower 

on  the  ISAT. 

'Difference  In  I5AT  Scores  Between  White  and  Minority  Law 
School  Applicants  Who  Have  Comparable  Grades,  Majors,  and 
Undergraduate  Institutions 

Minority  Group  ^  Number  in  Sample   Score  Dlfferenne 

  M^  Median 

Blacks  ^722  -109.6  -101.1 

Chicanes  352  -  99.^  -106.5 

Native  Americans     .  ^8  -  77.8  -  79.9 

Asian  Americans  277  -  3^»5'  "  23.o 

*  Concerned  about  the  fact  that  the  I5AT  sample  booklet  features  dozens 
of  famous  men  --  presidents,  senators,  journalists,  scholars  and  the 
like      and  not  a  single  f»aous  woman.    This  is  Important  -because 
several  studies,  including  some  by  EIS,  report  that  women  score  better 
on  questions  featuring  females  or  persons  of  no  specified  sex  while 
men  score  higher  when  males  are  featured.    And  the  questions  that  do 
feature  women  are  disturbing.    For  instance,  this  item  from  the  ISAT 
makes  sono  interesting  assumptions.    It  reads  as  follows: 

20.    Maiy  cultures  do  not  share  our  assumptions  that  women  are 
innately  passive  and  emotional,  that  their  roles  must  be  domestic, 
and  that  they  cannot  function  effectively  in  position?  of  authority.  1 

*  Concerned  about  high  school  students  who  are  taking  courses  on  how  to 
take  tests  instead  of  Algebra,  Chemistry  or  Art.    Concerned  because 
teachers  are  altering  their  curriculum  to  teach  the  tests.    Writing  in 
the  New  York  Times  Magazine  of  September  2,  1979,  Thomas  C.  Wheeler 

made  a  strong  case  that  the  objective  test  system  has  been  a  ''devastating 
influence"  on  students*  writing  ability.    "The  American  language  -- 
supple,  imaginative  and  alive      has  lost  ground  to  the  pretense  of 
measurement,"  he  wrote.    And'  of  the^^T  in  particular.  Wheeler  concluded, 
"Its  verbal  part,  like  other  objective. tests  in  language,  does  not  ask 
for  writing;  and  because  it  doesn*t,  the  act  of  writing  has  withered 
in  our  schools." 

*  Concerned  about  the  fact  that  in  1979>  the  American  College  TestiJig 
Program  asked  five  health  experts  to  eliminate  the  obviously  incorrect 
answers  from  their  126  item  multiple -choice  health  care  proficiency 
^est,    ACT  researchers  planned  to  estlnate  the  (lifficulty  of  their 
test  by  the  number  of  answers  that  remained.    To  ACT*s  chagrin,  each 
expert  elijainated,  as  being  obviously  incorrect,  between  9  and  26  of 
the  answers  ACT  stated  were  correct. 

*  Concerned  about  the  fact  that  ETS  deceminated  false  statements  concerning 
coaching's  impact  />p  test  scores  and  on  the  costs  involved  in  Implementing 
Truth-In- Testing  J^egislation. 

1  See  Appendix  for  further  test  questions. 
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*  And  finally »  concerned  because  one  number  fron  a  lest  PU^^Js^er  can 
uiSlterably  affect  a  person's  life,  yet  that  person  «ust  blindly  trust 
the  testing  companies  that  the  test  is  fair  and  is  scored  correctly. 

The  Educational  Testing  Service  (EIS)  and  the  College  Entrance  Examination 
'  Board  (Cmrthe  bill's  najor  opponents,  reacted  to  the  legislation  by  hiring 
t^obbying  flrn  that  represented  the  State's  tobacco  and  P^;°«"^J°»i  , 
i^eresrs.    initially,  thSie  two  "non-profit"  firms  and  their  Jo^J^^^^^^^^^ 
that  testing  is  a  very  complex  technical  issue  that  couZd  not  be  dealt  with 
in  the  legislative  arina.    In  addition,  they  argued  that  there  were-few,  if 
'  *rv,  problems  with  testing,  thus  legislation  was  unnecessary. 

It  soon  became  apparent  that  this  simplistic  and  condescending  strategy 
was  rZt  con^incilS  legators,  ani  ETS  ard  * 
lobby  can  committ  -  they  lied.    A  few  illustrations  of  EMS  ^  l 
intentional  distortion  of  facts  concerning  the  consequences  of  New  York  s 
--Truthrln-Tes.ting  bill  are  as  fonowsi  ^  

*  An  ETS  "Memorandum-in-Opposition"  circulated  to  New  York  legislators 
and  educators  in  May  ard  June  1979.  stated  that  the  New  York  Truth- 
in-Testing  bill  would  require  public  filing  of  "all  statistical  data 
arri  reports"  filed  by  the  testing  companies  including  confidential 
tSo^^rtlon  ....  about  test  subjects"  when  in  fac>  the  bill  mandated 
that -no  Infonnation  identifiable  with  the  test  subjects  be  disclosed. 

*  Ens  arxi  CEEB  mailgrans  and  memos  distributed  to  every  high  school 
principal  ard  college  president  in  New  York  State  which  claimed  the 
bill  -would  seriously  disrupt  equating  procedures,    when  in  fact 
questions  used  solely  for  equating  were  specifically  exempted  from 
the  bill  (equating  is  the  process  for  making  tests  given  at  different 
tlm63  comparable  to  each  other). 

»  On  June  13.  1979,  the  day  before  the  New  York  Senate  ^" 
the  bill,  EMS  distributed  a  "Memorandum-in-Opposition   to  all  New 
Yox*  State  legislators.    Ihe  Memorandum  stated  thati 

Publication  of  the  test  questions  will  Increase  the  cost  of  that 

SATi  between  $^1.73  and  $12.73 
GREi    between  $9.73  and  $32.73 

I5ATt  between  $21. 6o  and  $35.^, 
GMATt    between  $1'*.13  »nd  $26.63 

*  EMS  argued  that  large  fee  increases  were  necessary  to  offset  their 
additional  costs  due  to  having  to  vrite  new  questions  for  every  test. 
ETS  eventually  retracted  the  above  statement  wheni 

1.    Truth-in-Testlng  supporters  publisized  two  internal  KS  documents 
which  revealed  that  test  development  was  only  a  small  portion  of 
costs  (33«S  to  86^  per  test  in  one  study,  17li  por  test  in  another. 
See  charts  I  and  III). 
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2.  Several  fomer  BTS  employees  testified  that  approximately  70JC 
of  the  items  of  BTS»  tests  were  made  up  new  for  each  form. 
ETS  therefore  Koild  have  to  increase  its  it^m  Krlting  capacity 

by  about  50J<.   Since  the  total  test  development  costs  for  the  SAT. 
GWt,  I5AT,  ana  GMAT.  were  less  than  a  dollar  per  candidate, 
Truth-in-.Testii«  legislation  would  only  increase  students  test 
fees  by  s  fev  cents. 

3.  IIB  documents  revealed  that  between  197^*  arri  1976  ETS  and  CEEB 
earned  over  $10  million  in  "non-profits"  from  just  their  Admis.sions 
Testing  Program  (see  Chart  II). 

There  are  several  other  examples  of  ETS  and  CEEB's  use  of  inuendo, 
unsupported  statistics,  ani  selective  misinformation  to  promote  their 
pro-ams  aid  mislead  legislators,  ^w^^J^^^  i?*q.I^h 
sperific  examples  are  coaching  arri  the  ETS  and  CEEB  operat;?d  Student  Search 
Severvice  (see  Appendix  A).  ^ 


Chart  Ii    How  Much  of  Candidate's  Fee  Goes  to  Test  Development? 

 ~~'      College  "ATGSB 

Test  Program  Board        I^AT  ORE  (now  GMAT) 

Fee  Paid  By  Candidate  $5.75      $13.50     $8.00  $10,00 

Total  Cost  (per  session  $^.82      $10.83     $7.17     $  9-22 

candidate)  to  ETS  ^ 

Cost  of  Test  Development         $  -33      ^  $  -66  $ 

Test  Development  as  J<  of  6.5  %       ^-5  %     8.7  %      ^-8  % 

Total  Cost  to  ns 

Sourcei    "Activity  Analysis,"  Internal  KS  Study,  January  31 •  1972 
Chart  III    Admission  Testing  Pro<p:aa  Revenue  and  Expenses 

Revenues        Expenses         Surplus         %  Profit 
197^75    $16,036,276    $12,550,5^1    $3»^5»735  ^7% 

1975-  76    $16,260,652    $13,232,47'*    $3»028,178        22  ^' 

1976-  77*  $17,6^*0,000    $1^*, 099,000    $3,5^1,000  25^ 
♦projected 

Source!  College  Board  Statement  of  Revenues,  B^P^nses  and  ^ 
Year  Ended  July  30,  I976,  with  Comparable  Figures  for  1975  *«i  for 
1977  Current  Projections. 


.ERIC 


13J 


126 


/ 


^Charl  Hit    STS  Test  DeveloT)aent  Spending  Breakdown  and  Budiset  for  College 
Boaid  Admissions  Testing  Pro4rraa  (SAT  and  Aohievement  Tests). 


1976  Actual 

1977  Budget 

Test  Construction  Expenses            $     291 i 000 

$  389,000 

Prosran  Administration  Expenses  $10,079iOOO 

$10,86^,000 

Test  Construction  as     of  Program            2.9  % 
Administrative  Expenses 

Admissions  Testing  Program  Volume  $  1,737|000 
(in  number  of  Test  Subjects)* 

$  1,^30,000 

Total  Construction  Expenses  per     $  .17 
Caididate**  j 

$  .27 

•Test  Subjects  Volume  figures  are  from  ETS  In  Fact,  and  ETS  publication 
•^Expenses  Per  CaMidate  calculated  by  dividing  Test  Construction  Expenses 
by  Candidate  Volume 

Souccei    "ETS  CONHDENTIAL  Project  Operating  Statement  by  Pos,-  Category/Project, 
Period  Ending  3/31/77,"  a  66  page  computer  print  out 


\ 

\ 

\ 
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HOW  IS  ne  BILL  VORKIWG  IN  HSV  YOfgC  ? 


\ 

On  January  3,  1980,  Just  three  days  after  the  law  went  into  effect,  the 
test  piblishers  announced  that  twenty  of  the  twenty-six  tests  covered  by  the 
new  law  would  no  longer  b s*  administered  in  New  York,    This  occurred  because 
the  testing  companies  took  an  inflexible  position  against  any  form  of  the 
legislation  and  made  no  suggestions  for  amendments  while  the  bill  was  being 
considered.   This  resulted  in  a  law  which  was  insufficiently  clear  to  insure 
the  most;  effective  administration.    After  th»  New  York  legislature  adopted 
several  amendments  in  February  1980,  test  publishers  reinstated  fifteen  of 
the  previously  witWrawn  tests.    The  following  is  a  brief  synopsis  of  specific 
test  company  reactionei 

*  TtL  AMERICAK  MOTAL  ASSOCIATION  (ADA)  initially  announced  that  they 
woulk  witWraw  their  tests  from  the  state.    In  November  1979,  »fter 
meeting  with  state  legislators,  the  ADA  pledged  to  administer  the 
Dental  Admissions  Test  on  a  normal  schedule  and  to  keep  test  fees  the 
same.    State  legislators,  in  turn  tentatively  agreed  to -exempt  for 
1980  Ithe  "perceptual  ability"  section  of  the  test  from  the  Uw, 

*  Foii  days  after  Govemer  Carey  signed  the  Truth«ln-Testing  bill  into 
law,  the  ASSOCIATION  OF  AMERICAN  MEDICAL  COUJKES  (AAMC)  announced  that 
they  would  not  administer  their  test  in  New  York,    In  November  1979  the 
AAMC  filed  suit  in  federal  court  charging  that  the  law,  by  forcing  then 
to  aalte  :>ubllc  their  test  auestions,  violates  federal  copyright  laws. 
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On  Januksy  21,  1980  U.S.  District  Court  Jud«e  Neal  McCum  granted  the 
AAMC  a  preXlainaiy  injunction  until  the  case  is  heard.    As  a  result, 
th^  Medical  College  Admissions  Test  (MCAT)  is  exeapt  frou  the  disclosure 
provision  of  the  law  unti]^  the  case  is  heard  a«i  was  not  withdrawn  from 
the^state.    A  recent  issue  of  the  Columbia  Law  Review  (January  1981)  * 
r^ects  the  AANC's  argutents  against  the  legislation,  and  concludes  that 
the  Truth-in-Testing  law  should  be  allowed  to  stand.    Also,  New  York's 
medical  schools  and  the  American  Medioal  Students  Association  (AKU) 
have  told  Senator  LaValle,  sponsor  of  the  New  York  bill,  that  they,  were 
not  consulted  and  do  not  endorse  AAMC's  decision  to  witMraw  the  ^fCAT 
^ftx>m  New  York  or  AAMC's  decision  to  file  suit  in  opposition  to  the^law. 

♦  The  PSYCHOLOGICAL  CORPORATION,  a  subsidiary  of  Harcourt,  Brace, 
Jovanovlch,  Inc.,  withdrew  its  tests  from  the  state.    Mo'-t  of  these 
teats  have  an  extremely  low- volume  and  are  now  exempted  by  ameniments 
to  the  law. 

0 

♦  The  KXJCATIONAL  ISSTINC  SERVICE  (ETTS)  wid  the  COLUBGB  ENTRAJKJE  EXAMINATION 
BOARD  (CBEB)  feontinuod  their  efforts  to  uniennine  the  law.    They  made  it 
extremely  difficult  for  students  to  obtain  materials  made  available  by 

the  law.    They  instituted  a  $1.75  surcharge  to  all  New  York  test  takers 
in  an  effort  to  "punish  New  York,"  and  they  charged  an  extra  $^.76  to 
those  who  requested  the  information.    CE£B  also'  reduced  by  the 
number  of  test  dates  for  the  SAT  and  cut  back  by  75<  the  number  of 
test  dates  available  to  students  who  cannot  be  tested  on  Saturday  for 
religious  reasons. 

In  addition,  they  provided  little  if- any  information  to  students  or 
educators  that  additional  teterials  are  now  available.   George  Hanford, 
President  of  the  College  Board,  told  the  New  YojA  Times i  afte^*  the  bill 
was  enacted,  "Why  should  we  go  out  of  our  way  to  push  something  we  don't 
think  is  useful."  SAT  takers  must  nil  out  a  special  fora  to  obtain 
a  copy  of  the  test.    In  several  instances  this  form  has  not  been  included 
with  the  regular  registration  form. 

♦  The  reaction  of  the  LAW  SCHOOL  ADMISSIOIC  COUKCIL  (I5AC),  the  GRADUATE 
RECORDS  IXAKINATION  BOARD,  and  the  GRADUAW  MAKASEMCNT  ADMISSIONS  ISST 
BOARD  sponsors  of  the  IS  AT,  GRB  and  the  GHAT,  respectively,  were  much 
more  favorable.    They  clearly  informed  students  of  their  rights  and 
broke  with  ITS  and  the  College  3Board,  extendir^  the  benefits  of  New  York's 
law  to  atudents  throughout  the  U.S.    The  LSAC  enabled  students  to  receive 

the  additional  information  without  raising  prices >  initially.    They,  unlike  ETS, 
enabled  those  inditiduals  who  wanted  the  materials  to  Just  check  a  box 
on  the  registration  form. 

After  65i  of  those  taking  the  May  1980  admlnistr;^ation  of  the  I^AT 
requested  the  information  provided  by  the  law,  the  I5AC  in  an  effort  to 
compliance  coet  effective  decided  to  make  disclosure  not  enly -national, 
but  mandatory.    Starting  next  year  all  teet-takeri  will  receive  a  copy 
of  the  questions  scored  as  well  as  a  copy  of  their  answers,  Bruce 
ZU«er,  Executive  Director  of  the  I5AC  stated,  "The  ty^se  of  persons  who 
apply  -to  Law  School  are  quite  interested  in  their  irriivldual  rights." 
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Recently,  ETS  aid  other  ncnbers  of  the  testing  Industry  have  been  forced 
to  reevaluate  their  position  with  respect  to  compliance\    Eighteen  months  ago 
ETS  Vicch President  for  Law    Prograns.  Thomas  0.  White,  wrote  an  internal  nemo 
to  ETS  President  Willia-n  TurnbuU  (Fall  1979  Testing  Digest)  stating  that 
since  Truth-in-Testing  had  beconc  law,  publishers  should  do  their  utmost  to  ^ 
comply  with  it.    Today  tfhlte  Is  President  of  a  new  non-ETS  affiliated  organization, 
the  Law  School  Admissions  Service  (i^AS)  of  Newtown.  Pensylvanla,  which 
administers  several  programs  previously  run  by  ETS  (including  the  LSAT).  tie 
told  The  New  York  Times  (November  23,  1980)  that  'as  a  result  of  the  New  Yoiic 
bill:  "Peopl-,  can  see  more  <yf  the  elements  of  a  process  that  is  critical  to  k 
their  cor^^r  decisions,  and  they  can  comet  any  mistakes."  ETS  Senior  vice 
President  for  Testing,  E.  Bolvin  Williams,  toijd  Th^  New  York  Times  education 
editor  E<X.vaid  Fiske  that  New  York's  Truth-in-i'esting  bill  has  prodded  Ms 
company  inw  a  "healthy  rc-examlnation"  of  the  organization's  internal  pro- 
cedures.   Vlllios  conclua^  t\iai  duo  to  Truth-in-Testirg"I  can  say  with 
absolute  certainty  that  the  quality  did  not  go  down  on  any  of  our  tests.  To 
the  contrary,  it  is  better  than  ever."  ^^v.^ 

Yet  despite  the  high  request  rate  for  the  LSAT  and  CEE3's  new  disclosure 
poUcies,  ETS  and  CEEB  have  spent  thousands  of  dollars  on  high  prictd  lobbyists, 
to  prevent  other  state  and  Congress  from  extending  the  benifits  .of  Truth-in- 
Tostlng  to  their  constituents.    In  August  1978,  ETS  Presdent  William  Turnbull 
»<rote  a  meaoraTriam  titled  Public  and  Professional  Attitudes  Towards  Testing 
and  ETS.    The  21-pago  confidential  document  outlines  Turnbull's  plan  to  spend 
|i-5oTooO  to  Influonco  legislators,  government  officials,  teachers'  unions 
and  civil  rights  organizations  (sec  Appendix  D).    Testing  lobbies  in  other  . 
states  have  continued  thoit  efforts,  presenting  qucstionalble  arguments  against 
the  bills.    For  cxamploi 

1.  they  claim  that  the  New,  Yorf^  law  would  be  repealed,  when  in  i"act  the 
legislature  in  Njw  York  jicver  considered  such  action. 

2.  legislators  in  other  states  were  told  that  "Tnith~in-Testing"  is  really 
a  federal  issue j  when  at  the  same  time  ETS  lobbyists  were  telling  members 
of  Congress, considering  the  bill  the  the  Federal  governaont^iad  no  rl«ht, 
to  interfere  in  education;  and,  ^ 

3     the  cost  of  administration  of  the  law  would  be  in  tha  area  of  50,000 
dollars  when  in  fact  the  Now  York  State  legislature  for  the  past  two 
fiscal  years  has  budgeted  absolutely  nothing  for  the  laws  administration. 

In  February  1980,  six  weeks  after  the  New  York  bill  became  law.  Senator  - 
LaVallo  told  the  following  otory  to  illustrate  his  frustrations  wit^  ETS  and 
CEEB  offlcialsi    "In  the  early  1960»s  khen  Congress  enacted  auto  emission 
regulations,  both  General  Motors  and  Toyota  hired  1,000  ne  employees.  Toyota 
hired  1,000  engineers  aM  CM  hired  1,000  new  lawyers.'    The  -ol^owing  axe 
Just  a  few  of  the  lobbyists  ETS  and  CESB  have  hired  to  defeat  Truth-ln-lesting 
legislatiojit  , 

•  florlda  -  Bruce  Smathcrs^  the  state's  fonaer  Secretary  of  St^tej 

*  Maryland  -  Tom  Lord,  the  state's  former  Assistant  Attorney  General i 

»  Massachusetts  -  Tom  Joyce,  the  lobbyist  retained  by  that  state's 
banking  and  nuclear  interests j  * 
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♦  Kew  Jersey  -  Joe  K*t2,  Lobbyist  for  that  state's  restauAnt,  motel, 
cigarette  I  auto  dealers,  race  track  and  casino  interests;  and, 

♦  Waahir^ton,  D.C.  -  the  Ian  fina  of  Vilmer,  Cutler  and  Pickerir^,  whose 
other  clients  include  General  Motors,  IBM  and  DuPont. 


\ 

ERRORS  AND  TOEIR  RAMIFICATIONS 

Hew  York  State's  Truth-in-Testii%  Ian  has  resulted  in  increased  public 
scrutiny  of  tests  as  well  as  provided  college  and  graduate  school  applicants 
with  the  right,  after  scores  are  reported,  to  a  copy  of  the  questions  asked" 
and  their  answer  aheets.    Prior  to  the  enaction  of  Truth-in-Testing  in  New 
York,  students  had  little  if  any  way  of  detecting  or  proving  that  there  was 
any  problem  with  test  items  or  reported  scores.    In  fax:t,  as  mentioned  in  the 
accompanying  article,  ETS  claimed  that  they  were  virtually  infallible.  Since 
the  enaction  of  the  law,  errors  effecttjlg  the  scores  of  nearly  orie^half  million 
sttdents^'have  be<5n  discovered.    Six  different  categories  of  errors  have 
been  brought  to  light*    administrative  errors,  factually  incoirect  questions, 
scoring  errors,  reporting  errors,  ambiguous  questions,  and  biased  test  items. 

The  first  error  detected  after  the  passage  of  the  law  was  discovered  by 
a  Pitts  ford,  New  York  high  school  student.    He  wrote  ETS  pointir^  out  that 
one  of  the  test's  readirv";  comprehension  passages  that  dealt  with  how  migrating 
birds  navigate,  was  incorrect.    "Readtr^  false,  statements  does  tf//d  to  jar., 
one's  senses,"  he  said,  "possibly  causing  errors  to  be  made  in  answering  the 
questions."  — 

Nexjt,  Michael  Simon,  a  recent  graduate  of  Columbia  University's  Masters 
Program* in  International  Affairs,  who  took  the  15 AT  last  summer  wrote  ETS 
that  their  computer  had  incorrectly  marked  a  "no  answer"  In  five  places 
where  he  had  entered  a  reply.  ^ 

Similarly  a  graduate  of  Arizona  University,  now  a  New  York  resident, 
took  the  I^AT  In  February  1981-    Approximately  three  weeks  later  she  received 
a  score  of  56^  on  a  scade  of  200-800.    Several  weeks  later  she  received  a  copy 
of  the  questions  scored,  her  answer  sheet  and  the  correct  answers  to  the 
questions.    When  computing  her  score  f^m  the  information  provided  she  found 
that  her  score  was  actually  a  62^,  &)  points  higher  than  the  LSAS  had  reported. 
After  several  rechecks  she  phoned  ETS,  ,^h'i  acknowledged  their  mistake,  claiming 
a  computer  had  errored.    ETS  then  issued  corrected  reports  to  the  law  schools 
she  "had  applied  to  for  admissions. 

Without  Truth-in-Testi^^,  errors  like  these  would  never  have  been  discovered. 
In  April  1980  NYPIBC  ana  the  Committee,  In  an  effort  to  determine  the  frequency 
of  such  occurences,  s',**t  questlonaires  to  the  nine  major  testing  companies 
asking  for  information.    To  date  tney  have  received  responses  from  two 
agencies,  the  College  Board  ana  the  Graduate  Records  Exanlnatlort  Board.  Both 
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lattara  »cknowled«ed  the  inquest  and  stattd  that  further  Infowation  would  be 
forthcoaing.  Unfortunately  NYHBC  uA  th#  Coaaittee  have  received  no  further 
infoTBation. 

The  fourth  error  discovert  got  quite  a  reception,  aaking  the  ftront  ptge 
of  The  Key  York  Tiaes  on  March  17,  1961.    Danlal  I^wen,  a  17y««  Cocoa 
Beach.  Florida  High  School  styient.  proved  that  the  answer  ETS        ita  panel 
of  16  college  profeeaors  selodted  on  a  question  froa  the  October  21,  lyoi 
PSAT  w«  inferior  to  another  c^ice.   Senior  Vice  Preeident  for  Testing  ^ 
'  ?rogra««  at  ITS  told  The  Hew  York  Tlaeg  that  the  question       a   lousy  i^ea- 
Vhy  ITS  ani  the  .College  Board  kept  this  error  a  secret  for  three  nonths  still 
r««air»  unknown.   Could  it  be  that  this  informatien  could  have  h«d  a  profound 
effect  on  pendir^  legislation? 


h  MffMuM  Aaco  ani  irOM  tf«w>  le^.  «i  AMM  MC««(  kM»  POM 
•ft  •VuMlvtf  Mn#M  •!  afMl  Mm.  «  «M*  MC  Mr*  fflKN  «!  Mm 

(A)F«v*    <f)^     K)i*«i    antm  mmm 


Depending  on  whether" 
the  faces  considered 
are  those  of  the 
orlgineJL  two  solids 
or  those  of  the  con- 
bined  solid,  both 
choices  (a)  Five  and 
(C)  Seven  have  merit 
«A  correct  answers* 
Vion  the  question 
n'us  originally  scored, 
only  choice  C  was  con- 
sidered correct.  Al- 
though seven  of  the 
original  faces  renain 
exposed,  .the  solid 
that  results  if  face 
ABC  is  placed  on  ZFG 
contains  but  five 
distii^aable  faces.  - 
Sone  of  the  faces  of 
the  original  figures 
(for  eanplo,  faces  ABD 
anl  BSK  in  the  diagraa 
on  the  bottom)  lie  in 
the  sane  plane  and  fom 
a  parallclogrta  when 
the  solids  are  placed 
together.    The  diagrwi 
provides  an  iUustratloh. 


The  October  i960  PSAT  was  the  first  PSAT  ever  released  to  the  pjblic. 
This  disclosure  of  the  PSAT  was  a  result  of  a  new  College  Board  Policy, 
intxtxluced  due  to  the  increasingly  apparant  success  of  Truth-In-Testing  in 
Itew  York  and  the  impending  threat  of  the  passage  of  a  «i«il*r  bill  by  one 
of  the  many  other  states  considering  this  type  of  legisUtion. 

Mr.  Uwen's  discovery  resulted  in  2^,000  students'  test  scores  being 
uixraded.  60  additional  students  being  awarded  financial  scholarships  and 
o^lTlOO  a^itional  Otters  of  coa-endation"  beli«  awarded  by  the  multi-million 
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dollar  National  Merit  Scholarship  Progran  who  annually  awards  students  with 
high  PSAT  scores.  / 

In  addition,  the  test  Mr.  Lowen  had  taken  was  made  up  of  old  SATs. 
Robert  Moult rop,  ETS  spokesnan,  estimated  that  the  scores  of  about  80,000 
of  the  316,000  persons  who  took  tests  using  the  "lousy  item"  in  recent  years 
should  probably  be  raised  by  as  lauch  as  10  points.    Their  scores  have  never 
been  corrected. 

Mr.  Lowen's  discovery,  to  quote  a  New  York  Tines  headline,  opened  a 
"Pandora's  Box,"    The  Times  and  the  testing  companies  received  a  "deluge  of 
letters'*  suggesting  a  variety  of  new  answers  to  the  same  questions.    E.  Bevin 
Williams,  Director  of  Test  Development  at  ETS  in  response  to  queries  on  the 
legitimacy  of  alternative  solutions  presented  in  the  correspondence  said  with 
a  shrug,  "IV seems  as  if  every  answer  was  correct  except  ours." 

Just  one. week  later  on  March  23,  1981,  the  fifth  mistake,  discovered  by 
Michael  Galligan,  was  announced  by  ETS.    Galllgan,  a  senior  at  Clarkstown 
South  High  School  in  New  City,  New  York»  disco \fered  the  error  on  the  October 
SAT.    Again  the  public  was  not  informed  until  well  after  the  error  was  discovered 
and  roscored.    In  a  letter  to  ETS,  Mr.  Galligan  pointed  out  that  a  question 
abcuc  integers  o/i  the  exam  had  two  right  answers.    Despite  tdmittir^  that  Mr. 
Galligan  was  correct,  Brnest  Kimmel,  Director  of  Test  Devel^opment  at  ETS, 
declared,  "We  know  the  people  who  chose  C  (the  other  correct  answer  discovered 
by  Galligan)  were  less  ablet  they  skipped  over  the  obvious  answer."* 


Row  A 
Row  i 

Row  C 
Row  D 
Row  £ 


2 
S 
4 

5 
6 


6 
7 
2 
6 
4 


16.  Whjch  row  in  the  list  above  conttiw  bolh  the 
square  of  an  intefer  and  the  cube  of  a  difTcrent 
integer? 


(A)  Row  A    (i)  Row  B 

(D)  Row  D    (E)  Row  E 


fC)  RowC 


(or>«K,Mr  ^;  191k)  »>  rts  and  rnt  coliece  ioaiid 

A  student  pointed  out  that  (C)  should 
have  been  accepted  as  a  correct 
afusM'er.  as  well  as  the  '  officiar  (B). 
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As  a  result  of  Mr,  Galllgan's  discovery  about  16,000  of  some  8^»000 
ness  able^t«t  takers  in  Kew  York  State  ^f  their 
several  hundred  thus  qualified  for  state  scholarships  worth  $1,000  over 
a  four  year  period, 

Hr.  Lowen's  discovery,  coupled  with  Kr.  Gall«an's  caused  quite  a  disturbance 
in  the  testing  Industry.    Just  three  days  later,  the  College  Board  Trustees. 

w  th"o"*n^;Sl,«^vldence  that  openl,«  up  the  ^"tlrg  process  had^^ 
would  improve  test  quality,  not  to  mention  the  effect      ^^ese  discoveries 
wouU  ^Ton  pending  legislation,  voted  to  partially  !^^'^;t;;,ted 
Testing"  concept  natiorortde.    Their  new  policy,  however,  is  limited  to  selectea 
test  Sites  am  unUke  "Truth- in-Testin«"J,egislation,  provides  no  concrete 
gu^^entees  ?St  disclosure  will  contlnub^n  the  f\iture. 
^ote  that  College  Board  officia.l?  i^Bt  three  dws  earlier  testified  against 
Truth-in-Testin«  in  both  Massachusetts  and  Florida. 

Many  thina,  concerning  the^^ixth  and  seventh  mistakes  "'^"h  occurred 
on  the^  mldvanoed  enrineea.^  aJd  advanced  I«y<=hology  ^  stlU  ^n«^"«<»- 
Both.questio,s,  according  to  BIS.  were  not  relewed  by  the  GKE  Boj^  because 
of  the  possibiUty  of  the  questions  being  reworded  and  used  in  future  admin 
Istrations  of  these  exams.   Who  discovered  the  errors  is  also  open  to  debate. 
Mw^  mke.  New  York  Times  Reporter,  on  April  28,  1931  said  that,  "students 
fu^cl^sX  clliliSiSd-q-nSitioS  on  the  CPE."    BIS  Public  RelaUons  person. 
Marllvn  BalHs  claimed  that  both  mistakes  were  discovered  as  part  of  the 
o^olS  ^vlew  process  after  they  were  printed  and  administered.  Assuming 
Mrl  Flfke  was  correct,  students  who  had  discovered  these  mistakes  would  have 
gliJeil^  sftlsf«:tion,  for  the  GHE  Board  voted  «>t  to  change  any  incorrect 
-scores  unless  differences  of  more  than  10  points  would  result. 

Ms   Ballis,  in  referene  to  the  two  errors  remarked,  "it  was  only  a 
matter  of  four  points"  airi  "  was  not  statistically  ^"if^=^^ •jjjs''°J^=^ 
Altnan,  acting  Vice-President  for  Higher  Education  Programs  at  EIS,  in 
deftS;  of  ttS  Boards  decision  stated,  "We  continually  tell  coUeges  that 
it  is  dangerous  to  make  judgements  about  students  on  the  basis  of  10  POl"t 
differences.    If  we  sent  out  corrections  of  ^^l'  ""fPjf.f " 
everything  we  have  been  telling  them."   When  asked  about  the  GES  Board  s 
decision   Thomas  White,  President  of  the  I5AS,  remarked,  "I  wouldn't  want  to 
apply  t^  saSe^ic  ti  our  test  or  to  the  SAT.    There  are  i>^tances,  even 
if  we  do  not  consider  them  justified,  in__whlch  10  points  can  have  an  impact 
on  a  person's  educational  opportunities." 

A  recent  FTC  report  entitled  "Coaching  for  Staidarilzed  Admissions  Tests" 
roprted  that  "l*^  of  the  private  four  year  colleges  and  37.9!S  of  the  public 
"riear  colleges  respondi,«  (to  their  survey)  indicated  that  they  h^  minimum 
SAT  score  requirements  below  which  applicants  generally  are  not  considered 
eligible  foTadmission."    In  addition,  although  test  makers  . 
use  of  cut-off  scores,  prellmin«7  selection  for  National  Merit  Scholarships 
are  bas%d  on  "cut-off  scores  on  the  PSATP  Finally,  according  to  Bevln 
Willlaas,  the  testing  industry  isn't  aways  aware  of  how  test  scores  are  used. 
He  stated,  "As  long  as  there  is  any  chance  that  not  rescoring  will  affect  any 
Individual,  then  it  is  irresponsibjle  not  to  do  so. 

Of  the  23,200  students  who  took  the  February  21  J^^^^^, 
ISAT,  almost  22,O0C  had  to  have  their  scores  changed.    The  eighth  error  was 
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discovered  by  Christopher  trucks  of  BrookUntr  «*as*chus«tt»  when  he  rc*lized 
that  their  were  two  possible  mnswers  to  a  GeoMetry  question  on  the  exaii.  (see 
dl««r*a).  The  discovery  resulted  in  15,000  students*  scores  incresii^^  1,600 
scor«3  re&alnins  the  s»e,  aad  6»60O  scores  dlcreaslng. 


wh«f  Imf  jrgmf  nlJ  I*b«lf  d  b  *nd  <  rn*f  t  »  e  fighl  *r>slf  or  ii  In* 
*f9mfn»  UbfJfd  *  «nd  b  iot  ihojf  Ub*lfd  c  end  d)  «rf  known  to 

b*  oihfr  m*ngif  J  ih«i  »4ti»ly  th*  s«v*n  condifiou.  but  lot  wh*ch 
*hf  tengih  XY  »  not  5  Th*  p«t»on  who  mtif  the  miti«i  mqwv 
PQintf  d  out  onf  juch  CAM  Ihc  Figure  3)  In  ihtt  c«s«  {in« 
xgTTKnn  Ubf If d  t  And  d  «if  noi  p*r*lJfl.  «nd  ihf  Jfngth  XV  » 
^3'TP  +  >Trr  =  vT3  +  v'2  whKh  IJ  ST«t*r  lh*n  5 
Ihf  iV  «rf  c«s«>  /oT  which  the  Jf  ngih  XY  it  5  «nd  oih«r  c«s«)  tor 
whKh  thf  tengih  i>  not  5,  thf  «n}w«r  (o  (he  question  it 
*ppf*T*d  1}  lOi.  Ih*t  iJ.  (hf  rfUtKjnjhip  (*nnot  t*  d<Jfrminfd 
ffom  Ihr  iftformAtionqivrn 


Three  days  after  the  alstalce  was  reported*  the  ISAC,  vhich  represents 
I7l  law  schools »  approved  by  the  Aaerlcan  Bar  Association  and  is  sponsor  of 
the  I^AT,  announced  drastic  chans«s  in  the  stntoture  and  scoring  of  the  IS  AT, 
Accorilns  to  the  Associated  Frees t  beelnios  in  the  suwier  of  1982  studients 
taklns  the  Z£AT  wuld  no  longer  be  required  to  ccrrect  uncraaaiical  sentences 
or  solve  geonotry  and  other  ''quantitative"  aath  questions.   Also  the  seal  used 
to  report  I5AT  scores  (200-800)  would*  be  replaced  by  a  scale  ranglr^  fron 
10-50.   Bruce  Zlaner  explained  the  council's  actions  are  an  effort  to  "discourago 
the  use  of  s»all  score  differences  to  shape  adjilssloi«  declsionc."   It  is 
Important  to  note  Wiat  generally  law  Schools  plac  60  to  70  p«:  cent  of  their 
enphasls  in  adAissions  on  LSAT  scores.    Only  30  to  ^  per  cent  is  placed  on 
other  criteria,  Uke  CPA  and  extra-curricular  activities. 


EXPLANATION 

FijVirC  1  >how\  qvf  M'Vn  23  *>  fi  *pp«*rcd  on  ihf  L5AT  ThiJ 
quffftion  «nvo(vff}  ^hf  <.omp«itson  d  twv  qu«ntiltf»  ihr  Ifn^th  o( 
XY  «nd  ihff  tntrgcr  5  Thr  cifd.ifd  tfipomt  to  ihf  qurxivn 
id  (hat  n.  th»\  rhff  twv  c^uAnMif )  «tf  f qu«l  The  mtrnt  oi  (hr 
question  w«)  to  h«vc  thv  ^.in^i^^J4t*  abw^t  (h^*.  d  Inf  S^^Tifrtlt 
Ubrtffd  »  «nd  d  w/frf  rxtf  rdrd  (hey  would  mf f t  >n  e  r>9hl  tn^if 
and  (ofm  «  ns^t  uutngic  with  hypotf ruf«  oi  length  XY  «nd  »»df  > 
ol  Jfngh  *-f  b«4»nd  c-fd»3  is«*  F>gw*  2)  Th«  Jfrglh  XY 
would  thrn  b«  v^TTT^  >'2S=  S  «nd  ihr  tntwcr  would  b«  (Cl 

Thit  mioning  n  cofrrci  it  m«ny  ptvplt  «»umfd  from  <hf 
w«y  ihr  figure  n  dr«wr.  thf  Argtf  b«ti*f fn  thf  two  tritngif ) 
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EEMISTIFICATIOK 


Truih-m-Testlng  legislation  in  New  York  is  also  having  a  positive  impact 
on  the  availabiUty  of  quality  test  preparation  courses  to  low  income  and 
«?r^^ty  t^sfSeL.    Patrick  Shields  of  the  East  Harlem  ^^ll^-^.^^^^f,,,,^^ 
Sounsellng  Pxx>gran,  a  federally  furled  organization  ^^"^j^f 
assistanct  to  college  airi  career  bound  f  "^^"^''u^v,      fS^^^M  JhAa^als 
.week  coaching  course  for  program  participants.    He  characterized  the  ^*V«^als 
"Sla^^e  prior  to  the  enaction  of  the  law  (published  commeici^  materials  and 
ETS  sample  booklets)  as  of  questionable  value.    There  was  a  very  limited 
nuaber  of  sample  items  of  which  many  were  of  perhaps  little  value. 

Due  to  the  enaction  of  the  law,  Mr  Shield  maintains  that  having  realistic 
SAT  items  available  has  enabled  him  to  do  a  "better  job.      students,  ne 
descri^,  "feel  more  comfortable  about  taking  the  tests  now  that  they've  had 
their  hands  on  the  real  thing." 

Jeannette  Burgos-Servedlo,  Head  Counselor  of  Talant  Search,  also  feels 
that  Truth-In-Testing  is  providing  information  to  her  which  helps  her  to  do 
a  bettor  job.    In  a  letter  to  the  Committee  she  statest 

At  the  request  of  students  in  our  program,  we  at  Talent 
Search  Program  of  Bronx  Community  College  sponsor  an  SAT  coaching 
course  ever  academic  year.    Presently,  we  charge  the  students 
$10  for  an  average  of  eight  two-hour  sessions.    We  are  now  in 
the  process  of  writing  the  course  into  our  project  so  that  we 
an  offer  the  course  at  no  cost  and.  therefore,  make  the  course 
available  to  an  even- greater  number  of  our  student  population. 

Throughout  the  1980-81  academic  year,  we  had  four  sessions, 
and  He  got  a  opportunity  to  use  actual  SAT  tests  with  the  students 
in  the  last  session.    Their  responses,  in  comparison  to  tnose 
students  who  only  got  an  opportunity  to  use  sample  tests,  were 
nore  positive.    They  felt  that  having  had  an  actual  test  before 
then  helped  not  only  prepare  them  more  adequately  for  the  ^an. 
but  they  also  felt  that  the  level  of  familiarity  they  gained 
by  having  the  test  would  help  relieve  much  of  the  anxiety  they 
would  have  gone  into  the  exam  with.    This,  in  turn,  would 
enhance  their  chance  of  obtaining  a  better  score. 

As'  a  counselor,  I  feel  that,  regardless  of  what  others  may 
feol  about  coaching,  coaching  does  help  o.ur  student  peculation. 
That  popiilaiOon   being  predominantly  low  income,  minority  students. 
Coaching  for  these  students  gives  them  an  opportunity  to  Ijarn 
test  taking  techniques  they  do  not  necessarily  Pick  up  in  the  hl«h 
schools.    It  also  raises  their  level  of  confidence. 

According  to  Luis  DeGraffe,  of  the  Puerto  Rican  Legal  Education  and 
Defenao  Fur^  which  administers  a  coaching  course  to  about  60  l)aw  scnool 
c^Wateslvery  year,    Truth-in-Testir«  heli«  his  students  in  two  major 
ways  I 
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1.  students  vho  take  the  ex«M  nore  than  once  are  enabled  to  see  what 
ptrt  of  the  exaa  they  are  wealcest  in.    They  ctn  then  prepare  accordinsly* 

2.  it  enables  tis  to  institute  a  simulation  of  a  test  situation.  This 
can  help  to  relieve  much  of  the  test  anxiety  which  students  generally 
experience., 


The  ultimate  solution  to  the  problem  of  disclosure  is  for  the  federal 
goverwtent  to  enact  a  nation-wide  "Truth-in-Testir«"  law.    This  will  eliminate 
the  difficulties  the  testir^  industry  faces  having  to  comply  with  a  variety  of 
forms  of  state  legislation  and  the  costs  incurred  thereof.    In  addition, 
students  now  and  in  the  future  will  be  assvured  that  the  testir^  process  is 
conducted  in  a  fair  and  open  manner.  / 
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APPgNDIX  A 


Coaching 

In  late  1976,  the  Boston  Regional  Office  of  the  Federal  Trade  Commission 
(FUC)  be^an  an  industry-wide  investigation  into  the  validity  of  claims  nade 
regarding  the  effectiveness  of  coaching  for  standardized  adnissions  tests. 
They  subpoened  th«  files  froa  all  of  the  coranercial  coaching  schools,  as  well 
as  frora  the  testing  companies.    Ironically,  although  their  "investigation  was 
spawned  by  concern  that  connercial  coaching  schools  were  Misleading  prospective 
students  by  deceptive  claias,"    they  found  the  opposite  to  be  true.    In  iact, 
they  reported  that  students  who  took  a  coaching  course  before  taking  the  bAT  a 
second  time,  score  100  points  higher  than  those  students  who  sinply  retook 
the  SAT  without  taking  a  course.    Additionally,  research,  including  some  done 
by  ETS,  has  shown  that  coaching  iaproves  Minority  students'  scores  the  most  — 
yst  minority  students  are  probably  the  least  able  to  attend  coaching  schools, 
which  cost  as  nuch  as  ^350. 

In  the  Spring  1930  Harvard  Educational  Review,  Drs.  Warner  Slack  and 
Douglas  Portor  of  Harvard  Medical  School  report  in  "The  Scholastic  Aptitude 
Test!    A  Critical  Appraisal"  that 

In  publications  sponsored  by  ETS  or  the  College  Board, 
woe  found  nine  cinclusions  that  studies  to  date  had  demonstrated 
coaching  to  be  ineffective,  even  though  the  published  exper- 
imental evidence  indicated  the  contrary.    We  also  found  seven 
assertions  that  gains  In  scores  fron  coaching  were  no  signi- 
ficant, although  they  were  statistically  significant. 

The  Harvard  suthors  concluded  that  thei 

Educational  Testing  Service's  technical  and  pronotional 
publications  are  characterized  by  omlssloriS  and  mis  leading 
otatenents.    They  have  enhanced  the  product's  Image  at 
the  risk  of  the  students'  sjelf-esteea.    The  students* 
trust  has  been  broken. 

In  iddition.  Slack  and  portor  came  across  a  1968  EIS/CEEB  booklet  titled 
"The  Effects  of  Coaching  on  Scholastic  Aptitude  Scores."    This  booklet  summarized 
seven  studies  of  coaching  programs  which  failed  to  produce  significant  score 
gains.   'It  conveniently  did  not  mention  a  College  Board  sponsored  study  at  the 
U  S   Military  Academy  w^dch  showed  a  coaching  gain   of  136  points  on  the  SAT. 
The  studies  which  the  booklet  did  choose  to  report  invloved  coaching  programs 
substantially  shorter  and  lessintense  than  those  offered  by  the  commercial 
ciachlng  schools.    The  Harvard  researchers  stated  that,  "there  is  ample 
evidence  that  students  can  successfully  train  for  the  SAT"  and  that  such 
evidence  was  available  at  the  time  the  College  Board  booklet  was  published 
in  1968. 

In  19?2,  ETS  researchers  Dr.  Louis  Pike  and  Dr.  Franklin  Evans  analyzed 
the  studies  cited  by  the  booklet  on  coaching  for  the  SAT  math  section.  They 
concluded  that  ETS'  unequivocal  denunciation  of  coaching  was  hazardous. 
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Yet  ETS  continued  to  distribute  this  pamphlet  until  last  year. 

Despite  convincing  evidence  of  the  effectiveness  of  coaching  courses, 
the  Federal  Trade  Comnission  report  contended  that  the  College  Board  and 
ETS  "continued  to  indicate  that  special  preparation  was  unlikely  to  be  of 
significant  benefit." 

Taking  the  SAT,  a  student  guide  published  by  the  College  Board,  nade  the 
follOKlr^  statement: 

The  verbal  and  mathematical  abilities  measured  by  the  SAT 
develop  over  years  of  study  and  practice.    Drilling  or 
last-mlnute  cramming  probably  will  not  do  much  to  prepare 
you  for  the  icac,    However,  if  you  are  not  taking  a 
mathematics  course,  a  review  of  mathematics  concepts,  such 
as  those  given  in  this  booklet,  will  be  useful. 

"The  Student  Bulletin  1979-1980"  addressed  the  coaching  question  in 
three  sentences* 

Before  the  test  date,  read  the  appropriate  descriptive  booklet. 
Taking  the  SAT  tc  About  the  Achievement  Tests,    which  will  give 
you  a  better  understanding  of  the  test.    Studies  have  shown  that 
cramlng  does  not  raise  scores,  but  knowing  what  to  expect  can  be 
helpful.    A  good  night's  sleep  and  a  nourishing  breakfast 
before  you  take  a  test  are  also  helpful." 

The  FTC  study  concluded  that  the  1979-1980  SAT  materials  "did  not  appear 
to  fully  appriae  students  or  educators  of  the  possible  benefits  of  coachlr^," 


Stiident  Search  Service  (SSS) 


In  1979  ETS  and  CEEB*s  most  profitable  activity  was  the  CEEB  owned,  HITS 
operated  Student  Search  Service  (sSS).    Last  year  the  SSS  sold  naillr^  lists 
con-laining  over  22  million  names  and  addresses  to  1600  cllencs.    SSS  collects 
its  lists  from  the  forms  the  1.8  million  high  school  students  fill  out  when 
they  take  any  one  of  the  fourteen  CEEB  sponsored,  ETS  developed  multiple- 
choice  college  entrance  "aptitude"  and  "achievement"  tests.   ETS*  1979-1980 
Scholastic  Aptitude  Test  (SAT)  promotional  booklet  informs  students  that  thej 

College  Board's  Student  Search  Service  is  an  information  service 
for  students,  colleges  and  gaiverniienlal  scholarship  programs. 
It  is  free  (their  emphasis)....  and  worfcs  this  wayr 

If  you  ask  to  participate,  college  and  scholarship  agencies  * 
interested  in  students  with  your  characteristics  can  ask  for  and 
receive  your  name,  address,  sex,  high  school  and  intended  major. 

Somehow  ETS  and  CEEB  forgot  to  inform  high  school  students  (or  their 
parents)  thati 

♦  the  SSS  considered  the  Defense  Department  to  be  a  governmental 
scholarship  agency. 
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*  the  Kwapap^r  Funi,  Inc.,  a  fouttUllon  afflUalad  with  The  Dow  Jonee, 
Inc.,  the  owner*  of  the  V>U  Street  JourrMa,  was  also  considered  to 
be  a.govermental  acholaxshiv  as«acy.  ^ 

*  besides  the  characteristics  cited  above,  the  SSS  also  provided  Its 
cUents  with  Inforsatlon  concerning  the  atudents'  race,  soclo-econoaic 
status,  and  test  scores* 

*  their  nanee  were  «olr«  to  be  sold  at  a  larg?  profit.    In  FY  1979-80, 
the  SSS  sold  lists  containing  over  22  Million  na«es,  earned  BTS/CEEB 

over  $2.7  ailHon  in  revenue  and  $2.1  aillion  in  "non-profits" 
(excess  incoae  over  expenditures  ). 

In  late  I960  ITS/COT,  r«actlr«  to  legal  action  brought  by  the  Coaalttee 
in  a  Brooklyn,  Mew  Yoi*  federal  court,  started  informing   students,  .for  the 
first  tine,  that  they  will  be  categorized  by  ethnic  background  and  fanily 
income.    Today's  tTS/CEEB  solicitation,  however,  does  not  Inform  students  that 
their  names  will  be  provided  to  the  mlUtary  or  that  the  non-profit  corporations 
sell  (at  a  lai«e  profit)  the  Infoimatlon  they  provide    (see  Testing  Digest, 
Vintir  1981,  pages  1-3  in  Appendix). 
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Appendix  jfc  -  Miif  kei 
In  1974,  Jean  Kerr,  ETS  director  of  Testing  fervicei,  itated: 

I  think  that  in  termi  of  our  reporting  and  our  processing, 
we  have  been  virtually  one  hundred  per  cent  correct.... 
I  would  say  over  the  past  few  years,  at  least  in  my  associ- 
ation with  this  division  of  operations,  and  that's  "*lly 
what  I  speak  to,  there  have  been  virtually  no  errors. *'* 

In  the  following  year, Jernard  Tehorni,  ETS  Vice  President  in  charge  of 
operations,  was  asked,  "What  percentage  of  the  reports  that  you  send  out  are 
free  of  error?"    He  responded,  "Free  of  error?    One  hundred  per  cent. 

In  November  1976  ETS  Executive  Vice  President  Robert  Solomon,  testifying 
before  the  Privacy  Cooiission  was  "asked  specifically  and  repeated  about 
'errors  that  might  be  correctable  if  students  had  access  to  their  ETS  files. 
He  responded  that  to  the  best  of  our  experiences,  ETS  doesn't  make. mistakes 
so  no  corrections  would  need  to  be  made. 

What  follows  are  brief  descriptions  of  over  a  dozen  scoring  errors  and 
reporting  errors  effecting  nearly  a  quarter  million  students  that  have  occurred 
since  1972.    These  descriptions  were  obtained  from  press  clippings  people 
have  mailed  to  The  Committee  during  the  past  three  years.    In  all  liklihood 
a  more  systematic  approach  to  discovering  errors  would  have  uncovered  mistakes 
affecting  thousands  more  students  opportunities  for  graduate  and  professional 
school. 

What  disturbs  me  about  the  following  mistakes  is  not  that  they  occurred— 
foj;  mistakes  will  always  happen,  but  test  publishers  seeming  inability 
to  reci'lfy  mistakes  once  they*ve  been  made,    Truth-in-Testing  will  help 
remedy  this  situation  by  giving  students  access  to  the  information  they  need 
to  verify  that  thtir  tests  were  scored  correctly. 

Error  1  \ 

In  January  1973,  the  Educational  Testing  Service  (ETS)  Informed  Harvey  Block 
that  he  had  s^cored  a  270  out  of  a  possible  800  on  the  Graduate  Records  Examin- 
ation (ORE)  In^ Advanced  Psychology,  taken  in  December  of  1972.    Harvey  Block,  then 
a  senior  at  Yei^iiva  University,  majoring  in  Psychology,  with  a  3.92  grade 
point  average.  Was,  to  put  it  mildly  shocked  by  his  low  score.    He  inmediately 
called  ETS  requesting  that  they  rescore  his  exam.    ETS  initially  responded  that 
they  did  not  make  mistakes  or  rescore  exams  and  that  many  people  thought 
they  would  receive  higher  scores  than  they  actually  achieved.    Mr.  Block 
was  persistent  and  inflate  January  1973,  ETS  agreed  that  within  a  week  they 
would  rescore  his  exam,    The  following  week  Mr.  Block  contacted  ETS  only 
to  find  that  no  rescore  >ad  occurred  and  again  received  a  similar  assurance  from 
ETS  that  a  rescore  would  vsoon  take  place.    Mr.  Block  taking  no  chances  followed 
this  up  with  a  written  request. 

Some  time  between  February  14  and  February  23,  1973,  ETS  upon  rescore 
found  that  an  error  had  occurred  and  Mr.  Block *s  correct  score  was  a  570, 
three  hundred  points  higher  than  what  was  Initially  reported. 


*Sce  The  Reitn  of  ETS  by  Allan  Nairn     R^lph  Nader 
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In  mid-March  1973,  Block  received  notification  of  the  score  revision. 
Included  was  a  list  of  schools  to  whom  corrected  scores  were  sent.  Block 
discovered  that  the  revised  score  had  not  been  sent  to  over  half  the  schools 
he  had  applied  to.    During  this  period  Block  received  several  rejections 
letters-  from  many  of  the  schools  that  had  not  received  hia  corrected  score. 

On    December  13.  197A.  Mr.  Mock,  who  is  currently  a  doctoral  student 
in  New  York  University's  Social  Psychology  Program,  filed  a  lawsuit  against 
ETS  seeking  damages  for  income  lost  due  to  his  inability  to  enter  «  doctoral 
program.    On  November  17.  1979  Block  lost  his  case.    ETS  admitted 
mis-scoring  Block's  test,  but  successfully  argued  that  he  might  not  have 
been  admitted  to  the  graduate  program  even  if  his  scores  had  been  correctly 
reported.    During  the  trial  ETS  Director  of  Higher  Education  Programs, 
Robert  Altnan  stated  that  Block's  answer  sheet  was  mts-scored  because  Block 
grldded  th{  second  letter  of  his  last  name  incorrectly  on  his  answer  sheet 
as  "1"  instead  of  "1"  and  provided  an  incorrect  registration  number.  In 
th«  process  of  making  the  two  corrections  an  ETS  clerk  also  revised  the  number 
indicating  the  specific  form  of  the  test  taken  by  Block  (which  was  entered 
correctly)  to  an  incorrect  number.    Altman  continued  that: 

/'Although  we  do  not  know  why  this  action  vas  taken,  it  caused 
an  incorrect  scoring  key  to  be  applied  to  his  answer  sheet, 
with  the  resulting  incorrect  score.    The  quality  control  pro- 
cedures described  did  not  uncover  this  error,  probably  because 
of  the  low  incidence  of  similar  errors  at  this  administration 
date»  none  of  which  had  been  identified  as  quality  control 

Yet  Altman  later  went  on  to  state; 

"In  addition  to  the  mis-grading  of  Mr.  Block*s  answer  sheet, 
ejeven  other  answer  sheets  for  the  Advanced  Test  in  Psychology 
administer<id  on  December  11.  197.:  were  mis-graded." 

When  questioned  by  Block's  attorney  Irt  1^75.  ETS  cloimed  that  they  could 
no  longer  identify  or  , produce  information  about  the  other  eleven  scoring  errors 
or  whether  these  test-takers  had  been^  notified  of  the  error. 

Block  can  at  .least  be  thankful  that  ETS  discovered  his  mistake.  What 
happens  when  the  t^^st  publisher  doesn»t  find  the  mistake.    Equally  disturbing  is 
what  happen*  to  a  student  who  skips  .  question  on  a  multiple-choice  test, 
but  doesn't  skip  the  corresponding  SRace  on  his/her  answer  sheet.    Such  clerical 
errors  are  ail  to  easy  to  make  .on  spe'bded  multiple-choice  tests,  especially  when 
a  student  is  under  pressure. 

Truth-in-Testing  legiaiatlon  will  grant  Connecticut  test  takers  the 
same  rights  New  York  students  now  enjoy  -  the  ability  to  make  sure  that  their 
teat  was  properly  scored  and  that  they  filled  in  their  a^er  sheet  correctly. 

Trenton  Times.  N.J. .  11/16/79,  Superior  Court  of  New  Jersey  Uw  Division  - 
Mercer  County,  Docket  No.  L-13177-7A  (Civil  Action  Interrogatorlos) 
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Error  2  '  ^ 

■   ETS-  1975  and -1976  Law  School  Admissions  TMC  (LS/.T)  registration  f^ra 
asked  students  whether  they  have  taken.the  test  before     This  question  appeared 
aoong  a  scries  of  general  clerical  questions  f ""^  '° 

Applicants  had  no  way  of  knowing  that  failure  to  indicate  that  they  had 
taken  the  test  before  (whether  'by  answering  the  question  Incorrectly  or 
Bcrcly  leaving  it  blank)  was  Important. 

The  reason  for  asking  this  question  wa.  not  clerical     ETS  researchers 
had  found  out  that  students  who  retook  a  Wst.  Improved  ""i' 
by  an  average  of  30  points.    The  Increase  occurred  because  these 
were  now  «re  familiar  with  the  test's  format.    It  should 

this  time  ETS  official  position  wa,  that  coachl.ig  would  not  Improve  students 

ce.?c  scores. 

According  co  the  February  5,  1977  Nrw  Republic; 

•Hitj  test  score  report  form  sent  to  law  schools  contalned- 
unbeknownst  to  the  student  who  was  paying  to  have  this  Infor- 
*  taatlon  sent  -  a  space  labeled,  "unacknowledged  repeater.  . 

Wlien  this  space  was  marked  by  an  asterisk,  it  Indicated  chat 
<!  candlrjatc  applying  to  take  the  test  for  the  '»ey:ond  tine  had  not 
indicated  that  this  was  the  case.    The  asterisk  appeared  even  it 
a  candidate  (possibly,  by  accident)  failed  to  answer  the  question  ^ 
at  all.    Ralph  Smith,  a  professor  and  admissions  committee  rncn- 
ber  at' the  University  of  Pennsylvania  Law  School,  explained 
that  the  "unacknowledged  repeater"  designation  raised    a  question 
of  (the  applicant's)  Integrity."    A  number  of  other  law  school  , 
admission  officers  confirmed  that  this  was  the  construction 
admissions  committees  put  on  the  asterisk. 

Smltji  and  several  others  think  the  appearance  of  the 
aste'rlsk  kept  some  appllcant^ut  of  law  school.  Of 
course  there  are  such  a  variety  of  reasons  an  admissions 
coianittee  can  give  for  denying  admission  to  any  one 
applicant  that  it  Is  all  but  impossible  to  prove  chat 
anyone  was  excluded  because  of  being  designated  an 
"unacknowledged  repeater." 

In  the  1975-76  applicant  year,  the  dean^of  admissions 
at  Che  University  of  Pennsylvania  Law  School  noticed  that 
more  and  more  of  theae  asterisks  were  appearing  on  LSAT  score 
reports.    He  reported  this  to  ETS  and  asked  whether  the 
designation  was  correct  In  all  these  caaes.  Shortly 
thereafter  ETS  responded  with  a  memo  «ent  to  all  law  school 
admissions  deans,  which  read  in  part:  ^ 

It  has  recently  become  apparent  that  a  problem 
exists  with  regard  to  the  flagging  of  candidates 
as  "unacknowledged  repeaters"  (an  asterisk  In 
the  area  under  "Unacknowledged  repeater"  in  the 

ft 


14 


142 


iiMUtry  ««ctlon- of.  reports).    Thin  problem  hat 
been  c*ui«d  by  tevertl  factor*,  tOBe  ofy which  rtlte 
policy *que*tlon*  which  will  b«  contiderid  next  aprlnj. 
The  result  for  the  current  ye»r,  however, 1»  that  ^ 
soae  candidate*  who  are  not  "unacknowledged  repeaters 
have  been  dealgnated  aa  such. 


The  neao  warned  that  the  designation  should  be  disregarded  and  ^ 
explained  that  "it  will  not  be  possible  to  identify  all  such  candidates" 
^(those  wrongly  identified  as  "unacknowledged  repeaters") - 

There  are  .several  disturbing  things  about  this  incident.    Fiist  of 
all,  since  applicants  have  had  no  way  of  knowing  that  th<  "unacknow- 
ledged repeaters'*  designation  existed,  discovery  of  this  error  de- 
pended on  the  fortuitous  curiosity  of  one  admissions  dean.  Second, 
since  applicants  are  not  permitted  to  aee  the  reports  ETS  sends  to 
law  achools,  individuala  would  have  had  no  way  of  clearing  thenselves 
of  falae  charges  even  if  they  had  known  that  the  problem  existed. 
Third,  even  after  the  error  was  discovered,  ETS  kept  it  quie^  ^r.t* 
apparently  nad«  no  attempt  either  to  correct  its  past  mistakes  or 
to  inform  the  applicants  who  were  harmed  hy  them.    In  short,  candi- 
datea  who  were  perfecr^y  acceptable  may  have  been  denied  access 
to  their  chosen  profession  without  ever  suspecting  the  reason., 

ETS  avoided  any  mention  of  the  "unacknowledged  repeater"  incddent 
io  teatimony  at  a  Privacy  Commission  hearing  in  November,  Robert 
Solomon,  vice  president  of  ETS,  was  asked  specifically  and  repeat- 
edly about  errora  that  might  be  correctable  if  students  had 
^        access  to  their  ^TS  files,  but  he  failed  to  mention  th4  asterisk 
episode  and  insiated  that  ETS  errors  were  "to  the  best  of  our 
'experience"  no  problem. 

o 

Kim  Masters,  "ETS's  Star  Chamber."  New  Republic.  February  5,  1977 
Error  3 

ETS  changed  the  content  of  the  Law  School' Admlsaion  Test  (LSAT) 
between  the  July  and  October  1977  adminiatrations,  apparently 
without  notifying  che  nation's  law  schoola.    The  reau^t  was  that 
nearly  twice  as  many  atudents  scored  750  or  better  in> October 
than  July,  with  triple^  the  number  of  perfect  300  scores  reported. 
Law  achools  with  rolling  admissions  policiea  (that  is,  admitting 
applitiints  when  the  application  ia  completed  as  oppoaed  to  waiting 
for  a  set  date  to  look  at  all  the  applications  at  the  same  time^ 
admitted  atudenta  on  the  fklae  aaaumption  that  LSAT  f cores  from 
October  1977  meant  the  aame  tning  as  those  from  July  1^77  and 
earlier.    Students  who  took  the  LSAT  in  July  1977  or  earlier  were, 
in  effect,  penalized  in  terma  of  their  chances  for  ad^iasion.  The 
acore  variances  weren't ^explained  to  law  achools  by  ETS  until 
February  1978. 

Comey  Winfrey »  "Keviaed  Uw  School  Teat  Leads  to  Diaputc,"  New  York  TlmeJ 
«/28/7a.  p.  A23.  ^  ^ 
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Error  4 


In  Mav  1978,  the  Anerlcan  College  Testing  Progran  (ACT),  which  ad- 
nlnisters  the  Medical  College  Adnisslons  Test  (MCAT),  wrote  to 
medical  schools  to  Infona  themrthat  the  MCAT  scores  they  had  been 
sent  were  incorrect.    Due  to       error  in  the  scoring  key  sent  to 
ACT  by  the  MCAT  development  agency,  the  scores  of  roughly  90  per- 
cent of  the  cesc-takers  were  coo  low. 

Maxwell  Gould,  "MCAT  Scores  Fall  fron  Past  Level,  Pronpt  Rcgradlng," 
Harvard  Crimson.  5/19/78,  p.l. 


Error  5 


ETS  nisscored  over  50,000  Graduate  Management  Admissions  Tests* 
(CMAT)  taken  In  November  1977.    Before  ETS  corrected  the  mistake 
numerous  business  schools  had  mailed  out  letters  of  acceptance 
And  r<»1f»ction, 

J.  Wvatt  Eraaerlck,  "Error  in  C^^T  Scores  Affect  Applications,"  Harvard. 
Crlnson,  January  18,  1978,  p.  1. 

Error  6  <^ 

Several  South  Carolina  school  districts  require  teachers  to  pass 
ETS'  :;aclonal  Teacher.s  Examination  (NTE)  as  part  of  the  job 
certification  process.    In  1977  a  South  Carolina  teacher  was 
flrod  because  ETS  Incorrectly  reported  that  her  NTE  test  score 
was  below  thu  school  district's  passing  rate.    ETS  corrected  Ics 
error  in  1979,  but  the  teacher  was  out  of  work  for  eighteen 
cx)nths  due  to  the  mistake** 

Spring  1980,  Testing  Digest,  p.  2 

Error  7,8,9 

Kenneth  Drexler,  the  President  of  the  Student  Government  Association  of 
North  High  School  In  Great  Neck,  New  York,  explained  to  the  U.S.  House  Commictee 
on  .Education  and  Ubor  three  mistakes  that  occurred  in  his  school  In  1978: 

Our  school  has  gotten  involved  in  the  question  of  the  testing 
Industry  and  the  truth  in  testing  bill  primarily  as  a  result  of 
several  Incidents  which  occurred  at  out  schools.    There  were  e.rrors 
made  by  the  Educational  Testing  Service.    I  described  them  In  my 
testimony  and  have  given  them  titles.    They  are  not  official  titles  but 
are  used  to  give  Identification  to  the  incidents. 

First,  rhe  case  of  the  missing  paper  and  the  duplicated  test. 

^In  I97t>  the  Great  Neck  school  district  notified  ETS  that  a  test 
booklet  of  a  SAT  exam  was  missing.    It  subsequently  developed  that 
tho  missing  booklet  wa<  taken  by  a  Great  Neck  teacher  who  made 
copies  and  used  it  to  give  students  practice  in  caking  the  SAT  test?. 
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There  was  no  question  but  chat  what  the  teacher  did  was  Illegal, 
but  the  test  was  used  for  purposes  of  coaching.    Other  exaraple^s  are 
reported  as  missing  and  such  tests  should  never  be  repeated.  The 
teacher  never  contemplated,  even  as  a  retaote  possibility,  that  ETS 
would  repeat  the  same  test. 

When  ETS  unaccountably  did  repeat  exactly  the  same  test  only  2 
years  later,  almost  50  Great  NecJC  students,  fewer  than  5  of  whom 
had  even  seen  the  earlier  test,  had  their  scores  invalidated.  ETS 
promptly  brought  a  suit  of  copyright  infringement  against  the 
teacher  which  was  subsequently  settled  out  of  court. 

No  justice,  however,  was  available  to  the  50  Great  Neck  students 
whose  tests  were  invalidated  due  not  to  any  fault  of  their  own  but 
to  the  gross  inefficiency  of  ETS  in  repeating  a  test  when  a  copy  had 
been  reported  missing. 

The  October  weekend  fiasco:    ETS,  to  its  credit,  is  aware  that 
some  students  observe  Saturday  as  their  Sabbath,  and  it  gives  such 
students  the  option  of  taking  its  exams  on  Sunday. 

On  Sunday,  October  29,  1978,  13  Great  Neck  North  students  took  the 
PSAT  exans.  Incredibly,  ETS  administered  to  then  exactly  the  same 
test  that  was  given  to  their  classmates  on  Saturday,  October  28. 

The  rct>ults;    (1)  The  National  Merit  Scholarship  Corp.  disqualified 
the  results  of  the  13  students  who  took  the  Sunday  exam,  and  (2)  to 
ro.ike  amends,  ETS  asked  the  NMSC,  which  bases  it  scholarship 
awards ^on  a  formula  based  upon  PSAT  scorers,  to  use  the  regular 
SAT  scores  which  the  13  students  obtained  the  following  spring  in 
making  the  scholarship  awards. 

This  has  caused  protests  from  others  who  claim  that  the  scores 
on  the  regular  SAT's  are  generally  far  better  than  those  on  the 
JpSAT's,  that  the  two  are  not  comparable,  so  that  in  the  words  of  a 
school  newspaper  editoriAl,  "It's  like  comparing  apples  and  oranges, 
or  more  appropriately,  it's  like  comparing  responsible  organizations 
to  irresponsible  profitmaking  groups  such  as  the  ETS.    It  just 
cannot  be  done." ^  ' 

How  to  demolish  a  student's  college  prospects:    ETS  permits  a 
student  to  cancel  an  exam  by  filling  out  a  cancellation  report  when 
he  turns  In  his  test  paper.    If  he  does  so,  ETS  promises  that  it  will 
not  grade  the  exam  nor  nake  any  report  thereof. 

One  of  the  better  students  who  had  been  rejected  by  some  colleges 
later  discovered  thaC* £T3  had  reported  to  all  colleges  to 
vhx^h  he  applied  the  results  of  an  exam  which  he  had  canceled 
after  cotspleting  fewer  than  half  the  questions. 

Tlierc  is  no  way  to  ascertain  how  substantially  this  ETS  blunder 


\ 
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affected  the  dccUlon*  of  the  colleges  frota  which  he  was  rejected. 
But  how  do  you  nakc  restitution  to  this  student?    One  aust  surely 
speculate  as  to  how  nany  tines  this  has  happened  and  gone  undis- 
covered. 

All  three  of , these  events  occurred  in  one  school  with  a  population 
of  1,200  students  In  1  year's  tine. 

.    Truth'ln-Testlng  Act  of  1.979,  The  Educational  Testing  Act  of  1979,  Hearings 
before  the  Subcoaalttec  9,n  Elcaentary,  SMondary  and  Vocational  Education 
of  the  Coanlttee  on  Educjitlon  and  Labor  House  of  Representatives- 96  Congress, 
October  11,  1979.  |t 
I 

Error  10  j 

In  1979,  National  Evaluation  Systeas  of  Aaherst,  Massachusetts,  made  a  re- 
porting error  on  the  scores  of  New  Jersey's  ninth  grade  reading  test.    The  error, 
.1  of  a  percent,  raadc  the  difference  In  1,300  students  falling  or  passing  the 
test.    The  coapany  notified  school  districts,  who  then  had  to  notify  students 
and  parents.    Before  thi.s  process  was  «.^>n>pletcd ,  many  students  had  already  been 
told  they  had  failed  the  test. 

(Tg^iging  Digest.  Winter  1981,  p.  15) 

Error_n 

In  February  1979,  a  graduate  of  the  Georgetown  Law  Center  took  the  Maryland 
bar  exaainacion.    P-irt  of  this  examination  consisted  of  the  Hultlstate  Bar 
Examination  iMBE) »  a  standardized  test  administered  by  ETS.    In  April  1979  the  student 
was  told  that  he  had  failed  the  bar  exan  and  would  have  to  take  It  again  If  he 
wanted  to  pa5&.    A  few  oonths  later  ETS  Informed  the  student  that  when  someone 
was  conducting  a  randoo  quality  control  check,  they  discovered  a  "crinkle"  In 
his  answer  sheet.    This  had  covered  P«rt  of  the  answers  the  student  had  made,  and 
the  computer  had  scored  that  portion  as  all  Incorrect.    When  the  test  was  rescored 
by  haA4  ETS  found  that  the  student  had  actually  passed  the  test.    ETS'  Director 
of  Public  Relations  told  Ncwsdny  that  "to  hU  knowledge  (this)  was  the  first  tine 
a  mechanical  error  (had)  interfered  with  the  accuracy  of  computer  corrections. 

"In  Short:    Wrinkled  by  a  Crtnkle'\ii«iiii!*^  July  31,  1979.  part  11,  p.  2 

Error  12 

The  Washington  Post  reported  that  ETS  lost  the  answer  sheets  of  163  Mongooery 
County.  Maryland  high' school  seniors. 

Spring,  1980  Testing  Digest,  p.  U) 

Error  13  \ 

"A  !•  iky  watermaln '  according  to  an  ETS  spokesperson,  caused  a 
cor.uter  to  fnil  to  send  thousands  of  students  admissions  ticket? 
for  the  October  13,  1979  Law  School  Admissions  Test  (LSAT) . 

ETS*  switchboard*  were  unable  to  handle  the  thousands  of  calls 
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from  students  whose  checks  had  been  cancelled  by  BTS,  but 
were  not  xaailed  test  registration  forms.    One  frustrated 
young  man  reported  that  he  called  ETS  thirty  tines  a  day 
for  a  week  without  getting  through. 

Those  lucky  ones  who  did  get  through  received  a  variety 
of  responses.    Some  received  xaailgrans  confirming  their 
registration.    Others  were  mailed  a  letter  indicating 
which  test  site  they  should  go  to.    Others  were  assured 
that  a  test  would  be  waiting  for  them  at  their  originally 
designated  test  center.    Still  others  received  two  or 
three  different  responses  from  ETS.    One  student  received 
four  identical  admissions  letters. 

Three  hundred  students  directed  to  Georgetown  University 
in  Washington,  D.C.  found  that  there  were  only  two  hundred 
and  fifty  tes.ts. 

The  test  administrators  admitted  students  on  a  priority 
basis:    those  with  regular  registration  tickets  were  al- 
lowed in  first;  those  students  holding  roailgrams,  second; 
next  were  those  with  letters.    Fifty  students  with  verbal 
assurance:?  found  themselves  out  in  the  cold. 

One  such  student,  Steve  Pearlman  of  Georgetown  University, 
had  completed  an  expensive  preparation  course.    The  course 
wa<»  designed  to  prepare  him  for  October  13.    "I  took  half  a 
week  off  from  school,  in  order  to  peak  on  that  day,"  he 
lamented^ 

Theresa  Koncick  wrote  that  the  entire  situation  was 
"chaotic",    %'e  were  all  nervous  about  the  test  and  then 
they  announced  that  some  of  us  wouldn't  get  to  take  it- 
Since  I  arrived  early,  I  got  In.    But  the  test  started  an 
hour  and  a  half  late  and  I'm  sure  the  waiting  around  less- 
ened my  concentration  and  my  score.*' 

Konlck  continued  that  "on  November  13,  1979  1  recieved 
an  admissions  ticket"  for  the  October  1979  test.    ETS  as 
of  today  has  not  offered  Theresa  Koncick  or  others  affected 
by  this  mistake  an  apology  or  even  a  written  explanation  of 
what  happened. 

Spring    1980  T^^sclng  Dlt;cst.  p.  2,  15 
Error  lA  \ 

In  1980  thousands  of  law  school  applicants*  scores  arrived  late  due  to  a 
computer  foul-up  at  the  Law  School  Data  Assembly  Service  (L3DAS)  in  Newtown. 
Pennsylvania.    The  LSDAS,  an  ETS  subsidiary,  compiles  law  school  «PP^*^|;"^^„^ 
graSes  and  Law  School  Admissions  Test  (LSAT)  scores  and  sends  them  to  the  nation  s 
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220  law  schools. 

ETS  did  not  publicize  their  mistake  until  New  York  State  Asscmblycmn 
Mark  Allan  Siegel,  Chairman  of  the  Assembly  Higher  Education  Committee,  con- 
ducted an  investigation,    Slegel  found  that  the  ETS  mistake  had  caused  pro- 
cessing delays  of  about  80,000  law  school  applicants  and  that  ETS  had  not  in- 
fo^ed  students  that  there  would  be  an  eight  week  delay. 

Slegel 's  Investigation  also  uncovered  the  fact  that  30,000  yellow  matching 
forms  were  not  mailed  to  students.    Applicants  fill  out  these  yellow  forms 
and  send  them  directly  to  law  schools.    The  schools  then  forward  the  forms  to 
LSDAS.    In  turn  LSDAS  sends  back  the  yellow  forms  to  students  to  verify  the 
arrival  of  their  transcripts. 

After  learning  about  the  legislators'  investigation,  ETS  pn  January  28,  1930 
mailed  a  press  release  to  college  newspapers  announcing  the  eight  week  pro- 
cessing delay. 

Assemblyisan  Slegel  in  a  February  21  interview  described  the  delay  as 
"unprecedented-ln  terms  of  a  complete  collapse  of  service."    He  continued  that 
ETS,  by  not  Individually  Informing  i>tudents  of  the  delay  "had  failed  in  their 
Judiciary  duties." 

The  forn^  the  I^DAS  were  able  to  process  contained  an  unusual  number  of 
error>.     For  exaaplc,  a  student  from  Bcloit  College  in  BeloiC,  Wisconsin  was 
Ixsted  as  attending  a  college  he  had  never  attended, filing  courses  he  never  took, 
and  having  been  disciplined  by  university  officials  in  1967,  even  though  he  was 
onlv  9  years  old  at  the  time. 

Michael  Rappaport,  assistant  dean  of  admissions  at  UCLA  I^w  School  told 
The  Chronicle  of  HlRher  Education,  that  he*s  "noticed  a  lot  of  raistakes-more 
than  usual.    We  are  beginning  to  wonder  If  we  are  missing  things," 

Sandra  G.  Mannix,  director  of  admissions  at  Villanova  University's  law  school 
also  reported  finding  numerous  errors..    For  example,  one  applicant's  score  should 
have  been  100  points  lower  than  was  recorded  by  ETS.    Before  the  mistake  was 
corrected,  the  applicant  had  been  accepted  by  Villanova  and  several  other  law 
schools. 

Admissions  officers  at  the  Temple  University  law  school  ran  a  spot  check 
for  errors  in  January  on  80  reports.    They  found  errors  in  20  per  cent  of  them. 

Students  currently  pay  $15  to  take  the  taw  School  Admissions  Test  and  an 
additional  $38  to  have  their  transcript  and  computerized  summary  sent  to  five  law 
schools. 

getting  Digest.  Spring  1980,  o.  15) 
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Appendix       Taraar  Pachtcr  Article,  $450,000  Fund  Article— Testing  Digest, 
'  Spring  1981 


ETS  Tests  Researchers'  WHes 


Many  pepf>\e  believed  that 
when  New  Ytxk  Male  passed  iis 
Tniih  m  Tesnng  bill  in  1978.  li 
had  hfled  the  cloak  of  iecrecy  $uf  • 
rounding  the  KihKalional  Test- 
fnK.Sfrvice<bT'S)  »nd  oiher  lesi* 
ing  iivsiiluiion%.  The  New  Yorl 
law.  whkh  rcquire>  slanddrJi7cd 
tellers  lo  prftvidc  full  {nding  jnd 
Icsi  qucslion  disclosure,  did  open 
up  ibd  fluHliiJKb  of  IepMjru>n 
AKkiI  iwcniy  s:jtc>  have  now 
pjsscd  >i>«>c  Uvm  of  opcn-iciiing 
tci*i>!j(t(>fi.  and  >4>me  t>f  ihcsc 
bills  are  more»lr>ci  ihjn  (he  New 
Ywk  pfoioiypc.  Bui  ii  jppcjr^ 
thJi  all  thii  lawmaking,  raihcr 
Ihjn  opening  the  industry  lo 
».lo\cr  scruliny.  hj$  served  to 
mdle  ETS  m  Princeton  an  in- 
ireisinjcly  flMrded  basiionoftesi* 
ing  bTS  i\  no  niorc  willing  now 
lhan  ii  w  js  lasi  $pnnj  (see  •"ETS 
jnJ  Ihe  'Co-iehing"  Cover-Up." 
WA/  March       lo  share  ihe 
fniii  of  us  years  of  catalogued 
Mudies  on  the  effects  of  coaching 
on  aptitude'  test  ^ore&,  research 
whith  <4)nic  independent  in%cv 
ii|:j|<)rshavecjlled  into  question 
recently,  two  outspoken 
cnttisof  \tjndjrdi/ed  lesling\ay 
they  were  denied  admission  to  the 
b1  S  library  archive,  despite  their 
having  made  appointments  to 
Mudyitscollet-tion  Thearchiveis 
rutiMxed  to  contain  not  only  early 
l  rS  history .  but  also  the  re*ult$ 
of  studies  LTS  cues  as  evidence 
that  cojchinj:  docv  not  improve 
test  Korev  Evidently,  ETS  did 
not  consider  it  to  be  in  its  interest 
to  allow  Sle^e  .Solomon,  tevting 
project  director  for  the  New  York 
Public  Interest  Research  Group. 
andJohnUeiss.Codirectorof  the 
Committee  for  Fair  and  Open 
Testing,  Id  examine  Ihe  archives 

Ihe  afshive  is  only  open  lo  re 
\pon>ihlL'  rc\carchers,"  Weis> 
savs  he  was  told  bv  a  libranan 
Ihc  t»in«.i.il  LTS  position  has  a 
Minilar  ring  '  Vnose  two  edit  a 
paper  which  is  the  Satwrwt  En- 
quirer of  testing."  says  Mary 
Churchill, Ihe  publicinformaiion 
officer  at  CTS  The  paper,  actu- 
ally  anewslciicf  of  the  Committee 
for  Fair  and  Open  Testing,  "con^ 
fains  \Ianderous  Ihings  about 
HTS."  adds  Churchill  "Asfaras 
those  two  aie  concerned,  the  ar^ 
(.hive  IS  not  a  mailer  of  public 
infomuiion  " 

But  ^olomon  and  Weiis  are 
nol  the  only  researcbetS  who  re- 
cently have  had  trouble  gelling 
their  hands  un  information  in  the 
ETS  archive  When  Dfi 
Wirncr  Sl^ck  and  Pooflas 


Porter  of  Harvard  Medical 
SchtK>1  tried  to  revieNh  results  of 
ETS  research  on  ».oat.hing— 
including  the  PiVe  Study,  which 
indicJies  coaching  s'Jn  work— 
for  a  stud)  on  the  SAT  published 
in  the  May  cditmn  of  the  Uar 
\urtt  filmunotMi  /fcMo*',  they 
also  were  thwarted  "People 
were  very  cagey  aU>ut  the  Pike 
Study/"  says  i)f  P<»rltfr  'They 
S3id  that  Ihey  v^ould  send  it  lo  us 
when  (I  u-jN  ready,  but  of  course 
II  wai  alfead)  ready  Pt>ntfr 
vays  lhal  he  Hnall>  received  the 
contriivefstal  study,  prepared  in 
1972,  from  a  member  of  Ihe  Col 
lege  Board,  an  ETS  client 

Slack  and  Porter's 
investigation — based  on  ETS's 
owr  published  research — 
concludes  that  the  SAT  should  be 
eliminated  as  a  requirement  for 
college  applicants  because  it  is 
highly  susceptible  to  coaching 
and  IS  not  a  lest  of  aptitude 
Wrote  Slack  and  Porter  "In 
publications  sponsored  by  irTS 
or  the  College  Board,  we  found 
I  nine  conclusions  lhal  studies  lo 
I  date  h.id  demonstrated  coaching 
j  lobe  incfleciive.  even  though  Ihe 
•  published  experimental  evidence 
1  indicated  the  contrary^  We  also 
I  found  seven  assertions  lhal  gams 
inMTores  from  coaching  were  not 
signiHcanl.  although  Ihey  were 
slalisiieally  stgniHcant  " 

While  ETS  freely  admils  lhal 
the  C(uching  issue  ments  further 
study,  it  uys  lhal  this  research 
will  be  conducted  in*house  One 
wonders,  though,  how  seriously 
college  admissions  officers 
should  ule  the  studic  of  an  in- 
stitution lhal  IS  so  unuilling  lo 
provide  tts  irilics  with  uncen 
SKed  Miforiiulion. 

— 7rff>w/r  Paihur 
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A  copy  of  th«  tntlra  21  pas*  confldantlal  wmo  wi  attachad  to  my  taatlaony 
Vift  following  la  a  portion  of  th«  mmo  that  wm  raprlntad  In  the  Spring  1910 
Taatlnt  W«aat  -       -  ,    .  w  -m 


^TESTING 
DIGEST 


\  l'u> ,.      .11  ..I  ilit  1  onirnittit.  I..r  I 


ETS'  $450,000 
Secret  Fund 


.  /«  Aii0Ut(  /f7#.  £7y  ^MirM  WiUmm  Tmiutt  y*me  « 
m*mofndum  litM  fMc  and  fiiliwliail  ilttfiain 
Tawardi  TaMteg  and  ETI.  Thr  H^prngr  c0*iUemiml 
dPCMW  omHmt  TuntSmiri  ^  i#  jpmrf  USO.OOO  J# 

mft^  chit  rtihtt  orgmimi^  Fothwimg  mre  exrrrjttt: 

Thiny  ytm  wfirn  ETS  wm  ouMMlwd.  mimf  for 
ttlactkiR  WM  not  nweh  in  die'^iWic  e)«....Thc  vobme  oT 
cntkiifn  wm  tmmd  vp  in  Utt  'yOt  ttA  '¥H  by  iMcsh 
HoffMMn't  wMMg  oa  tlie  7>fa»My  rnt^f  theiac  cMtiga- 
liAf  (AjKli've  mtt  for  tlicir  iJteged  Wlwc  lo  rcwvd  deep 
Aiakiftf .In  the  IMO's.  widi  *e  20-foU  cxpMsion  in  luc 
^  of  Mtt  fwttbctkM..>)eirawlobeilw|eoMii4(«cat 
orymiMiow....  , 

Actwdmily.  t>y  *e  «*riy  '70i  ETS  Mood  tt  a  powcrM. 
IMc-kaown  orpmuiioil  ihit  maiiy  ^Mple  ivd  lo  dHl,widi 
iavotamanlx  ia  order  lo  pm  (or  be,  deaied)  accctt  lo 
cdvcatkwaJ  offOftmiim.  We'^pvovidad  acort»  thai  wwe 
aiyaimiii  aot  oidy  lo  imdMM  aad  pam  bat  alao  la  *t 
»*tCi<on  la  wteM  diyy  aiiiht  fan  lar  pUmct. 

Thh  sitaatMNi  aahefad  ki  die  era  of  aafiy.  hoatik.  and 
lomacimet  parwaid  aMacfcs  oa  leatkiy  and  on  HS.  TlK  NBA 
'moTMOfnim*  .wMm  came  oat  in  1972.  At  about  dw  wnc 
lime,  die  Auaciaikm  of  llad;  Piycbolotim  Mid  odw 
Mhwrkyiroapi  MicMlMiddMyMiri.iaMii^paaitfcMa  ...Tbc  * 
ftm  clear  expmaion  of  die  mood  of  aa  exira«ii«i  Mufe 
Mfaiaar  HS  perar  wm  pobaWy  dw  ifW  «ikie  of  IW- 
aaly  fowyaaff  aio....Siace dMa.  *•  ibrill laM hai baaa 
carried  forward  ia  die  PtRO  attacks,  whtch  ^uoic  Irill 
extaaaiwly.  in  Nadw't  ipfiwim  (9.9 .  APA  IP7*).  ia  die 
NACSP  jaanalt  and  boob 

AMOciatloiH  lUtc  APA,  A£ltA.  and-NCME.  Mid  oUier 
froMf*  pn^iMiaaadi  oawHiiirf  wtdi  leatii^  mmI  ki  aw.  M 
been  paaaive  obacniMi  af  dinU— w^ij^iiaib  dM  bmIm 
70i.fcMbyaboaiW5difybaiM»iOMedmi*elioatiKty  1 
M  wider  raiwdcMioM  Mid  dacperajpaJAcMKcriMndtey  had  ' 
Ifcoagh*  whea  KofAaaaa  wm  twcakiai  MMfag'c  tail.  Tliey 


(OHDaiadiaiadadlwcniaaHkiMHiiMMiariallaam- 
cacy  afiMM  aad  Mr  an  ia  >ndllBd  aad  la  dmiap  •  paaidia  «> 
b  a  laMal  MMMat  ia  *e 


criticiaaM  af  Mil .  ilia^iiiai  caiaM  fxpaakfioa  of  a  pana^ 
#ve  taiiaaale  fpr  dMk  an . . . . 

We  haw  a  hraad  cMoe  lo  aH*e  baiwaaa  a  taMvely 
'actht  and  a  laladvaly  paniW  ipyriaib.  ETS  hM  Madidoa- 
aUy- 1^  a  n*er  iifiifiid  avaa  lofty  —  and  apoli- 
tical ifpioach  la  aaaMn  af  pMk  comwmy.  I  believe 
we  aaad  lo  laiaiB  oar  di|Biiy  bat  raakae  dM«  dM  pioMeaM 
Ke  awli  MR  ia  *e  iaya»  of  imiwIi  Miiai  and 
palitkt  dMM  ia  lapc  ari  *at  the  nhitioai  are  pMaf  10* 
ba  tod  (ar  *e  baRlea  loM)  ia  diow  hot  mvmm  nihar 
dM  ia  aaaliaaMia. 

la  aar  oonaaaicattoai  lo  aon-ptychometric  froapi.  we 
ahoaUcte  ftwir  Hatiiikt  and  laoie  hanwnbMtfMt  cwn. 

WlMa  dK  oonnit  of  mi  tgtiyt  ipptoach  coa*iniat  bodi 
i.wi>ahoald: 


I,  AaMfT  10  ifiu  It  die  jjaaaicM  and  let  people  know  whM 

we  Mcdaiaf.  lad 
2>  lacivaac  aad  jnprove  oar  comflwucMioa  wah  non'teat 

,pabfictz  A^aatfy,  lioaltte<  aad  ai  bciwaaai  . 

Each  afdMt  two  Han  dioaM  be  pmmi  yarty  by  BTS 
oa  Iti  owm  aad  pMtfy  ia  wwpMMioa  wA  ctt  ar  inoit  other 
^eactai.  Auuiilapt/.  we  woay  have  a  foatfold  appiooch: 
inanrvaaaaaK  aad  coaaMaaioaioa.  ahiaa  aad.ia  pannnhip. 

WMria  a«h  ar  *c  H^'^pim  Mndflad  m  crideal  of 
laaliat  (nnarWN.  MadaaM.  adcaiiaa  aociol  cridc*} 
*a»a«palaMMa«dMiiafBctHcw«ndtipaoa<.  We  AoaU 


la  dlmaihn  Mntefy.  I  Mipeaiarf  two  Imn  of  action: 

I.  Ati^npts  io  impfove  die.situMion  and 

:  2.  E/fOfU  10  coiiwwaikaie  (0  dM  pentnl  puMic 

....In  Diaplay  F  (are)  dv  kind*  of  projects  dMC  mipM 
develop. 
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nOof  It  FroKcnbtie^i 

•  EMwton  the  poo*il*y  of  wii»»«»"«»t  •  '««  ^ 
N>*rrf'  (WHief  »  hefltf  «•«»€)  «o  whKh  com^iim  of 
imffOfCf.  unpfOfettkOMl.  «if«*Akil  r^»c«  c«-  be 
referred 

the  styk  of  itHM  woci^  NCMe.  S.ek  ft—CWf 
from  NIE.  Look  wmm6  n  le»*i »  « «h«  '«Mt*o 

yt«x  ComW  he  entrrery  *>#i  NCME  c*  m.^**  Hn-kn  to^ 
w«i  wi*  AEH^.  AMEA,  fi>w*»y  APA. 

what  vmMn  v*rr(M«  <>'  •'^"•^ 

•  Woft  w«h  0<f  Swe  School  Offktf*  <«n<  SUK  Te^i«f 
U«den'»)  on  <k*tlnprtKf«  o<  •heinitivt  ow^t U  for  (k^ffl 
of  rtnewKle  «v«e»«neT«-e^Wly  b^k  co*nfetef»cy-- 
«nd  for  rtpr*il»r  *>f  w  s<hrt>lt  and  p«t«*  <rrA 
mtfhl  be  involved  > 

•  With  AFT  devtlot*  rtcommeftde<  model*  for  itKhef 
ev«lM(ion.  ifKhjdiBf  pnfiet       of  lew  of  leichert  mi 


•  WHh  C  .  <»e^»<f  •  W*'  AI»en»«tive 

EvihiMioA  Sy«i*M  a  «t«f»f  r»f«"  w  ^^'^ 
pcopk  on  So*  10  *eni. 

•  WiA  ACE,  coftve«e  a  rt>«f  »  w^hc^wm  of 
«)vefnm««»l  encro^fnenl  on  {•Miwkxul  and 
profeuioiial  audiortsy  m  dec'.Mon  makinff  *om  tdmwKn 
a»do<hef  »ii»deiM.f«l*»4tofK»  Ra«fe«  from  lakke  to 
Harnnfion.  and  incl-de*  fovky  (l-ckky),  »«ne 
^vuioM  for  HandkafM.  ^ 
cotponaorW  by  tim*  i»o«p». 

•  Convene  a  confew«  on  ^If  fc^KiH  by  tfie  prof«»J«». 
lookinf  towVd  ^ftnition  of  areas  of  concern.  preKnl 
mehwihmc.  fi^.  nt**"! 

•  Wort  with  kfiilaloa'  offtce*  on  the  WttfiBf  of  b»H» 
affcctmj  tcftinf  Of  rtUcy  ^mmi  on  i«m)»  of  aoeMinent 
Do  jome  of  ftH  woit  /»»  *o«>- 

•  DC  0(fic«<ip»oi.'n«ugiUefw«y  Weiho«ldbe»ufe 
10  ^ve  It  the  MkM  itfp  in. 

it  may  be  th«  we  a^  wtcneM«tf  a  Jong  tem  iiMd  »  »ep 
apowfCWimwBiotioneftwtt  In  any  caae  I'm  Mcluwd  » the 
view  that  we  og|ht  »  m  the  ne*!  3  or  4  yean  a*  a  twie  of 
unviual  p«d  and  offOftiwUy.  Some  of  the  actkmJ  to  be 
.  t»kei»c«nbe»Jppoilrf«nfcrexrtdBib«J|eofoeWornialK)n 
Serv'icei,  Ad«a«y  mi  l-katnKtwnal.  or  RAD.  km  «me  of 
itiem  probaWy  ca«»t  and  »ho«)d  not  he  »o  «"fPort*d. 
Accordinily.  I  we  >howW  anifcifiie  an  tiirwi*nafy 
altoctf  ion  of  ftmda  OMt  of  ETS  net  for  ihW  work  in  1*71-79 
tfmwth  I9»l. on  *e  oi*r  of  S200M.  $I30M  and  SIOOM  for 
the  three  rtipective  yean,  "nm  *o«M  fi»y  V*  with  Mr 
Sohxoon't  fomMlaa  for  allocalion  of  net. 

WHiMB  W.  1 


Abbreviations  Used  in  TurnbidVs  Memo 


ACE  -  AMfican  QiwKtl  on  ErfncMMin 

AEKA  /AmrkanEdueatKM  RcMarch  Aaaociation 

AFT  -  AMncaa  radefioon  of  Taachan 

ATA  Ajaicncin  hycholofjcil  AiaaciMMn 

Mi  AtlUk  '  "TW  Sacivcy  MMd  dM  CoUefe 

iOM^"  by  SiTMa  Mil.  Ntw  YM  MtfmMt.  Ocaobar 

A,  1*74, 

.  lUnm^  CoMOfM  m  Taataif 

(DHm*)  iMrorfMcad  a  Tni*-iftTaaM(  bil  in  1*77 

NAH3P '  National  AiaociMK)n  of  El iwi Miry  School 
hvciH<  (S«       Wy/A«#**  H75  iaane  of  M». 


NCME  -  Nvtorad  Council  on  »t<Murtmeni  and 
Evaluation 

NIA  •  NkkmI  Eihtctton  Aiaociation 

WE  '  NmiomI  iMtMc  of  EducatKM 

N3BA  -  NMioMi  School  tomk  Auocwuon 

rate  .  PmWic  iMeraai  Rcseartli  GfMp«< 
hMM  icMnrch  and  advocacy  cryamutioM 

Mr,  Sthmm  -  lUAcft  S^kxnoa.  ETS  E»ao<jve 
Vk«  hftideM. 

T>nMy  «f  T««li« '  look  pibiithad  «  I9i2  by  Dr. 
iancah  HoffnMn.  noiad  nrftfrnatictan  and  ^yticiM 
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QMestion:  "Mrs.  Wiliok  U  ready  i6  |d  home.  ^  iwi 
worted  all  day  and  will  work  at  home  tonight.  She  is  taking, 
some  books  and  papers  home  with  her.  Mrs.  Wilson  is 
probably: 

a)  a  waitress  in  a  restaurant, 

b)  a  schoolteacher  f 

c)  a  slore  clerk. 

— Stanford  Achievemeni  Test,  J973 

htele  thatthe  choices  do  not  include  lawyer,  executive, 
sales  manager,  or  professor.  Even  the  fact  that  she  works 
outside  the  home  makes  this  an  unusual  test  item. 


Sex  Bias  in  Testing 


"No  'mponm  mU^tcvenries  Mudict 
«cft  iMpirad  by  tht  pMMfcof  Ude  IX 
of  the  EducaiioQ  Amcndknentt  (which 
Mid  It  WM  illcfil  10  ditcrimifwit  aftiast 
iKMnen  in  leidiif  or  couoicliiig).  One  oT 
them  ioolMd  at  etghl  of  ihe  mote  fre- 
qyeiMly  vmdmA&ntmt^  tm  ibks  and 
found  wofneii  md  giris  pottnyad  U  sac- 
raotyped  "home^nUung**  roles',  pnaaively 
wakhini  boyi  play  or  yntk  wlufe  mea 
waie  actively  involvtd  t(i  a  variety  of  Job« 
or  profe»ikNM .  Male  Douiu  and  pnvoouot 
ontauinberad  femalct  tn  all  buc  one  M 
aariet,  aometimes  at  a  ratio  of  14  to  one. 
71m  tecood  study  looked  at  5th,  tch  mmJ 
lOd)  grade  test*  to  see  if  lex-Maaad  con- 
lant  had  an  effiact  on  girli*  scdrea  and 
found  that  girit  md  to  do  better  on  quea* 
ikmi  with  more  fenuJea.  aqua]  numben 
of  males  and  femalct,  or  people  of 


unapadtWd  acx  in  ihem  than  on  queadona 
that  featurad  Malei,  Sincn  femalea  ware 
teu  freqimdy  mentioned  in  thaat  feM, 
die  implication  clear — not  only  were 
dwy  protcniing  a  demeaniag  and  wrpal> 
iatic  picaM  of  fanydea  in  aodety;  they 
w«re  alio  nnfair-meaaucca  of  achiew- 
menc.  Widi  ifaeae  iMdies  in  mind.  I  cxan- 
ined  several  widdy  used  atandirdiaed 
achievement,  aptitude  and  iaielli|Bnce 
tests.  ^ 


In  Icie  ^rtag  moat  childrnt  take 
some  fonn  of  achievement  lest  to  caK- 


bMa  how  Mclt  liiyV^ 

oowM  of  ihs  aijhool  ymr  mmI  datcrmni 

dieir  liwd    tnck  for  Ihe  folkwrii^  y^ 

Achievement  leat  aoorca  are  also  vaad-k 

check  laadien*  efiectivcnau  and  to  com 

pare  a  acbool  or  school  district  witt  tta 

others. 

The  foOowing  widely  used  teats  pub 
InhadbitMen  1971  and  IfMwwicvkMad  . 
tmm  -ftK  aT  Me  atBs  pUbWiad  b* 
Hcn^iof^Mit^'Qmmit A  II 
•m  puUM  by  aWMcCm^iil:  and 

tt^^^^^^j^^^    n  ^^^^^^^^^^ 

Hm  9hiiM  AcUMaant  Irt,  bodi  0 
which  are  pidMhad  by  The  FsycMofka 
CorpontioK,  9  suMSorypfHomMnBnct 

Each'ofthaac  tests  ponriyti  woroai 
in  luhaarniant  tai/qt  demaaniag  aitua 
tiona.  Women  wtre  shown  io  the^tradi 
tional  roles  of  honiamaker,  teacher.  Mine 
and  babysttier,  and  girls  helped  modK 
cook,' wrote  to  pen  pab  or  watdiad  pas 
sively  while  roan  and  boyi  led  acdva 
iatereating  and  varied  lives.  Moat  fenda 
apactflc  heme  oo  tficse  tests  uand  mak 
'exaraplaa.  Ifer  inatance,  on  Ae  Iowa  In 
of  Basic  Skills ,  male  nouns  and  pronoun 
outMimberad  fechale  nouns  by  a  ratio  0 
aeariy  i  to  2.    t  ^ 

Revisions  of  each  of  dtese  laats  pub 
iitbad  betwnen  1977  and  1979  sbor 
stgnUknnt  egalrtarian  gains.  Males  an 
(pleaae  tun  10  page  3 


^hyiiis  Kosser.  «  contnbming  editor  at 
Ms.  MMtazine.  writes  on  edttcatictt^ 
lanes. 


inside... 

*'QihMn-Nri.Q.'ftal|   2 

SubacriptiooBMc  3 

'ftstmg  in  Oana  6 

AdukCompaiaKy'katiag   I 


Chuck  Stone  on  ETS..  10 

USATkra  ,.^...,.13 

Skidenli  Outwk  ETS  14.16 

BSslon  Cordtimoe 

Miy2nl,l9Cl  IS 

Thidi-in-'Rstifv'ftsiimony  16 
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Tlx  'Rxhiit  IXgal'Sprinc  Ml 


The 'Culture-Fair" 
WISC-R  i.Q.Test 

In  l<W>ihc  Amencan  Black  P$ycbolo|ical  ASNOCiauon 
calkd  for  a  ten.yrar  mofaion*im  on  ibc  I  Q.  tcsiinj  of 
mioooty  chMnn  By  1974  ihc  NAACP  and  ihe  Natiowl 
Educaoon  Assocutsoo  were  bo(h  publjcty  ur?  schtwU  to 
Slop  admrnistenng  te«*  to  children  of  all  coJori,  Reacting  to 
these  pfcssures  the  PJ>tholog»f »!  Corporation,  then  an  inoc- 
'  pendent  compaJ\y  and  now  a  wMidiary  of  Itarcourt  Brace 
Jo»novich.  revived  lh<»r  Wtchsler  Intelhfcnce  Scale  for 
Children  (WlSC)  to  create  the  cuUure-fair  VVtchsIer  Intelh* 
^rcnceScjIe  for  Children- Revisco.^lSr  R>  The  WISCR 
vas  standard rze  J  on  j  pt>pulation  which  was  5<Kf  male, 
female  8^^  white  and  1^'*  Black.  Latino  Asian  or  Native 
American  Today  the  WISC  R  is  America  %  most  widely 
administered  i  Q  test 

Last  Ocit*er  NtKihem  Califwn»an  Federal  Jud^  Robert 
PtCkham  ruled  that  the  WlSC-R  as  well  as  the  othe/ 
commercially  available  I  Q  teas  \* ere  biased,  and  coold 
therefore  longer  be  used  by  the  publ'C  schools  in  his 
distrtcC  jurisdKtion  to  track  mmotity  children 

In  l>cctmber  l'>80an  Illinois  federal  jud^  ruled  that  the 

WISC'R  t€«  ^-^^  ^^^-''^  ^  ^ 

*,hiWien  In  anelTort  to  bring  some  empintal  evidence  to  this 
dispute,  le!  *  ermine  severalqutstuKis  trom  the  culture  fair 
WISCR  IQ  (est 

l>  What  U  the  Ihinjt  to  do  when  )ou  cut  )our  flnntr? 
2  point  respond:  Pgt  i  bandald  on  it 

1  point  response:  (*o  lo  (he  hospllil 

0  poJnt  res^nse:  Cry,  bleed  or  suck  on  it  m 

— Wise- RIQ  Test 

Mtnoritv  (hldrtn  usuatlv  perform  poorly  on  thu  lUm.  A 
/en  Ytars  afo  a  Baltimore  .Ktanhnil  ioctohmt  oileil 
ie\erat  inner  iit\  somiAj  \*h\  theK  aniHeredthrcfuestitfn  the 
rttis/An  did  Shefoundthatman\oftheieliJians\iered  xo 
lo  a  hospitaf  bet  au  se  the\  thought  that  <  ut  meant  a  big  *  iit 
Onhn  ihtmKhtttua>o  maSUut-^tnd imK ethe\  didntha\e 
am  baniUudt  at  home  'he\  aniwered  lucked  ort  tt"  -and 
receixed  no  points 

2.  What  b  the  thinf  to  do  If  you  lose  •  ball  that  belooRS  to 
one  of  your  frkndi? 

2  point  response:  Buy  him  «  ne\*  one  and  p«y  for  it 

1  point  response:  1^  all  over  for  It,  try  to  And  ll 
0  polni  response:  I'd  Jiist  cry,  (ell  him  )ou'rt  lorry. 

'1^"     -WISCR  IQTW 

Ifvourtpoor  itoftenifnotp<fiMbIrtobu\  another  one 
andttts  unliktlythot  you  have  o(ie  tov^-  tf  the  bcttis  realty 
lest,  looking  for  It  is  a  waste  of  time.  And  if  it  is  not  realty  lost 
but  could  be  found,  wouldn't  looking  for  it  be  more  'tnieUi- 
gent"  than  buying  a  new  one?  Crying  oropoiogiting  might  be 
the  best  response  for  a  poor  child,  but  such  an  answrr  will 
yield  a  lower 'intelligence''  score 


3.  What  art  you  suppoMd  to  do  If  you  And  some- 
ont^  wallet  or  pocketbook  In  a  store? 
2  point  response:  Return  i( 
1  point  response:  GUr  ll  lo  the  store  owner 
0  point  responserKeep  Si;  make  bdkvt  you 
didn't  see  It 

—  WISC-R  ly  Icvt 

Is  a  poor  hungrv  child  realh  {ess  intelligen;  ifslheieept 
the  moneys  Also  a  child— especially  a  minority  child^might 
ignore  the  wolleV pocketbook  for  fear  that  sihe  y^ould  be 
accused  of  stealing  it  Such  a  respome  would  tarn  the  chid 
nci£oints  

Other  WISC'R  Items  Include: 

•  What  are  some  reasons  why  we  need  pi)licemen* 

•  Why  IS  ,1  usu»lly  be»cr  to  ?i>e  money  to  a  well-known 
chanty  than  to  a  beggar ' 

•  Fh)m  what  country  did  America  become  independent 
in  1776' 

•  Who  discovered  Amenca  * 

•  What  IS  the  capital  of  Greece' 

•  What  are  hieroglyphics' 

•  Who  vras  Charles  Darwin '  —  J.W, 


— ETS  on  Test  Bias — 

In  1 970  ETS  reacted  to  chai|KS  that  their  test»  were 
culture- biased  by  makinj!  one  out  of  every  ei|hl  reading 
quetions  minority  onenied  Ne^^  for*  Maga:ine  -iporter 
Sieve  Briirs  interview  (10/7/74)  with  ETS  senior 
psychometncian  Marion  Kpitein  ibout  the  addition  of 
(be  minonty-ofienied  section  follows 

Bn//fC?J  "If  the  (e5t  weren't  culturally  biased  tn 

the  first  place .  why  did  you  make  the  chanfc'**' 

Epstein  (A)  "Because  minorities  feci  at  case 

readrng  this  kind  of  passafc  " 

Q  "If  they  feel  ateasereadinjthisone.doesthai 

mean  they  don't  feel  at  ease  reading  the  six  or 

seven  other  p<JS««cs  in  the  icsl"*" 

A'^Ho,  It  just  meanstheyftelnwecomforuble 

with  this  one  " 

Q'  "Well.  If  they  feel  more  comforublc.  does 
that  HKan  their  scores  will  be  hi jherT* 
A  "NoM  don't  think  there  will  be  any  difference 
in  scores." 

Q:  "Well,  if  there  won't  be  any  difference,  why 
would  you  make  Ibc  chantc.  Was  it  just  so  you 
could  look  like  you  were  doin|  somethinjr 

A  "No,  it's  because  when  people  art  more 
comfortable,  they'll  do  betw  on  the  leal.  Tbey 
feel  less  dutatenod." 
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Stx  Bias 

Continued  front  ptife  I 
females  arc  mcniKmctl  in  ci^ujI  numbers 
Giili  are  ^hown  paiticipaiinj:  in  suvh 
previous!)  hoy\-ooly  XIjmIics  aibtcjtle 
rxJuif  ftshini:  vTitungihegras^  Jclivwnf 
iKv>ip*pcn  handling  mo(K>  afxl  even 
winnini  tciencc  av^ards  Women  u^re 
shown  dnving.  not  only  car^  buf  even 
Cihi  Mxl  tnKkt.  shooiini:  rapiUs  m  a 
canoe  and  ira>eUin;  in  spjtcc 


approidmately  ihe  same  number  of  ques* 
iiont.  correctly  ihough  not  the  same  ones 
The  messa^  one  fe\s  from  lookin| 
d\  ihe  Wise  R  and  the  WAtS  is  very 
cleax—it's  a. man's  \sof>d  In  a  general 
jntormation  section,  <,hildrcn  arc  asked 
questions  about  (,Qiumbus.  bdison. 
Daruin.  vvhile  adults  are  overwhelmed 
by  references  to  swh  famous  or  hijh 
status  men  as  Lon|  fellow.  I  ianttd .  Goethe. 
US  prc^Kknisrfumc  four  since  VXXT.i 


"Women  are  never  depicted  as  inventors,  doctors,  lawyers, 
politcians  or  ma  position  of  power  higher  than  a  man's  within  a 
question," 


Women  (or  the  hr^i  nmcarc  allosHed 
toenler  the  professions  a^  demists,  veten 
manarts.  even  scientist  v-^  incltxlmi  a  black 
\*oman  on  the  CalifofDia  Athioement 
Test  Wojnen.howoer.  are  never  dcpicicd 
a^  invenkxs.  dockxN,  lawyer*,  politicians 
Of  in  a  position  of  pov^er  higher  than  a 
iiuns  within  a  question 

But  these  new  improved  tests  are  not 
widely  used  Most  scho«>rdistrKts  sa>e 
money  by  boying  answer  sheets  for  the 
older,  stereotyped  lest  hooks  they  already 
own 

I.O;Te«l$ 

Measunnf  t^e  intelligence  quotient 
-or  I  Q  of  an  individual  is  a  mystenous 
activity  because  one  knovw  exactly 
what  the  components  of  native  intelli* 
jgenee  are  Nevertheless  I  Q  tests  tn 
used  10  label  children  as  'tmart  *  or  stu 
pvT  it  a  very  early  age— affectinj  leather 
expectations,  placement  m  class,  and 
utiimaiety.  ddcrminini  a  child's  future 
T\*o  of  America's  most  widely  used  1  Q 
icsts  were  reviewed,  the  Wtchsler  Intelli- 
fence  Scale  fo<  ChiMitn-  Revised  (WISC 
R).  adminisierrd  m children  between  a^cs 
of  5  and  I6«  and  its  companion  test  for 
penont  fJ  years  of  ifc  ind  older--' the 
WMnler  Adult  Infcil<(cncc  Scale  (WAIS) 
Both  of  the»c  tests  arc  published  by  the 
Psycholofical  Corpontiofl.  a  subsidiiry 
c4  Harcoun  Bncc  A  fovmovKh  These 
exam*  *re  vmtien  with  the  egalitarian 
iMumptKMi  that  men  ai>d  women's  avtrafc 
intelH|encci  are  equal  lUrcouit  Br»ce 
accornplithes  this  by  suttsiically  balanctn| 
the  test  so  that  c*ch  sex  will  answxr 

 Att€ntk>o  

We  Sopf  you  find  this  cornpfvnfn' 


Yet  not  a  single  tamous  woman  is 
mentioned  in  this  section 

The  math  sections,  where  girls  tra 
ditionally  peiform  poorly,  arc  even  worse 
On  the  WISC-R  there  is  one  firM  grade 
level  question  about  »  girl  losing  some 


nbbons  while  many  of  the  cJier  ques- 
tions show  boys  and  men  buying,  sethng 
or  working.  On  the  WAIS  nuth  section, 
there  arc  no  fenules  mentioned  in  any  of 
the  fourteen  items 

On  the  WISCR  picture  anannement 
section  (putting  a  sencs  of  pictures  in 
order  to  tell  *  story— which  purpom  to 
measure  a  person's  j^Iity  to  analyze  com- 
plex situations)  10  of  the  siones  feature 
males,  only  three  involve  fiemales.  In  a 
sequence  titled  "Ihe  Hirt"  a  king  asks  his 
dnver  to  slop  the  car  so  he  can  (lut  with  a 
beatmful  woman.  The  correct  answer  has 
the  soqucnoe  end  with  them  sttotling  dowi) 
the  street  together  Another  scqut^  fca- 
t^es  a  man  with  a  female  department  story 
"dummy" 

The  <.ontent  of  these  tests  raises  sev- 
eral impoftant^qucsiions  IXxrsthe  WISC  R 

(continued  on  p^ge  4) 


Which  is  prettier? 


FftOM  THESTANFORDSINETIQ  TEST 
USED  TODAfTO  ^TRAC/T  ELEMEfiTARY  SCHOOL  CHILDREN 

t=THE  TESTING  DIGEST=| 

**!ndispfnsible  for  anyone  who  wants  to  keep  up 
with  the  important  activities  in  testing." 

Harvard  Medical  School  Professor  Douglas  Porter. 
Co-author,  "The  Schoiasm  Aptitude  Test,  A  Cnlical  Appraiser 


wKam'  en  c«M  «'-TW  Hm^mmd 
ga^'ir  gt  Wk  frftti  MMly 

,  K). 


StttwcHbe! 

The  'ftstlitf  Digest 
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Comrimedfrom  patt  S 
wdW/VIS' mak  conmM  btve  an  effect  on 
fcuMit  Mtt  Kcm?  Doct  the  dem»«nin| 
coMt  hTM  m  effect  9*  female  lelf- 
coirfWtence  *tnH  tert-wd  in  later 
Ufc?  Af»<  why  imwt  an  LQ.fctt  contain 
maienal  that  i»  oflemive  to  women? 


Aptitude. Tk«»— which  attempt  to 
meMUft  a  person't  potential— aie  uied 
by  vocational  couMclors  and  by  colleie 
Md  sradiMie  school  admiwiont  depart- 
mentt.  One  of  ihe.  moat  popular  couth 
Klmf  exams-- tfte'Diffferential  Aptitude 
Tbt  puMitlHH  by  dMPsychotogical  Cor* 
poration,  a  subaidiaiy  of  Harcoun  Brace 
Jovanovjch— ^contain!  a  section  on 
mechaaical  rraaoning  where  boyt  score 
much  ht|h(r  than  $irli.  Ihe  comenl  ii 
hifhly  maleHKienlBd:  there  were  pictwet 
of  men  fociinf  in  nutron*  rirfmf  hotKi» 
ihrowhifaWil.uMn(ahofe.ana>taaJii)t 
on  the  moon.  The  only  woman  on  the  left 
U  tiaittf  in  a  wheelchair.  No  Cunous 
women  apfear  in  the  V^thal  ReaMnint 
Mction  ihboufh  there  ait  two  quettiona 
feUurinf  famoua  men.  In  the  LanKuage 
Uuie  MCtioN.  male  nouMand  pronount 
OMtnumher  fMnaJe<  thne  to  one.  Men 
and  hoyt  ut  invotvad  in  Inforfanl  activi' 
lica  while  firis  ut  careleu.  bttak  their 
dollt  or  aie  pan  of  trivial  compariMns. 

Sex  balancing  bccomei  critical  on 
ayiitwde  teM  whcncolle|e  entrance  is  at 
M^.  On  dte  Scholaatic  Aptitude  'Rst 
(SAT)  which  is  administered  by  the 
Educational  "hatinf  St^occ  (ETS)  and 
wtd  hy  Moai  aelactiw  colleiea  for  admii< 
liona  purpoaac.  firlt  and  boy«  have  the 


sm  avcrar  vnhal  acores.  Girls  Med  to 
scoe  Ufher  on  the  vcfW  section .  but  at 
ETS  Kaevchar  Carol  Dwyw  explained 
vobal  section  hat  baen  rewntien  so 
tfMt  boys  and  firk  Mw  score  equally 
well."  ^  I 

Wluk  liw  vatwl  Mction  haabven 
•"WMcad"  for  sex.  SM  similar  equa)i2in|' 
of  aCQfes  hM  occurred  on  (he  SATs  rnaih 
iKtiM  where  boys  otnacore  jifis  bjr  an 
•m^  of  50  points.  In  bet  in  th^  past 
few  ytm%,  ETS'  hna  chmiiMad  aewal 
alpebn  Md  data  safldency  questwus 
(  I  liiiiianat wha*ar wiut\ enoufh infov 
mMion  to  sohfe  a  problem)  which  usually 
bvorad  girte/ETS  researcher  Thomas 
Dodon  obacfvad  in  one  study  of^the 
SATs  ma•c^  taction  thai  his  compaiiy's 
paychometrictMS  had  the  power  to  vary 
the  scores  between  the  sexes  by  as  nnich 
«s  60  poinu  dependinf  upon  the  ques- 
tiona  they  selected.  Dwyer  says  the  deci  • 
sion  to  "equaliae"  the  vert>al  section 
h^ipenad  gradually  over  a  period  of  20 
years.  Accordiitf  to  Donkm  it  reflecu  a 
shift  in  the  inteieats  of  colkfes  from 
liberal  aitu  to  more  emphasis  on  technical 
wbjectt  a«d,en|ineerin|.  This  shi^  in 
interests  undoubtedly  affecled  content. 
AsOonlonnoted.ina  1975  study  on  the 
SAX  "If  the  Ihaty  science  and  pmctical 
affi'irs  Items  had  been  matched  in  number 
to  equal  the  twenty-four  aesdtetic.  pHilo* 
sophical  and,  human  relations  items, 
women's  SAT  tcfM  scorM  mifht  have 
been  hi|her  than  men's  scores." 

Questions  in  the  ETS  guidebook. 
Takint  the  SAT,  seem  to  emphaaiw  power 
and  accomplishment.  Enfliah  questions 
'  refer  to  "iMlers  af»d  admiaistiiitors  who 
hold  the  worM  in  their  hands."  "man's 
MpMom  and  wnndeimeMs,"  and  imfivid* 
who  belie^e  Ami  tftey  have  the  ligN  to 
Wfle  ow  onfinniy  people.  Farnous  men 
(SMv^cwe,  Dylan.  Hdcr.  fVeud.  Na(N> 
lton)ftfoulnnifcertinn(MSwomen,evcffin 
(fuejtoons  about  ite  arts  t  corteitf  ares 
imft  luppoaad  to  fiMjr  women. 

Male  nouM  and  pronow"  P'^i^' ' 


nate  in  all  section*  of  the  sampk  test  (no 
females  are  mentioned  in  the  maih  tec- 
tioos  ahhoufh  men's  names  are  Used  in 
three  questions).  Mak  occupntiofii  out- 
number fcmates  (who  are  mai^  writen) 
almoa  3  to  1.  but  there  is  a  woman  mayor 
in  the  Eaflith  r>mmar  section. 

A  repoit  published  by  a  Colk«e 
Entrance  Examination  >otedcoruraU>ion 
cfcniy  admhs  that  "the  SAT  scores  tend 
to  rwkice  the  advantage  giris  enjoy  in 
gnded  school  work"  ETS  researcher 
Marlalnc  Lockheed  raises  a  critical 
questioti-^^if  the  test  contains  more 
female-orientad  content,  will  mak  test 
scores  go  dovmr  Since  girls*  college 
grades  tend  to  be  better  than  boys,  we 
know  the  SAT  doesn't  predict  how  well 
they  will  do  ill  colkfc  even  though  this  Is 
jthe  puipose  of  ihe'test. 

^QH  colkges  and  professional 
schools  use  a  mathematical  formula  to 
combine  frades  and  apbtude  scores  into  a 
singk  admiuions  number  thai  is  supposed 
to  predict  first  year  grades.  According  to 
a  1973  study  by  the  American  Colkge 
•ftsting  Progmm  (an  ETS  competitor)  the 
equations  most  universities  use  lend  to 
systematically  under-predkt  giris'  actual 
performance  in  colkge.  Nwcy  Co|e. 
Director,  of  Educational  Research  at  dw 
University  of  httsbuiih.  believes  thit^f 
colkftt  uaed  a  fomiula  thai  fciriy  pradKted 
giris  first  yewgrades.^they'dbe  accepting 
two-thirds  giris  to  one-third  boys."^ 

On  the  praduMc  kvel.  the  Law  School 
Admission  Tksl  (LSAT)  sampk  book  fca« 
tures  questions  testing  "dau  evaluation." 
"dau  application"  and  "logical  reasoning 
•bility**  that  ofkn  have  a  business  and 
economics  content.  Men  predominate 
tlwoughout  the  test  and  are  shown  as 
presKknUp  senaaors « famous  writers  and 
political  thinkers.  Not  a  singk  famous 
woman  tt  ntentioned  and  no  women  are 
shofwn  in  a  poekion  of  po*tr  or  even 
woriung  ui  a  profession.  Only,one  woman, 
a  partner  ui  a  family  business,  is  alkiwed 
to  make  business  decisions.  And  another 
(pkaae  turn  to  page  3) 


The  Testing  Dif^est      vai.  ni,  #i 
Co-DUtcton:  John  Gordon  Weiss  Steven'^Splomou  ^ 
AssockUs:  Debra  Ettinger  Lawrence  Kjronick 
PubltolMd  by-Tbc  Com^ttce  For  Fair  &  Open  'ftsUng 
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"SbocM  your  ncuhbor  Jiop  bcadng  hjj 
wjfe^  Thii  s«mj  like  adoubte  *himmy 
for  minbnty  women 

ACiomieiTen  Ro(h  and  David  W-hite 
report  in  Hiivard  Um\ersuy*j  Women  s 
Uta^  Journal  lhal  the  *x>mcn  *ho  take 
the  LSAT  are  JuperKh»e\erJ  They  have 


ihat  the  LSAT-haj  irKre4J»n|Jy  empha- 
Jucd  mathematical  ability  even  though 
math  H  not  a  high  priority  jkiU  for  law- 
>tn  "  While  continues  "that  Since  women 
ujuilly  ^a\'c  lesj  tnterejt  in  math  than 
men,  the  USaTj  math  onentition  puts 
women  at  a  diiadvantigc  "  Pcihips  aj  a 


"The  only  woman  on  the  test  is  sitting  in  a  wheelchair:' 


C<mUnu<4ffom  pane  4 
woman,  refenrd  lo  aJ  ~a  bujine$j*oman 
with  •  reputation  for  boncityrij  mvohed 
in  «  slander  suit  apinst  her  neighbor 

Several  quesftons  seem  geared 
towards  disrupting  a  woman's  self 
confidence  Por  imiance.  this  item  reminds 
law  school  applicants  that  women  ha\e 
been  regarded  as  property  fora  longtime 
"In  Roman  law.  avroman  was  known  fir^t 
as  her  father's  daughter  and  later  a*  her 
hu  sband's  w  I  fe .  she  had  no  »de  nt  ity  0  f  her 

own"* 

Of  this  LSAT  reaioning  ability  item 
where  tesi  takers  must  choose/select  the 
answer  th^t  most  nearly  resembles  the 
questioo  "*Do  )wi  think  that  our  uni\er- 
sity  ought  10  goon  discnminating  apinM* 
disavaniagctl  students  by  continuing  us 
oinert  adnussioo  poJicKS  The  answer— 


extremely  high  LSAT  \tibal  scores  higher 
college  grades  and  will  b,\ve  higher  law 
school  grades  than  the  average  male  I^AT 
test  raker.  Yet  male  and  female  LSAT 
score  averages  arc  identical  If  the  pur- 
pose of  this  tett.  like  the  SAT.  ts  to  predict 
success  inrschool.  then  it  doesn  t  work  as 
well  for  women  as  it  docs  for  men 

Over  the  past  decade  White  reports 


result  of  White,  Roth  and  others*  cn- 
tiqucs.  the  Law  School  Admiss  lonsCbuocil 
recently  announced  that  starting  m  mid- 
1982  they  willeliminate  some  math  ques** 
tions  from  the  LSAT 

.  o  a  O  □ 

bliminatsng  sex  bias  m  tests  that 
affects  both  girls'  test  kores  and  their 
self<onfidence  seems  like  a  matter  of 
simple  justice— providinggirlswiih  equal 
opportunities  for  success  in  life 

But  this  d«sn't  deal  with  the  power 
which-test  makers  ha>c  o>er  our  li>es  in  a 
larger  sense 

Depending  upon  the  lest  publishers' 
hidden  or  not  so  hidden  agendas,  dif- 
fcrent  groupsof  people  will  be  labelled  as 
intc I! igent .  achie  ve rs .  or  hi v i ng  aptitude 
Currently  people  with  math  and  science 
tMlcnt  are  likely  to  score  highe»;  on  tests. 
The  answer,  how  even  is  not  Simply  to 
ti\e  more-  weight  to  >erbal  qucstwns 
Instead  Amencans  must  realize  that  since 
standardized  tests  can  be  so  easily  manipu- 
lated. It  IS  impossib^  to  make  them  com* 
pletely  fair.  Wc  need  to  accept  this  fact 
and  devalue  test  scores  instead  of  altowi  n  g 
them  »o  be  the  major  determining  factor 
for  getting  ahead  in  life.  

Women  at  ETS 

Marlaine  LockheaJ.  the  newly 
appointed  Chairperson  of  the  Committee 
on  the  Status  of  Women  (^SW)  at  ETS. 
announced  the  Completion  of  a  recent 
study  entitled.  The  Status  of  Women  at 
ETS—Compensanon  and  Clarification 
"One  of  oui  major  findings  is  that  C  * 
a\crage  salary  qf  women  at  ETS  as  of 
July  I.  I9t0.wis60  percent  of  the  a^ragc 
salary  of  men  at  ETS  That's  close  to  the 
national  figure  of  59  percent  and  reflects 
the  higher  concentration  of  women  at 
lower  $al«y  grades."  sutcd  Lockhcad 
ETS  has  deferred  any  action  on  this  studx 
pending  the  completion  of  another  study. 


^lypes  of  Bias—  ^ 

Sludievdooeonl  0  .achievementandaptituJetestshaveidentificdfi^elyYcs 

of  potential  sex  bias 

•The  most  blatant  type  is  the  demean  m  g  aM  stereotyped  d^epiction  of  wt>men 
tnd  girls  on  many  tfMs 

•  Amlher  vvmirxjo  type  of  bias  is  that  males  are  more  often  featured  m  test 
questions  A  1975  Educational  Testing  ServKC  tbTS)  study  found  this  has  a  direct 
er?ect  on  achievement  test  Korev  Girls  are  more  likely  »  get  a  question  nght  if 
(here  are  more  females,  an  equal  number  pf  males  •and  fenwtes,  or  people  of 
unspecified  sex  withm  the  question 

•A  potential  vource  of  test  bus  results  from  difference  in  interests  and  skills 
which  emerge  m  junior  high  scfiool  and  follow  the  lines  of  traditional  socialization 
Several  studies  ha>e  shown  that  gitls  perform  bctte^on  math  questions  that  invol>e 
-typical"  female  activities  For  example,  girls  answered  i  question  about  feer  and 
inches  correctly  more  frequently  tf  it  was  put  inihc  context  of  drapery  making  tfian 
the  heights  of  male  basketball  players  This  source  of  bias  des«r\Ci  more  than  the 
imatl  amount  of  researth  that  now  exists  because  poor  scores  may  now  be 
discouraging  girls  from  entenng  theic  traditionally  male-onented  occupations 

•CirU  score  higher  on  questions  involving  the  arts  and  humanities  while 
math,  science  and  business  ooented  question! ia\of  boys  Girls  excel  in  reading 
comprehension,  algebra  and  bwlogy.  while  boy^'  vocabulary,  analogies,  geometry 
and  physics  scores  are  higher      »  ♦ 

tThe  sex  of  the  examiner  may  alwcontnbutc  lobias  One  study  indicates  that 
f  .rls  score  higher  on  the  WiSC-R  anthmc'ic  section  when  tested  by  a  female 
examiner  and  boys  score  higher  when  tested  by  a  male  Since  most  clinical  and 
school  psychologists  are  male  this  might  be  lo^enng  gsris  scores  Harvard 
psychologist  Robert  Rosenthal  reports  that  "the  sex  and  interaction  of  the  testers 
have  significant  effect  on  results  jEvcn  though  they  re  not  supposed  to  gi\e  any 
feedback,  "a  wirmer  examiner  will  get  a  performance  that  ts  supenor  to  a  colder 
oner  he  uyt  ^   .  ^ 

•The  rushed  nature  and  muitiple<hoice  fomut  of  nvAt  stantJardized  tests 
may  be  other  sources  of  bias  Imtial  researeh  indKate^  thai  on  multiple  choice 
lesu.  wwnen  answer  a  higher  RCrcentage  correct  than  men.  but  ha«  fewer 
completions  Therefore  it  is  probable  that  if  test  takers  were  gi«n  more  time, 
women  i  scores  would  go  up  TTwre  ts  also  some  evidence  that  essay  questions 
improve  girU"  scorev  Over  the  past  two  decades.  bo*e\er,  essiy  questions  ha^t 
been  deleted  from  tests  becaux  they  can  t  be  Kored  by  a  computer  
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Tht  'VttHy^  rMgrst/Sprinft  t9tl « 


Cheating  in  China  *  •/ 


Bonnk  Sexton 
Pekinf .  China 


Ancitiut  hifh-tchod  frxliMtmf  clau 
his  been  chafprd  with  «clin(  in  collusion 
with  1  teacher  and  an  xssislanf  principal 
K)  cheai  on  universily  entrance  examina- 
tions, accordinf  to  a  rtpM  in  China 
)buth  Sews,  a  national  newspaper  for 
yoonj  people  publtshcfl  here. 

The  cajc  has  dranutiicd  the  intense 
pressures  on  students  to  fct  htjih  |rades, 
in  a  country  where  very  few  qualify  for 
admission  to  universities  litis  y<v.  for 
instance,  only  JOO.OOOTof  the  5  millKX. 
students  who  took  the  examtnaliont  were 
admitted. 

The  chealinf  inadent  took  pixc  tn 
H«Vian  Province  Accordin|  (oihe  ncws> 
paper  account,  the  a.s$utant  principal  and 
the  teacher  toM  the  students  «o  disrtfard 
ruks  on  ^the  examination,  to  help  each 
o<her  with  the  answers,  and  to  bnn| 
reference  materials  to  the  classroom.  When 
students  Mid  they  were  afraid  t})ey  v^-ould, 
be  caught,  they-werert^  that  'theexam- 
(nation  procicn'  repons  of  cheatinf  will 
never  leave  the  province.** 


As  a  consequence,  the  students 
brou|h(  notes  >nd  books  to  the  test  rooms, 
worked  with  each  other  lo  fonnulate 
ans^en.  and  look  a  k>ntet  time  ihan}vas 
allos/^td. 

Eventually,  v^ixd  ofthecheatini  did 
reach  higher  authorities,  apparently  from 
a  proctor  who  said  he  had  been  threater^ed 
by  the  assistant  principal  and  some  of  the 
students.  * 

As  a  result,  the  ex.unt.'vttion  results 
we(e  declared  invalid  and  the  students 
were  told  they  would  not  ha>e  a  second 
chance^to  take  the  Ksts  The  assistant 
^napal  was  fired  and  the  teacher  arrcstd 

in  an  editorial  tKat  appeared  alonf 
With  the  account  of  the  incident,  the 
newspaper  blamed  the  <heattn|  on  ihc 
fact  that  t^e  Cultural  Revolution  had. 
weakened  respect  for  law  and  order  and 
had  concentrated  power  in  the  hands  ofa 
few  people 

The  ireatmeAt  of  those  invohed  in 
the  inciddit  ts  harsh  by  Chinese  sian- 
dards.  since  dismissal  from  a  job  is  a 


Spfcial  Report 


China 


severe  and  rare  punishment  and  the  stu- 
dents ma)  ha>e  been  permanently  denied 
a  colkfie  education,  . 

There  are  other  reports  of  pressure 
on  students  to  do  well  on  the  entrance 
examinations,  and  on  teachers  and  school 
administrators  to  prepare  them  for  tests 

Parents  in  Inking  are  reponedly 
asking  for  longer  school  houts  in  the 
week>  before  the  examinations  aregi>en. 
andoneloreignteachennsoutheast  China 
said  that  physical  edu.ation.  art.  and 
mu^iv  had  jII  been  dropped  for  several 
w'ceks  before  the  examinations  so  stu- 
dents would  dfvute  mpre  Itmc  to 
preparation 

Bonnie  Sexton  i*nt<$/orTh<Chron 
tele  o[lftgh<r  Education, 
t>  The  Ch^onkk  1980 


PRC  Prohttort 
VltHETS 

ETS  recently  ho«ied  two  profcsson 
from  the,Untvmtty  of  IVkinf  Foreign 
Lingua|E  Institute's  English  Department 
The  Chmse  tram's  pnmary  foat  was  to 
Icam  how  to  score  and  construct  (he  Test 
of  Er^i)h  asa  Rxtign  Languajic  (TOFfL). 
a  test  that  tno«t  U  S  colleges  te<^\tt  for- 
eign applicants  K>  pass. 

«  Profe9MX  Ding  Wardoo  told  7Ar  £75 
Examintr  that  'In  the  IVople's  Rtpublic 
of  China  out  nvethod*  are  somewhat  coo- 
setvative  and -we  want  to  improre  "  He 
oononued  dat  k)day  standardized  multiple* 
choice  tests  are  rareiy.  if  e>er.  used  in  the 
nC  If  detiih  can  be  Onilized.  a  PRC 
^Riearch  team  will  trivelio ETS  later  this 
t^ar  to  stud/ "the  whole  |t»(tmj;|  process 
a<td.alf  0  k>  learn  about  bTS*  Interoaiionai 
toMTuctiona]  rrofr*ms.''Dingcoochided 
The  Committee  has  written  to  ETS . 
the  Chinese  EniUwy  in  Wuhingion.  and 
the  Univcnity  of  IVkirfg  English  Depart* 
mhi  requetting  a  meeting  with  the  FiCs 
tNling  tram.  iF  you  would  like  to  attend 
#M  mMling  plewe  contact  The  Committee. 


—And  You  Think  YouVe  Got  It  Tough— 

"The  examinations  usually  took  piKc  at  permanent  quarters  which  >^cre 
created  indifferent  citKsespecially  for  this  purpose  The  halls  >^crc  arranged  in 
alleys  and  further  disposed  in  row^f  cells  ~  cxb  alley  being  named  and  each 
cell  numbered.  The  cell  was  aboutTour  feet  by  three,  with  the  height  of  a  nun. 
and  open  on  but  one  side.  Grooves  were  rrude  in  the  wall  to  aJmit  a  plank, 
.which  served  as  >n  eating  table  or  a  writing  ucsk  by  day  and  a  bed  by  night 
'Before^cntering  the  examination  hall>'4ku>e  candidates  had  lo  be  strictly 
inspected,  their  robes,  pockets,  shofs.  tnkstoncs^  and  otherper-onal  belongings 
being  southed.  Ies»"skinning  paper"  or  "cribbing  compositions'*  be  smuggled 
in  Each  cxauiination  consisted  of  three  sessionv.  tasting  for  a  p:riod  of  about 
three  days  In  the  tuurw  of  the  emperor,  t^e  chief  examiner  called  upon  the 
spiri  ts  to  inspirs  the  niindx  of  the  candidates  according  lo  their  arKCStra!  instils 
As  he  intoned  this  prayer  many  iVccTKlrrs  «<re  set  off  Tnus  the  examination 
begar, 

'During  the  three  day  sc*f  conlincnxtt  in  the  cramped  cells  neither  examiners 
nor  t^andidkites  were  allowed  outside  communication  No  book  or  written  paper 
was  permitted  tc  te  earned  upon  any  person  Names  were  scaled  and  exh  paper 
>^  as  marked  With  a  Cipher,  thus noexaminer  could discoverthe  possible  identity 
of  the  cai>didates  Strict  regulations  concerning  the  cxammaiion  and  severe 
punishnKnts  for  Offenders  were  enacted  so  as  to  guanntcc  honof.  spini.  and  fair 
play  A  single  instance  of  cheating  in  the  examination  miglit  lead  lo  wholesale 
execution  of  ali  involved,  extmincrs  tnd  Candidates  alike  " 

From  a  description  of  <i\tl  service  examlnaliont  in  China  in  ihe  I4ih 
Ceniun,  The  Funceion  Unive/siiy  Library  Chronicle^  Summer  1959,  page 
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A  fully-documented  expose 
of  the  standardized  testing 
currendy  used  for  college, 
the  professions,  civil  service, 
business,  and  industry 


ACCLAIMED 


«An  impoctant  book  which  }iMiic>ou^y  trlli  ui 
whM  w  w»on^  w!ih  itindudiicd  (titinjc  and  the 
tniinfi  ii>duMry...h  k  i  book  which  ihouU  be 
wklcly  frid -ASHI^  MONTAGU 

<*A  Irvtl  beaded,  uifonnxfrc  aweMmcnc  of  tntinf 
thx  will  be  useful  10  ^yoac  concerned  abouc 
eduocioo.  and  invaki»bk  fix  {urron  and  «i\<deno 
whofKtencouncen  w«h  stand  ardUed  teiti.** 

-JAMES  rAJLIX)WS,  W*ihifln»n 
Editor.  Tht  AtUmtic  M^fitkty 


WITH  ENTHUSIASM 


*^An  invaluable  lervice  w  the  many  people  victim" 
bed  by  tefU...  It  ihouid  mocivace  Americani  lo 
open  up  the  testinjc  induitry" 

-ALTIIEA  T.L  SIMMONS 
Director.  NAACP.  Wash .  D.C 

^^Scfcnio  hM  rsptured  the  ei»ence  of  one  of  the 
fno«tcon4>texeducatk>nalusue«oftheS04  ..and 
hat  ict  a  count  of  action  for  much  needed 
chaiiM^  -REBECCA  FISHER. 

National  PTA 


SI4.$y  *f  irW  tM  tfitt  it  f>f  /Mt^       immSt»i)  t* 

SY  toon 
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Oncoul  ot  live  American  adulls  lacks  iL  skills  and  knowl- 
edges (MC)  10  function  effectively  m  the  basic  day-to-day 
struggle  to  make  a  living  and  niamlam  a  home  and  family" 

HEW  Sews  JOI29I75 


b>  I^Hrrncr  Kronkk 

W  hot  VJ  the  Orpormenl  lit »  to 
twue  ttf<  h  a pKK  himattm  *  //  true  tureh 
iu<  h a  stair  "I Pt fairy  is u\  \xi>rrts>me m 
an  unemj't-\mfni  rate  ol  iOprrt  fnt  fur 
lht\  flf  •»  >  rfltau  )U\ » not  just  thin  udutn 
tatk  ;<//»^  "t  luik  sktih  for  job*,  tut  thm 
lhe\  tatk  the  f>rr/r4^uiu[e>  to  lunt  tton 
effe<i(^fis  in  ff'>^  d,J  fUM  remh 
thi%  trntn^tis  *.omluu<>n'  tht%  tfutition 
n  fxplor^il  "1  ii  rei  ent  Mt  rejHtrt  entt 
tied  The'PiStuJ\  Sueme  Dissemi 
mitum  and  the  \uture  vf  Adult  Edum 
lu'ft  frt  Huron  Insti  tute  re  feiin  her  Wait 
Ume\  oml  I  /'>w/  l>JMd  W  the  (  onttn 
utn,i  fduuition  Imtdute  \  t)H(//>tM  of 
their  findirltii  (oKim  i 

RcatJing  fo  a  dramj(K  «ncre»\c  m 
^uit  ci]«C4JM)*ul  pfujifimn  rhc  Atlvli  I>ivi 
Njon  oi  ihc  V  S  Offne  of  WsKjIk^a 
a  SOfc*  in  August  IVTO  mucdaReqiKM 
fwPfO(x)sal>«Rt  P»forarcsc;»rchpfojetl 
tbJi  v^oo  W  cttjbli\h  "the  funciional  <i>fn 
pclcrwe  ncoJcd  ttH  nwxmg.  the  require 
mcMy  for  adult  living  ~  USOb  officiaK 
b<>pcd  ihal  onct  the  requiremertiv  fof 
jdult  hvmp'hjJbcen  dchned, educator* 
iouW  «hcNe  vpccitK3tM>flv  Ut  icacji 
jduU*.  fhc  AiIK  «he>  needed  rt>  fgtKtron 
iniiKJern  Amcma 

tntV\ufnnierof  »V7}  I  SOhjrAirdcd 
Ihc  Texas  Suie  Uysit'onal  Ai'«xutu>n 
i  FSl  A>  J  ninHH>n doUir\to<.<Mr>pletc  (hi\ 
pfojetl  rhc  I  SI- A  ihen  vuUooirscted 
With  'be  I)iv!\K>n  of  I  \i£n\v^n  of  rbe 
t  niveruty  «>I  lexas  at  Au\tin  (o  ittgjUy 
^Je>et<.p  'Ihe  rcqu»rcnieptt  f«>r  jduli  liv- 
ing vThc  i  nive/>it>  ol  Te» js  rc^eJ^he^> 
*>o  fhe  ^a*n  *>f  a  review  related 
literature  and  research  '  decided  that  a 
pcfV(,o  ^^*K.«.c^>^nllfe  co<Tt1aittJp<>Mti>eSy 
with  hivhcr  yftt\  of  Hhoolmjji  iiKome 
Kcvel  ttvi  •K«.upiti'>nal  status  "  Ihc  Tens 
re%eaf«.hcrs«her« developed  i  hs\  of  hi«t 
\KiU>  jnd  gcrwra!  KnovsJedgc  area*  th*t 
>uccei.%!u!  people  pmscv«d  From  thi* 
U\i  {e\l  items  >*tr3r  developed  and  then 
wlmmiMcrfd  to  ^  <X)0  adujt  ^o^an^cer^ 


nH>^tol  Vkhotii  wxrre  pjrtivipann  tn  adult 
edui4tion  proyr^ns  in  V>  i^jtc\ 

Ihe  Te*  js  Stvc  Wucation  Ansocu- 
tion  reportedly  the  I  SOh  that  thcmo$t 
»mportJ^t  produtt  of  the  t'ni\crMt\  of 
lexawviMk  ^^j%ali,vtinj;of  the  require 
rncnti^  for  *JuU  iivmy  *huh  *e  ha>"c 
tcntJiiNcly  tdentihed  js  ^.ontnbuttnjc  to 
>u'.^.e^^  in  jduU  life  "  The  report  von 
eluded  'h>rihehtMlime.lhcrcnaN)dy 
of  research  which  offers  guidan^x;  on 
sshai  we  should  be  teaching  our  students 
in  Adult  Bjsic  Lducation 

In  1973  jn  AduUIVrfoniwiKcl-estl 
Text  ronsiHtmg  of  Ji  ^«V  of  adult  compe- 
icncy  ic«4  »lcm\  hascd  iHi  ihf  Te  k  as  research , 
MS  administered  loa  rcprtwntatist  lomplc 
ol  7S00adultsthroughout,thc continental 
t  nited  States  Ihe  HhW's  Pinal  Report 
on  Adull  Competency  (education  Protitc. 
based  iHi  the  reMilts  of  this  tcsl  concluded 
InjKneral  ih?  answers  (<?  the  questions 
posed  by  this  sKlton  is  not  as  competent 
as  v,c  thought  ^ 

Oserall,  i>ne  out  of  hse  <19  8'^I 
adult^i  were  ^atd  to  lack  skills  and  Viwvsl 
cdpencededtofunciwneircttistlv  arxxhcr 
i%  9'i  ^^tre  ritcd  as  mirjiinatly  ^.ompc- 
tent,  and  only  •16  %^  *erc  said  to  be 
functioning  ^J^lth  any  degree  of  real 
compete  ns.e 

IhereptiftsofKludedihtt  rwrethan 
W  ol  Buk  arid  Spanish  \umArncd 
jduits  vvere  (unttionatly  iiKompctent 
This  \tudy  and  its  findings  roused 


considerable  attention  Ilie  title  of  Kdith 
Roths  lead  article  in  the  May  1976  USOI^ 
published  ^umal  Ameruan  tduxawm 
credited  the  studs  with  sjusing  "A  Fer- 
ment in  F^uci.ion  "  She  ssrote 

Jod:^  -not  quite p^e  \eari  since 
the  Al%  iiudv  be  tan   morf  than 
JO  stales  are  either  nennnn  up  to 
teachororealreads  tfOi  hingaduHts 
to gutn Cifmpetenc\  in  the  6^  prac 
tuol  ohj«  file*  vkhuh  tht-  Vni\fr 
sit\  ofTcuts  team  developed 
In  March.  1975  the  \?l  approach 
aiv>  res'eiscd  ihc  seal  of  apfwosal  from 
ihc  Joint  UiNseminjtion  Revicss  Panel 
liDRPl  m  in.W  s  Education  Divi>iop 
Just  a  fess  day\  after  the  JDRP  vapprovaU 
USOK  and  the  Unistrsity  of  Te^as  at 
Austin  entered  into  an  agreement  with  the 
AmericanCoIlegcTesting(/VCT)  Program 
under  sshich  ACT  received  the  "exelu- 
sise  nyhl  to  refine,  adapt,  publish,  and 
distribute  the  APL  materials " 

API.  Res Lslted:  U^  Usrs and  Adap- 
tation in  Stales  can  ^  obtained  from 
Jerome  Lord,  Adult ^ Learning  Team 
Nationat  I  nstitutevf  Education,  1200  l9th 
St  NW.  WashmttonJ)  C  2O20H  i202i 
254'$^  , 

By  the  erxl  of'  1976  there  ssere  a( 
least  120  APL  based  adull  competency 
educational  projects  in  JOstates,  In  addi- 
tion scseral  Mate s;ised  APL  items  in  their 
m1nlmunf^comp<ten«.y  tests  that  high 
school  students  bad  to  pass  to  receive  a 
high  school  diploma 

In  1976.  the  USOL  sited  the  APL 
project  as  an  cwmpUry  educational  pro- 
gram, and  CoftgrCNs  authorued  10  mil 
lion  dollars  t^  subsidise  \iJte\  Adult 
Basis  Uuvjtijjn  Pfogramv~ttr  cSOl 
then  gasc  priMity  f<»r  funding  to  those 
j     (continued  on  page  9) 


5  —APL  Item—  j 

Mary  Dilly  is  a  housewife.  She  needs  to  make  some 
extra  money  for  a  while.  She  can  type,  ?)ake.  and  sew. 
The  quickest  thing  for  her  to  do  to  make  money  is  to 

a.  'AppIy  for  temporary  office  workl 

b.  Go  to  school.  1 
c  Bake  a  cake.  \ 

d.  'Make  her  own  clothes.  \ 

e.  I  don't  know.  \ 

,     —  The  Adult  Performam  e  Lev)^.  Sfudy,  1973 
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ContinnfJ  from  po%e  S  \y 
itjiei  \Yu\  implcmewcd  progwrm  based  ^ 
OA  the  APL  rocarch  In  aJdiUon  HEW 
spent  adJtiionjl  monic\  >ponwnnjj 
nuTiKiuuv  ifcurk.vhop%  v»n  xhc  APL  pru 
gf  jm  All  these  faciofs  combined  rouiied 
in  the  viiidc^pre^uiiliiiiiK>n  of  the  Ini 
\cniiy  of  JzM\.  reseifchers'  uork 

In  i976  the  l/ntvemiy  of  Jz\a\ 
re»emhen  fe^.ci»ed  i<t  ^junl  troin  ihe 
State  of  Tetjs  (o  buitJ  a  curTKulum  to 
complement  the  APL  test  Three  ye*^» 
titer  the  UniverMiy  gf  Texas  at  Austin 
entered  ink>  an  a^reen)ent  with  fl jrcvun 
Brace  it  JovanovKhio  market  (hecumc 
ulu  m  program  e  nt  I  lied /The  A  PL  Senes  ** 
TofUv  ACT  s,  APL  Test  and  Harcoun  s 
APL  Series  are  u^^edin  hundred>  of  Adult 
Basic  bducatton  Proginims  lunonwidc 
In  addition  APL  test  iierrw  art  used  b)  it 
(cast  a  do  re  n  Ma(e%  in  constructin|:  the 
minimum  ^ompcicfK>  i<sti  high  school 
sfudenl>  TS\iis\  pass    rrteive  a  diploma 


The pre<fjfni  ut « ouni  rt^  rail  ho^ 
an  Si!  miUion  ptut  to*ernmrnt  subsnt\ 
K/>mbtntdvktth  entrepreneurtat  tnttiothf 
tan  result  m  the  tmplementatum  of  a 
teftinjt  program  in  nrarU  three  dvien 
itatet  ond the  nuleipreaJ dmrmination 
vfa< tmdutton  that  nearU  20  pen  ent  of 
Americanf*^erefuftaiorujll\  inCtmpelrnl 
Hane\  and  Oa\iJ  spend  the  hulk  of  their 
report  anal\7thf  the  forces  thatprorrtoted 
the  Af'L  pronram  and  tummartunjt  other 
researchers  <nmtims  of  the  APL  leit 
Follo^tnUisa  summan/  of  their  remarks 

CrUkUm 

One  of  the  first  to  comnwnt  on  the  APL 
approach  was  H  Aclarid  tn  iM76  fie 
questioned  the  University  of  Texas 
rewarchers  assumption  that  iite  skills 
can  be  nwasured  by  a  competency  test 
Ifeartuedthat  ( 11  people  do  ikk  face  the 
same  problems;  and  f2)  there  axe  a  vanety 
of  ways  of  solvtnf  a  problem  Ac  land 
Cites  several  APL  Items  to  show  how  hard 
ms  to  hftd  hfe  skills  problems  ihat  all 
people  actually  encounter  m  their  lives 

One  Item  Adand  analyzed  asked 
people  10  use  a  mock  airline  schedule  K) 
select  a  /lifht  -so  that  they  couk-  make  an 
appoininwni  m  another  cny  at  a  partic- 
ular tinx  According  w  the  APL  study. 


—APL  Item— 

The  City  garbage  truck  has  not  picked  up  Esther 
Maxey's  garbage  of  three  weeks.  Esther  is  having 
trouble  keeping  the  flies  and  mice  away.  What  should 
she -do'? 

a.  Take  the  garbage  down  the  street  to  an  empty  lot. 

b.  Call  the  hospital  to  complain  about  the  mice 

c.  Call  the  sanitation  department  about  the  problem 

d.  Cover  the  garbage  with  a  sheet. 

American  College  Testing  Program.  1978 


30  percent  failed  to  choo>e  the  conect 
ansuer  AsACbndnoiev.ihc APLdcvel- 
opers  apparently  assun^ed  thjt  the  airline 
schedule  item  incJ>.urwd  soine  general 
life-skill  vr  tompcience  .Nevertheless. 
Acland  observes 

The  lase  con  be  made  that  t^ere 
are  skdls  v,htch  appl\  lo  checking 
atrhne  $«  hedulei  v^hicharenot  nec 
esiar\  for  other  tatks  Inthatcate 
II  ft  pertinent  to  ask  hovt'  man\ 
people  ute  airlines  In  September 
1974  onl\  one  person  m  t^o  <55 
pertenti  had  ever  flovtn  (Oallup. 
1974)  Thn  malei  the ''ba<r  result 
took  a  lot  less  depresiinf.  tt  (the 
APL  ftndtnf(i  now  teemt  to  reject 
different  es  tn  the  tasks  people  fa<  e 
rather  than  different  e$  m  their 
problem  ioUlr.ft  skills 

To  illustrate  his  potnt  rejarding  dif 
ferent  v^ays  in  which  people  ^^}vc  Ihe 
same  problem.  Adand  cites  results  on  an 
APL  tiem  indicaiin^ihationly  39  percent 
of  the  population  could  correctly  cgm 
pleK  calculations  for  a  partially  completed 
Federal  income  tax  form  1(H0  when  pro- 
vided with  the  pertinent  information  In 
contrast,  be  cites  Inicmal  Revenue  Ser- 
vKe  data  indicating  that  only  about  6 
percent  ol  individual  returns  actually  ton- 
lam  artihmatK  erron  of  any  kind 

The  two  points  raised  by  Acland  arc 
essentially  questions  of  measurement 
validity  -wones  that  are  particularly  tni 
cial  to  any  elTort  tu  assess  life  skills  cum 
petence  Fust,  it  cannot  be  inferred  that  a 
person  lacks  a  particular  skill  simply 
because  he  or  she  i$  unable  to  demon 
vraie  it  in  a  testing  situation  SecorKl»  just 
because  someone  Jacks  a  particular  skill 
does  not  nwan  that  be  or  she  will  be 
unable  to  deal  with  a  problem  in  a  panic- 


ular  real  life  Mtuadon  Ptople  ask  for 
help 

Along  these  same  tines  B  R  Heller 
jt  al  11978)  criticizes  APL  Study  Direc- 
tor. Norvell  NorthcutiS  statement  that. 
*A  Shocking  34?{  of  the  (national  asses*- 
mem)  sample  felt  that  police  had  the 
authoritytodetaina  suspect  for  as  lon(  as 
a  ucck  without  bringing;  charges  against 
htm  (not  rccognizin|)ihe  illegality  of  the 
situation  "*  Because  of  the  way  the  items 
and  options  are  worded.  Heller  wrote, 
their  IS  no  correct  answer.  *  Urnler  no 
circumstances  "  is  not  correct  according 
10  the  Constitution  of  the  United  State 
which  allows  for  the  one  exception  if  | 
thereisasiaKofmartiallaw  This  example 
IS  not  meant  lo  be  lighthearted  nor  eni* 
due  We  include  it  as  an  illustration  of 
two  problems  thai  are  common  to  the 
Items  First,  as  an  example  of  poor  item 
construction  and/or  second,  of  an  elitist 
value  syMcmihat  $u|;gcsts  that  most  people 
need  not  know  'the  full  story** 

Heller  also  examines  the  USOE 
Coding  that  "12  percent  of  (he  sample  felt 
that  permission  to  have  public  meetings 
should  not  be  given  lo  certain  kinds  of 
groups,  e  g  radicals*  an  1  'troublemak- 
ers ■  *'  Clearly,  the  wording  of  this  item 
asks  the  respondent  for  an  opinion  rather 
than  the  constitutional  guaranicc  the  pro> 
portion  of  'incorrect"  responses  may  not 
be  as  surpnsmg  when  interpreted  in  this 
manner 

The  Texas  researchers  defined  suc- 
cess m  voccty  stncily  in  terms  of  uiconvc, 
education  an^  occupational  status  Yet, 
Haney  and  david  show  that  APL  items 
apparently  distriminafc  far  nwrcelTectively 
jn  terms  of  people's  ethnicity,  agcandcily 
size*  than  they  did  in  terms  of  rcspon- 
dett's  income 

Please  turn  H  page  15 
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I  he  TtMinx  DiKrvl/.S'prinK  1981 


— Why  I  Resigned  from  ETS— 


ft'Ihi*  tn  <  lift  a  /<H-  ( «,  trpti  from 
iftuik  St'-nc  i  konoie  mUftSS  to  Jkt 

\ir/RO  y  (htotKr  /V«^/  <i^(rfn*«  in 

li  is  J  pJcj'turc  X<»  N:  here  jnH?«(  h» 

i<\  he  tw>n»«v»d  tun  fhc  Njmc  pfwgrani  wuh 

*h\>  p«  (he  *J^)  U>r  4!1  of  us  i>  a 
.J.s«irl»«.n  i  shill  trcjvure  tor  ibc  of 

prc>'\icot  Jo<l  v<!  m><  »>»»c  ol  ibcin  hjv  doc 
^okI  f»>  >JV  aU>ui  the  <.omp*nUipn 

jif*.  rcmiKcd  t<)da»  f«>  enter  college  law 
vN¥>l  );r>d!u4tc  M.h<K>Iv  Kt^incvv  jnd 
(>H«ltv4rit  »n  v*»n»e  t>tic%  joJ  stjtc*  the 
kj*bnf>;:  j»M»»<'svn»n  Jftd  vcvfral 
mv»jf4*»4Hr»v  ir>J  pfotc«»\M»ns  vuvh  js  real 

I  i't  .'Jvh  «  Nifjojckhofd  on 
Vnvru an  vju<.i!.<>'<  hc> j'>vf  jI>>.  icvCv  ^rc 
^rfjit  vjitidjiMfs  ihc  pr^-itijiious 
jiotJ^ntvai  >t\  tt>e<f.vimt»«>cylcgitim(/crs 
*.f  h»>,-Kf  c\IiKatK>fi  KTS  van  raivr  ic^c 
X-xs  irHl<i<A)c>M»pcrn)dKilly  merely 
to  rfiv*  a  cyphcmntivali)  tails 
oxvcvs  trxomc  «rtcr  cxp<n>cv  but  ii 
rrJo^^>^c^.  *x  ^xofio  FfS  a  bovincvs 
v»>ffv«>f4t  on  w»th  Ihc  vjnic  maj^^r  soal  as 
(n-ntrrjit  Motors  or  anv  muliinaiion^t 
^roii[>  maKc  m«>nC>  and  niay  chc 
v«  nsumcr  he  tlamncd   

Yum-Yum 

{  IS(  i-oJv-rcnvc(  enlcfhasancw 
txf<.u^l^•<'^  bcf  Bnin  F.afcr  According 
iv  Thf  t(S  i  iummef  Lager  'has  prc- 
pjred  .^uuinc  at  fine  hoich  and  rcsiau* 
rjnt\  «»n  jhrcc  (.^>mincniv  and  vookcd  tor 
uch  <v>idin(C  A^uics  <i>  Ociald  lord. 
D^viU  Rv>v>lt.ctcilei  ^riink  Sinatra  4nd 
Ijtkw:  CtV^MO   Glcau>n  on*.e  ^avc  hitn 

4  S^^l  «ip 

f  i^fr  su|<[Mvcv  a  Maff  of  12. 
including /i\riN.HAv  M>fiicot>*tw)m*crc 
trained  a(  (he  Culinary  Jn%tiiuK  in  New 
kurk  i  ival  voixentiate  ^  pruvidm^ 
reall /  «x«jui^ite  tood  h«rc  Eager  I 
wa^i  th  CVmfcrcftCc  Center  lo  have  the 
reputation  of  hcin^  the  best  restaurant  in 
fhc  hincffcvft  4rea  ' 


\^  jn(>(gani/aih>n,  BTShasii^  hands 
deep  into  the  vu>iic  |ar  of  feden^  grants 
jMarded  bciause  »er>  >trong  LTS 
soniaviv  J*.  a  rcsuU  ^f  an  interchanging 
relatiomhtp  heiueen  federal  dnd  private 
employees  Tederal  offKiats  know  thai 
uktng  |:ood  tare  of  hTS  in  juarding 
soniraci^van  result  in  a  );o(x!j<>bdurtn)!a 
vhange  in  adnf)innifation  or  a  cutback  in 
dcpanmeni  apprornaiion> 

Tlie  year  before  Ilefi  1971  ITShad 
%ucccisfuHy  bid  on  a  project  known  a* 
Task  B  6  named  alter  the  outmoded 
bomber  lis  title  A  Study  of  ibc 
Sp?^,ial  ServKe  Programs  m  Higher 
I  ducaiion  for  Disadvantaged  Students  ' 
and  would  assess  c«»i>ng  pfctgrains  for 
divxl^aniaged  Mudenis  and  identify  the 
eleiTKnt^  and  vharxten^tissof  successful 
p(ogram\in  collegesand  uni%er>ities  with 
all  minofily  and  racially  mued  student 
populations  for  research  conipan*kons 

!n  JhcKrPlRequest  for  ProposaU  from 
the  Office  of  Education  i  was  listed 
thuslv  Mr  St»Hic  wiHild  scfsc  a*a  kiinl 
i>l  senior adsiM>r  m  residence  .  demoting 
10  percent  (imc  over  the  c'our«  of  the 
project  ' 

When  I  rcsigrted  in  Febftiary,  1*^72 
TjskB  6 wasAXKfuIiy behind itSKhedule 
and  overspending  ils  budget  I 
subsequently  received  a  letter  on  March 
16  1972  from  an  KXS  eveculise  which 
read— nund  you,  fww  I  have  resigned— 
Yog  may  not  agree  but  I  suspect  that  it 
IS  critical  tof  you  to  retain  the  title  and 
responsibility  of  co-dircCtor  The  truk 
then  land  tt  should  ha^c  been  a  incki  will 
be  to  find  w  ays  ihit  you  can  continue  to 


stupe  the  prowsl  and  the  Una  I  rep*>rt 
without  inlringcnKnt  on  your  neU 
respt>nsibilitics^' 

Ihe  letter  gtK-s  on  to  sijte  that  two  ol 
(he  project  s  top  oscrNCeing  olluials  in 
the  t)tfice  ol  t^tucation  had  been  intom)ed 
ot  n)>  resignation  and  that  they  would 
probably  ^ant  a  letter  Ifoni  nie  that  1 
would  rK>t  IcjK  jnv  inl«tfmjtion  and  J 
pciv>njl  tetter  ihji  iiiv  restgnati<tn  i\  tn 
no  wjv  prompted  bv  the  project  \ 

It  wasn  1  I  resigned  because  1 
discoscred  that  j  >.n)  jII  group  ol  people  at 
hrs  led  b>  Its  exc>utisr  >icc  president, 
Robeni  SoN»nH>n  arctjrnK»rcinteresied 
in  making  a  pr()tit  Ihjn  educating 
AnKrivaN  children 

Last  year  LTS  mt>bili-rcd  one  of  the 
nMKtc'ipens|selobbyingclfortMnhisi<>ry 
tod  deal  testing  reform  legislation,  j  «.os( 
which  wilicsentually  result  in  increased 
tcsifec^  OuctotK^brillunlande^ubcrjnt 
leadership  ot  the  Coir  mittec  for  Fair  and 
Open  Ts'stingandnuny  othcnndisiduaU 
gathered  here  todav  New  ^ork  Slate 
enacted  Amen*.js  lirsi  con^prchencisc 
Iruth-in  lesting"  legisjjtion  Ihe 
en Js tinent  ot  this  legislation  show  s  that  a 
coalition  cmsts  u)  lOaVo  (he  testing 
^(Hp(trati<>n\acct)uni:!ibtcii)theconsunKrs 
who  pay  Ijtcslokecpitalloat  Our  task 
todjy  IS  to  develop  suatcgiCs  that  will 
Awke  this  testing  reform  mosement  of 
ours  strong  enough  to  drag  KTJ>.  kicking 
andv.reaining  mtuthc  twentieth  century 

Once  again,  it  n  a  pleasure  to  be  here 
today  -thank  you 

Chuck  Stone,  ETS  foma  Oiftaor  of 
Mmoni\  Affutrs  n  sfnior  htiuor  t^Tkf 
Pkiladflphia  Oath  Nrws 


In  many  communidcs  around  (he  country,  (he  qua)i(y  ofedu- 
cadon  is  being  measured  by  (he  scores  children  achieve  on  i(an- 
(ardized  (ests.  Educadon  (hus  falls  under  (he  junsdicdon  of  (he 
language  of  slatisucs,  and  i(  is  a  fac(  (ha(  many  sch<yols  arc  now 
designing  (heir  prograrm  almoi>t  soldy  for  (he  purpose  of  increasing 
(heir  s(ude;i(s'  mean  tes(  scores.  Here.  i(  is  slighdy  unfair-fpr  me 
to  rcpea(  the  joke  abou(  (he  sotisdcian  who  drowned  while  (rymg 
to  wade  across  a  nver  wi(h  an  average  dcp(h  of  (wo  fee(  The  fauh 
IS  no(  with  s(aiis(ic!ans.  whose  special  language  is  a  remarkably 
useful  ins(rumcn(  for  uncovenng  abs(ract  fac(s  The  fauh  is  with 
(hose  educa(ors  who  have  fallen  under  i(s  spell  and  have  allowed 
(heir  purposes  (o  be  subverted  by  (he  scdutdons  of  precise  mca- 
surenven(  '^Neil  Posltnan 

Crazy  Talk,  Slupid  Talk 
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Conunued  from  pa%e  16 

•womeJ  by  the  fact  that  no  one  knew  bow  ETS 
scored  Of  equated  lis  tests  or  what  the  company  did 
with  the  tnfornution  they  had  on  o\er  TO  milliofl 
fioday  S5  million)  Amencans 

•  womed  by  evidence  iiHJicatm|  that  the  multiple- 
choke  test  format  penalized  deep  *iui  creative  siu 
dcni»  (Sec  The  hrannv  of  Testmit  by  Banesh 
Hoffmann.'PKCrowell.CollierPrcw.  1962) 

•  vionied  by  the  faci  thai  research,  includmf  some 
done  by  BTS.  has  jhown  that  coachinf  improves 
black  students  :est  scores  the  most— yet  black  stu- 
dents are  probably  tlie  least  able  to  aiiend  conthmg 
schools— schools  that  van  cost  aj  much  as  5300 

•  tM>med  by  the  fact  thai  in  1979.  the  Amencan 
CoilefcTeMini  Prot/am  asked  Hve  health  expens 
10  examine  their  126  iiem  muliiple*choice  health 
care  knowledfc  proficiency  lesi  and  eliminate  the 
obviously  incorrect  ansvvers.  ACT  researchers 
planned  to  esiimaie  the  dimculty  of  iheir  lest  by 
the  number  of  the  possibly  plausible  answers  that 
/emained  To  ACTS  cha|nn.  each  expert  elimi- 
nated ks  bcinf  obviously  incontct  between  9  and 
26  of  the  answers  ACT  stated  were  correct  (Sec 
Fall  1979  rettmf  DifestJ  ^ 

•  worried  by  ETS*  past  practices  of  Mndmf  one  score 
to  stents  while  sendipj  umversiiies  different  scores 
(hat  were  derived  from  secret  statistical  manipula- 
tions that  had  the  effect  of  reducin|  minority  and 
lower  scci<xcoflomic  sutus  students'  chances  for 
admission.  (Sec  Kelfn  of  ETS  Allan  Naim  and 
Ralph  Nader/p.  246) 

•  worried  by  the  fact  that  an  ETS  employee  leaked  a 
"confideniiaT  ETS  report  daied  Au|ust  14.  1978 
outhnini  the  non-profit  company's  plan  to  iMrtase 
by  $450,000  ETS  experxlitures  to  improve  "Public 
and  Professional  Anitudes  Towards  Testing  and  EtS  " 

•  worried  by  the  fact  that  just  ohe  word,  or  more 
accurately,  one  nunibcr  from  a  lest  publisher  can 
unalterably  affect  a  person's  life.yct  that  pe/son  must 
tnist  ETS  that  the  test  is  fair  and  is  scored  correctly 

How  Thtth-ln-IHtJjni    Workinf  In  New  York 

After  lakini  a  recent  Scholastic  Aptitude  Test  (SAT),  a 
Pitisfoid.  New  York  high  school  student  wrote  to  ETS  pointin| 
out  that  one  of  the  lest'*  reading  comprehension  passages  that 
dealt  with  how  migrating  birds  navigate  wis  inconect 

"Reading  false  statement  $  docs  tend  to  jar  one's  senses." 
he  said,  "possibly  causing  errors  to  be  made  lo  answering  the 
questions'^ 

Another  student  identified  adiscrepancy  on  ETS'Oclober 
21,  1910  Preliminary  Scholastic  Ap<itudeTe$t'(PSAT).  He 
proved  that  the  answer  ETS  selected  as  correct  was  inferior  to 
another  ebo*ce  ETS  acknowledged  their  error  and  decided  to 
courit  bodi  iheir  initial  solution  and  the  xtu«l  correct  answer 
(see  bKk  cover)  '"^ 


Michael  Simon,  a  recent  graduate  of  Columbia  Univer- 
sity's  Masters  Program  in  Intenutional  Affairs  who  took  the 
LSAT  last  summer,  wrote  to  ETS  that  their  computer  had 
inconrctly  marked  a  *'no  answer"  in  five  places  where  be  had 
entered  a  reply. 

Such  increased  scrutinyof  admissions  tests  is  one  result 
of  New  York  Sute's  Ttuth-in<Testing  law.  whKh  went  inio 
effect  January  1. 19t0.andgivescollete  and  graduate  school 
applicants  the  nght.  after  Korcs  are  reported,  to  obuin  a  copy 
of  the  questions  asked  and  their  answer  sheets. 

Test  publishers,  whounifoimly  testified  apmstthe  New 
Ybrk  bill,  have  reacted  differently  now  that  the  measure  has 
become  law.  Eighteen  months  ago  ETS  Vice  President  for 
Law  Programs .  Thomas  0.  White,  wrote  an  internal  memo  to 
ETS  President  William  Tumbull  (Fall  1979  Tesmt  DiffU) 
stating  that  sjnce  Ihith-in -Testing  had  become  law.  pub- 
lishers shoulddotheir  utnKMt  locompty  with  it  Today.  White 
IS  president  of  a  new  noo-^  affiliated  orgamiation.  the 
Law  School  Admissions  Service  (LSAS)of  Ncwio>Mt.  Penn- 
sylvania, which  administers  several  programs  previously  nin 
b/ETS  (including  the  LSAT). 

45%  RcsfOMe  Raite 

Law  School  AdnussKm  Council  (LSAO  Has  extended  ^ 
the  benefits  of  New  York's  law  to  students  throughout  the 
Unted  States.  On  the  May  1 980  Law  School  Admission  Test 
(LSAT)  over  65%  of  the  test  takers  requested  a  copy  of  their 
questions  and  answer  sheets. 

One  of  the  reasons  that  LSAT  test  takers  have  taken 
advanuge  of  the  law  is  that  the  LSAC  has  clearly  informed 
students  about  their  new  nghis  Test  takers  can  ofcUin  a  copy 
of  the  test  and  their  answer  sheeu  by  Just  checking  a  box  on 
their  original  registration  form. 

LSAS  PrcskkiK  White  told  Tfc  iVw  )trk  Ttmfsitkrmrba 
ZJ.  1910)  that  as  areaultofthe  New  York  bill: -Pfcople  can  see 
more  of  the  e  tement  sofa  process  that  is  cn  tical  to  their  carter 
decisions,  and  they  can  correct  any  mistakes."  - 

Law  School  Admissions  Council  Dtrecloc  Bruce  I. 
Zimmer.  m  his  testimony  before  the  New  Jersey  legislature 
on  Febniary  II.  1911.  explained  that: 

Test  disclosure  prom<ues  confidence  in  the  inteifity  of 
the  test  insttwntni  and  the  testing  process.  It  is  sym- 
bolie  of  our  public  accountability  Indeed,  openness 
helps  us  in  our  quality  control  efforts.  Consequently, 
our  Board  has  decided  that,  effective  in  the  1981  •^2 
testing  year.disclosure  of  test  forms. answer  iheetiand 
credited  answers  will  became  a  "built-in"  and  auto- 
matte  part  of  our  testing  program  for  all  candidates. 
This  result  comes  first  btcause  it  hi//  bt  cost  effective 
for  us  to  send  test  copies  to  all  test  takers  rather  than  to 
handle  tens  of  thousands  of  order  s-'but  also  because 
test  disclosure,  if  it  Is  technically  feasible,  appears  to 
fv  a  service  our  constituencies  support  and  are  willing  to 

f^^^'^  plfose  turn  to  page  12 

Committee  Co'Directot  John  Weiss  drafted  Americds 
first  federal  Vruth-m-Testing  bill  for  Congressman  Michael 
Harrington  In  1977. 
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Ihith-in-'ftsUng... 

Continufd /rem  paf^e  II 

Despiie  the  hi'jh  request  race  for  ihc  LSAT.  the  College 
Entrance  Examinalion  Board  (CEEB).  the  spon«>fi  of  ihe 
Scholasiic  ApCKUffe  Teu  (SAO-  mainuins  thai  the  law  {ives 
siiMJems  n|htt  they  do  not  wanL  In  a  November  23.  1980 
interview  with  JheNrw  Hbrk  Timts,  CEEB  PreSKfcnt  Georjc 

 JUftfecd  waicd  that  Ihe  percentafc  of  New  York  «udents  wbo 

have  so  far  been  wilhn|  u  pay  54  65  »  obtam  a  copy  of  their 
SAT  (appfoximaicly  5  percent)  coftflrmv  »hij.  The  Board  has 
also  imposed  a  $L75  Surcharfc  for  all  New  Yoric  lest- takers 

There  is  a  simple  reason  for  ihe  hifh  school  students' 
low  disclosure  rtqueU  r«c$.  ETS  ind  CEEB  officials  have 
gone  out  of  their  way  not  \o  inform  uudents  aboyi^lhe  law 
CEEB  President  Ifanfofd  k>M  Tht  Srw  Ifork  Times  "Why 
should  we  go  out  of  our  way  »  push  somcthin|  we  don't  think 
IS  useful"*" 

Another  reason  the  SAT  response  rate  has  been  iow  is 
that  instead  ot  just  checking  a  bo«  on  their  initial  registration 
fotm.  SAT  lest  takers  must  fill  out  a  special  form  »  obtain  a 
copy  of  the  test  In  severai  instances  ihis  form  has  not  been 
inclutlcd  with  the  regular  registration  form  These  special 
forms  are  rwcded  because  the  Collej:c  Board  only  allows  New 
Yofk  test.ialters  access  to  iheir  lest  questions 

Sponsors  f)f  the  Onduate  Record  bxaminatton  (ORE>^ 
and  the  Graduate  Management  Admission  Test  (CM  AT)  have 
joinc4.L5  AC  in  voluntarily  making  diMlosure  national  pol- 
icy National  disclosure  allows  publishers  »>  spread  the  cost  ' 
of  making  new  icst  questions  oser  a  much  larger  number  of 
lest  takers  An  fcTS  official  loki  TheNrw  ibfk  T\ma  f  1 1'2  V80) 
that  were  the  College  Board  »  adopt  a  similar  policy  Ihe 
additional  <.ost  for  each  SAT  examination  coukl  be  kept  to 
about  Vltcnts.  but  the  view  was  to  punish  Nfew  York  State  ** 

In  February.  1980.  six  weeks  after  Ihe  New  York  bill 
bevame  iaw.  New  York  State  Rcpublivan  Senator  Kenneth  P 
LaVatk  told  the  following  ^ory  lu  illustrate  his  frustialtun^ 
with HTS  and CliEBoffitials  Inthe early  1960'iwhenCon 
gress  enacted  auto  emission  regulatiun\.  both  General  Moton 
and  Toyota  hired  I.OOt)  new  empl<^e/  Tt>y^>ta  hired  1.000 
new  lawyers  tSee  Winter  19^1  Tenttng  Digest  for  list  of 
lobhyius  hns  ha*  hired  ) 

•Test  Qu«»iy  Ur* 

ins  President  William  njmbull  recently  told  his  senior 
staff  that  If  publishers  Mind  firm,  the  testing  relorm  move 
menl  will  wither  "If  I  read  my  tea  leaves  njht."*  he  con- 
cluded. "th«  tide  of  public  opinion  may  be  turning 

In  spile  of  fumbull  s  call  »  stand  firm,  several  ETS 
officials  have  publicly  endorsed  the  measure  In  October 
'  1980,  ETS  Vice  President  for  consumer  Affairs  Jean  Bnttel 
K>ld  1  jroup  of  students  at  Harvard  liniversiiy.  ThJth-in 
Testing  legislation  has  not  banned  the  quality  of  our  tests—  in 
fKt.  test  quality  probably  has  gone  up  " 

And  ETS  Senior  Vice  President  for  Testing.  E  Belvin 
Willums  lotd  Thr  *\ew  York  Ttmrs  education  editor  Edward 
Bsk  that  New  York  s  Thith- in -Testing  bill  has  prodded  his 
company  inio  'a  healthy  re  .examination"  of  the  organt/a- 


lion's  internal  procedures  Williams  concluded  that  due  to 
Trulh'in-Te sting  "I  can  say  with  absolute  certainly  that  the 
quality  d  id  not  go  down  on  any  o  f  ou  r  tests .  To  the  contrary  it 
IS  better  than  ever" 

Co*t  of  AdmlnbteHnt  ll'uth-ln-l^lRtc  legislaihNi 

InFY  I980thc  New  York  Suic  Education  Department 
incorporated  Ihe  com  of  adminisitnng  the  Truth  in-Tesling 
law  inu  their  gcperal  overhead  budget  The'  state's  pnn 
ciple  expenses  were  to  file  and  store  Ihe  data  provided  by 
the  test  publishers  In  FY  1981  the  State  Legislature  made 
no  special  allocation  to  cover  Ihe  costs  of  the  taw 

How  Many  IbU  Are  Still  Adminlsterrd  In  New  York 

Three  days  afierihe  New  York  State  legislature  enacted 
Truih  in-Te sting  Iegivl<jtion.  test  publiUiers  announced  that 
twenty  of  the  twenty  >ix  tc>ts  covered  by  the  new  law  sw)uld 
no  longer  be  administered  m  New  York  State  Most  of  the 
publishers  who  withdrew  their  tests  did  not  (tsiify  at  the 
Legislature's  May  9.  1979  hearing  on  the  bill  After  a 
February  |980  heanng.  Ihe  New  York  legislature  adopted 
several  amendments  (outlined  in  the  appendix)  and  test 
publishers  reinstated  fifteen  of  the  previously  withdrawn 
ests  Today  97%  of  the  covered  by  the  bill  arc  adminisitred 
in  New  York 

What  is  to  be  done? 

Unfortunately,  there  is  no  simple  answer  to  our  <  unent 
overreliancconnorm  referenced. multiple-choice  tests  The 
process  through  which  reforms  will  be  implemented,  how. 
ewr.  should  be  analyzed  m  terms  of  an  evolutionary  pwxess 

The  first  step  in  this  process  is  to  provide  teachers, 
parents,  researchers.  siudenl*>  and  Jegislator*  with  acc«!»!»  to 
(he  intormation  (hey  r>eed  tomake  mtelligcnt  decisions  about 
how  AnrMrica  s  students  and  v^orkers  should  evaluated 

ETS  IS  currently  promtMing  the  hndings  ot  a  Gallup  Poll 
they  commissioned  which  fotnd  (hat  81  percent  of  the 
Amencan  public  is  opposed  to  govemmcnl  regulation  of 
standardized  testing.  Truth-m-Te sling.  howe\er.  is  nol  regu- 
lation No  boards  are  sel  up  No  requirements  are  mandated 
All  that  test  publishers  must  do  is  provide  students  and 
re^archers  access^  Ihe  data  they  Wed  to  ensure  that  tests 
have  been  correctly  scored  and  accurately  reflect  what  they 
are  supposed  to  be  measunng 

As  Palnck  Rooncy.  President  of  the  Golden  Rule  Insur 
ance  Cor"*^(iy  and  number  of  ihe  State  of  Indiana's  Repub 
|ic;»  ^vemitig  Council  testified  in  New  Yoik.  "If  this  piectf 
ui  legislation  dealt  with  Ihe  insurance  industry  or  with 
other  profit  making  ventures,  there  would  be  no  question  at 
all  of  Its  passage 

Acompttttunabrtdf(tdcopwofJohn  Wrm  tfstimom  is 
tn-cilabU  from  Tht  Commiutt  Room  1000  5  Bttlman 
Street.  New  York.  NY  10038  for  SlOOO.  SS  00  t^iihom 
opperuiUes 
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The  1btif«  Diffeft/SpriDS  mt 


Starnnf  with  this  issue.  The  TtHing  Digtst  v^ill feature 
Items  from  tests  disclosed  under  Sew  York's  Truth-m  -Testtnit 
taw  The  first  test  shall  examinr  is  the  L«w  School 
AdmlMtoMlMt—d  W<  KAi<  h  ts  required  by  r\en  ock  redtted 
la^schwT  admissions  department  The  following  tSM  items 
focus  on  issues  relating  to  cin/  riihs  and  labor  union 
activities  Jhtse  questions  Subject  matter  could  ad\erSelv 
affect  certain  test  takers  concentratton^and  scores 

I  civil  rights  Items  

SiukJ  boiJt  1  Z«lj  empire  c  tltnJin^  oNtr  huf>dfc<l%_of 
tfywuntly  o(  muvc  mik$.  and  ihal  cgftUincd  >ome  <\k> 

(A)  cxJciKlini  over  hunJreJt  of  ihouwndi  of 
y)uare  mile«  ind  thil  co<Ha>ned 

<B)  e»Jcniive  over  hundred* of  ihouwftdi  of  5<;uare 

mki.  ind  itcoouincd 
(C>  itui  extended  over  hundreds  of  (howunds  of 

Sffiue  mi!es  and  cootatmnj! 
(Of  th4t  extended  over  hundreds  of  ihoutands  of 

u^uwe  mik%  «nd<oniained 
f  bl  vkhKh  wif  etKndinf  o^er  ihouunds  of  squire 

ntileiandcoAliinM}: 

6  Afrikunt » the  Uny uajK  of  the  njlmg  party  in  Sooth 

A 

Africa  and  of  ihe  Afntaners  ^«>hov(!  vo<ct  nMtntain  rhe 
B  C       ,  O 

b 

7  The  Supfe^nc  Coy rtiyWih*»H»n«  inherently 
vnconMilulioiMl  for  i  white  *ub«rt> »  refuJc  »  change 
/ofimf  rules  y>.>)Kh  pfXlicil  cffe<Lwa*  *o  htock 
commiciion  of  ricuIJy  intcjraicd  hou^in^ 

rA»  whKh  p^ocal  erfccj      m  bkxk 

(B)  whKh  practtcal  effcci  '*eit  lo  block 
(Ci  vkhov  pracitCal  etfcci  wi» »  block 

iD)  of  \»hKh  ihe  pfacitcal  effecis  were  bkxkinp 
iti  whine  p«'acitcal  effecis  were  blocked  by 

12  Do  you  ihmk  that  oyr  univtrwy  oughlW  p>  on 
ditcnrntnatin;  apiinsl  diMdvanta^  students  by 
nmhnuin}!  Us  currenl  admitsioos  potKiev ' 
In  ierw»  of  itt  J^f  »cal  fcMures  the  q«<«ion  above 
most  viosely  ^tWmbles  whKh  of  the  followinj'' 
tA)  Dd  yea  ihmk  that  whatever  people  do  is  . 
ni-hi^ 

rB>  Should  ywt  ne»|thbof  stop  beatmj  his  wtfe^ 
(C)  Oo  you  think  Chiklren  shovid  be  iiufhi  lo 

belteve  m  the  deviP 
tl>t  Should  foftc  be  used  to  prevent  *  person  frwn 

coflimittinj  vuictde' 
tti  Does  pt>wer  soiwp*  people  and  abvohitc 

power  v>»mip<  ih<m  absolutely  * 

1 1  Mf  Kmney  spc*k>  reverefnl;t,  t.t  l>i  Bon  the  «h*>lar 

^  A 

ind  dismisses  js  a  hiti;>rc!dcrK  foolishness  f>u  Bois 
H 

jotninf  the  Cofftmuftist  Party  at  the  age  ot      No  errof 
C  D  t 

Thit  iirm  i»  /Af  t>nU  qufstutn  on  (he  (Hi%t  three 
LSAl  t  thai  teo'urrtt  it  t*i'noii\  W<«A.  person 


pufc  13 


union  Items   

4  Dofotfiv  Day,  the  founder  of  the  C>thot>c  Worker 
A 

Movetneni.  has  been  jiiM  enhtjimes.  rnoarcge.rtt  a* 
B    ,  CO 
an  iUcial  pKketer  for  Cesar  Chavez's  Utirted  Finn 

~b 

WorUrs  \n  »973  Ko  error 
b 

11  The  boilding  tr»de<  unions  tpoear  wiUini »  make 
A 

Witts  and  benefit  eonce«ion»  in  orde.rjg  bccgnjc 

D  C  D 

more  cowpetiltve  with  nonunioo  tabor  No  error 
D  t 

13  Real  wayes  bc^ean  10      tony,  before  oniont  becan< 

powerful,  and  the  level  of  real  wijcs  in  varww^ 

A  B_  - 

CPU  nines  bear  no  relation  »  the  «renfth  of  the  un^ 

*Ti  ^^c  D 

movemcnl  m  those  cwjntfKt  NoerrOif 
D  E 

25  In  ihe  p<r>od  since  1937  when  w»|cs.  salaries  and 

fringe  benefits  climbed  to  the  hithe«  leveM  in  hisiofy 

^>sent(«is(n  rcsuitini:  from  real  or  fancied  illnesses 
B 

have  been  increasint  at  an  axtrag  annual  nte  of  2  f 

C  O 
percent  Nq.errof 
L 


—How  To  Order  Tests— 

As  a  rcsuU  of  New  York  Stale's  7hith'tr)'Xcsttnf  Uw. 
copies  of  actual  sundardtzcd  tests  a«  rww  available  w  the 
^ncral  public, 

•  Scholastic  Aptitude  Test  (SAT)— The  four  SATj 
disclosed  in  New  Yoflc  State  from  admit) islral ion  in  the 
January- June  1980  period  are  available  by  wnlin|:  to  College 
Board  Publication  Orders.  Box  2SI5.  Princeton.  N  J  01541 
Request  a  copy  o^  Four  SATs  with  $3  00  per  copy  prepayments 

•Graduate  Record  Examinations  (ORE)— CREs  may 
be  ordered  by  usinf  the  order  form  in  the  Bulletin.  v>hich 
fives  dates  the  tests  will  be  ava  liable » or  by^  letter  to  Graduate 
Record  Examinations.  Box  955'A.  Pnnceibn.  N  J  OS541  for 
52  00,  prepaid.  Also  available  tn  the  same  way— by  order 
form  or  letter— arc  the  two  GREs  disclosed  tn  the  January- 
June  1980  pcnod.  now  published  together  for  S3  00  prepaid 

•  Uw  School  Admissjon  Test  (LSAT)— May  be  ordered 
by  venting  to  the  Uw  School  Admissior»  Service.  Box  2O00. 
Newiown.  PA  18940  Send  S4  00  prepaid. 

•Gr»duate  Management  Admission  Test  (GMAT)-  "By 
policy  of  the  graduate  Management  Admission  Council 
disclosed  tests  aa  iiot  available  lo  noncandidates  "  (There  are 
sample  questions  in  the  Butleun.  a  full  test  is  in  the  Guide  to 
Management  Educatior).  avaiUNe  through  bodcstorrs  at  55.00. 
or  by  order  form  m  Bulletin  or  Jeticr  w  ETS  for  54.00. 
Graduate  Management  Admission  Test,  Educational  Testing 
Service.  Box  966.R.  Princeton.  N  J  08541  ) 


ERIC 


164 


Ihf  Irsliiij:  IhKrM'Sprmj:  IWI 


tftxirMf  i  IS  f««  pjrfmll>  V  »^*>J  'h»  InjHh  m  - 
Apfifthk  ICN<^  Jr^  *<H  4^  l^*''  instil  Okn^x 

Oji  /V        .  nj^^Nd  'Iviv 


ETS  Caught  With  Its  Integers 
Down  a  2nd  Time  „ 


The  List  Business 

A  vfi«v  /'^«  ./.I  I  IS  <  1 1  H  hjv.  Ulkd 

m  B  I  Is  -*fviJ««J  swJv'm 

vthft>'i  ^jvViCf >w»>d  >f>"i  'Jt»"l>  }rx<MtK 
fhf  SSS  »>w^»n*  ihc»f  tjNt*       ifx  t«»f»^ 

I     >CJ<  ssS  ><>M  J.^>^  ^.ontrfimnc 

«Air  '!!  r,?lUt«»0 'MOWN   vdl»t\.«I  i^Vxt  S' 

m«rt  pit»iif\     <  ».  <  I'l  t  f 

SSS       "iv^*  n«^  initrfii^  ^luJcnis 

'♦White  Only"  I  Ul% 
Dk  March I'^XI  v<--  k>'«  Wrt^j 
rcpcrtfd  Ihjl  Usl  >Cir  Mrxfit  v\>t 
k|c^  uwd  the  SSS  10  purcha^  ruilmjj 

of  jutt  vkhitc  SAT  Jest  uKcr\ 

IK   Ihpx'  w  jf  tbt  t»fyrc        he  H  W^S 

UHmcti\  ^<k'^.t»^cv«'llcvv^^*^^>^tMye^k^l 

'Were  rx>  l«^),"Cf  4n  adu»vM«>nx  »>Hkc 
«c  re  4  /f*ru»tif»f  njciMitikKfit 


,A  y4M*h\  hi^h  mIk*'!  Mwktii 

u>rd4nv*>ltcj!CJ(liniv<ii«m>  mth^s\>.  ihc 
Ax  J  nrvult  Ihc  IaJikjikhuI  Ic-t  njj 

New  VYVlAVKJtKinvitTKtilxpralKicJ 
ttut  -at  to      aUiIniuI  stiKlcrtfx  u>ll 

the  cm*  was  dli<*t>Mercd 

rhcJikknt  M«h(tp()in<(,xi«<u((tM.  IjuItv 
ijucMMXJ.  P  scar  old  MkHjcI  (wlJi^jn.  * 

Nc\\  tits  No^  VhV  /Ak  \o>  hftk 
fnnci  tfut  he  wf<j«  h»  tTS  hci*usc  Qucn 
iwn  #l(uioh*NSAr  didn  I  iiuKc  Ncn^c  K» 
nv|h»4u\cl  If  hjd  (M*<>«nsw:r<. 

WA/<A(«««  tnikrfnTtittinx  t>m 
r<u»^t>"tfuhf  iqmin  <iiiit  /nfr^vr  fi</ 
rhf  i  u'f  li  ti  Jilfcrtnl  tntfiHr' 

r/f^  I A    V  * 

f<> w  : 

<  '  »  ft 

AnsvwtrU  »Mk,|viixtiKV\l4'>3p»AMNc 
insucr  (<*  >4ulcntv  ^»h^^  rvwJKniml  that  4 
^*  jf*  the  vjuJtft  i>l  2  and  thit  X  w  jts  the  vulc 


ol  Z  •!  wax  nveUxJ  wnmi:  l>cvju>c  Ihc 
quoiHtn  Np^uircd  thai  the  intcfxrv  be 

Ml  <^Ul))^w^nuIicdCva»TW.1an^^*tr 
tlt>  but  at  the  linK  liC  aiv*  noted  llui  (C) 
^»'^^y^J  jlv*  he  v«<iTect  bccjuvf  *  iv  ilv>  iJie 
vfiuxe  ol  minus  2  "^hvM  iv  a  diltcrfrt 
ifVkver  Iroii) «  IJevau^chchxlfKXKxxJ^i 
therr  were  (wo  amwwv  he  cxen.r>cJ  hjN 
of«nw>  k«  MX  th:  icM  t|uestK)n>  anJ  his 
anvwefN 

I  IS  ollKtals  told  7A<-  Timei  that 
<  bJIi^  vdtxxTvwv  w'J>'a  dmt  ^\«Nafji:nk'e 
Ki  Nc*  Y«V  s  Hixxh  in  lc>i«ng '  U\*,  which 
irtjuircskrsfiiuKersUJprjiMtlc  s^uJentswith 
v«>j)n.N  «>(  the  kjsl  and  tlKii  aiiNwct  sheets  Ml 
dt>s  allcf  their  scores  arc  rfpi>rted 

Ibe  em>r  did  not  alfcit  Mudcnts  »)mi 
M^le  New  ^ortv  J>UtC  Uxau^<.  unJiVc  s|X)n 
M"i  «4  the  Uvk  Aptitude  TesJ  and 
•Khci  aJnnNNKins  u*>|n.  the  C*^^'  HoanJ 
dcs.tdedr)oit(iiiuVe  disclosure  t^iu^KMU} 
r^'t)  

SATs  Not  Required 

By  28  Minnesota  Colleges 

r«enty-cij:ht  o|  ShnneM'ta  *  ^1  sol 
If^reN  and  unisersitics  all<»*  Mudents  to 
xubnut  l^elunirur>  SJxitastic  Aptitude 
K-Nt  iVSW »  in  lieu  of  SeholaNtic  Apti- 
tude leNt  <SA1 1  Hw  three  ^ oilers  that 
villi  mjf>daie  the  SAP  arc  *rruU  religious 
irjNtuu()««nN  The  institutions  that  auep« 
PS  AT  M«vre*  irklude  (  arluvn  The  i'ni 
\crMt>  oj  MipfKM»ta  aoJ  the  eniite  sute 
^olle^-c  s>Ntem  lbs-  \*S\[  ^osts  students 
SMS  |heSAr^ONtsS9  2^ 


—Solution  to  PSAT  Question  #44— 

Mr  Lowen prt)vcd ih.it answer rA^/zir waMorrccl because 
faces  ABC  and  EiGH  and  faces  ACI>  ainJ  h\'\  fonn  |urjllcIoi:rams 
when  Ihc  s<»Iidv  arc  placed  logclhcr  (sec  bclou) 
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API.  Study 


jUhhUI^.  1. 1  h..  Ik 'J -C^ti  J  .\  n  >l.>\*.v.} 

vmhiU'K^'  ^JUr^*.^^rt^)!^.  onhc 

Hiri<.\  .H'Vsl  DjsiU  vftfuf/c  f^^.'■  vif 
MiUt         MHxl      IN.  <  nivitviU  .'i 

Vi.vt  icat-'-A ^»,v>.^^ 

•Ah'sN  M'H  ^if'tniunca  tlx  J'nuKxl 
\  fitr^Ji"' '  «i«v  >ti  »ff  ns^"i^  jfiAli«k\up4" 

J«.ubtv  jiK»yt  -\  V*.  .'l  ^  A"'<'''«1 


The  Committee  Tor  f'jir  &  Open  Testing.  MasNathusettN  11  A. 
Mavuthusc'tN  Public  Intercst  RcNcaahCjnnjp.  MaNN4KhiiscttN  Tcj^-hcrs 
AsNOCialion  anil  The  Njltonai  C()nfcren<.c  ot  nij«.k  L.i\*\crN  jrc 
jointly  NponNtuin^  an  informjtion  jnd  ideas  sharing  (.onterente  on 

Evaluation  Reform: 
1'he  Next  Five  Years  ^ 


When: 

Salurdav.  May  2.  198! 
Where: 

Northeastern  Lav.  School. 

Boston^  Massichusells 


E'or  more  information  conta*,! 
John  Weiss 

Room  1000.  5  Ueekman  Street 
New  York.  NY  |{X)18 
1 2121  349  64(>() 


jfxl  np*>fnng  (i|  ihc  All  ^titj>  l^  jtki- 

(  onclusion 
The  Al'l  MuJv  <^  J  tlji»-*.K  txatnf4c 

'<minj|K)n  i*ilfu>yl  an  m  depth  ctjimi- 
n4lK*n  <(t  (he  ondifrlvin^  <««>\uniption\ 
I^c  kvM>n  t*>  /tameU  Irom  tK  \VL 
^luj\  lb4l  i\  IS  djn^rous  u>  i<»sc  Mf'hl 
oi  (h^  j^tuji  ic^ic  ^ut,^tK>n^  ^h^n 
inurpr^ttn^  Ic^l  rc^ulU  ^nd  N>fniuljUrT)>: 


Hjno  jnd  l)j\»d  ii»  js\<^Mn^'  Ih*. 
cikaofthc  \Vl  pn>^tjm<»>n<M\  h 

</cd  and  hu^«.ntKhcJ  th<  NKi>  t'UuuK 

Yd  It  hj^  ^^^s^.d  <ii  proiiHPtt.  j 
fiuc^tJofijbK  i>,<u«iA  jppj»>j».h  iM  (ht. 

iM^yrftHi  Kn»ink  munwi  ii.nl 


CHANGE 
JOBS 

Chame 
Wbrld 


F^cr>  vcar  (.ommunit\  7oAj  JkU 
o^cr  2.000  lob'OpfniniEVincommunilV 
jnd  scKiat-chingc  work  rution\hidc 
And  c^crv  m^ih  our  %pccul  features 
help  >ou  jcl  ihf  /Ob  done  \t  >ou  arc 
J  college  student  tooling  for  An 
internship  a  dk^jcrunifed  N^orker 
tookmx  (or  meaningful  uor)^  or  an 
acii\iii  uanttn^  to  t^eep  mrormed 
about  s^hai  is  re.allv  h4ppcning4t  the 
i;rji>>rooi>   ^oult  ^»anI  lo  *ubscnbc 
lo  K<mirrjunil\  Job* 


-Ji',  .>!!  trtc  ».i>vfr  pfivC  r  I'  ^<'U  di"^t 
..n  ijioji  kv^p  v«>.t>  i  tftv 


Federal  Government 
Stops  PACE  Testing 

mifHVit)  i<^h  jpplujnts  vnthjfc*  thcjr 
lavi>uil  jjiainvi  ihc  1' S  <>(«\crnmcrtt% 
Offict  of  IVrs*inncl  ManiJ^^n»cnt  *hcn 
ihcfedcrjtjpcrK>  actcp»cd«hcird<nund\ 
thai  }*)h  jppluam^  w«vu!J  nn*  \*y{\p:x  hy,<, 
to  paw  Ihc  fisc'vearoU/'roA  <«'  >//<//<«></ 
Aiimim<tfau\t  i'uf*eft  xumtPM  ^  /  The 
federal  0<>*c<nnKnt  UNcd  the  PACI.  icvi 
lonarrovk  down  the  number  of  J pplujirnv 
for  nyurtj^nncrt  Jc\cJpo\<mnisnti<*>^ 
ranging  frtwi  u\ la*  <pc».  ijUm  i<»n»u^<y(n 
t,utan>r 

Hoi*ecn  l<>7<  jind  vmi  IVU  I 
Hrccncd  jJnvJ^t  j\\  nurMVJi*  jppU 
t,ar>|s  In  br^UifV  ft>f -"xjuu^li'  fo*or 
rhan  I  pcrtcni  <>J  Mj».K^  and  i  6 
ptft.cnt  ihc  hnpifiuv  i<n>lk  tK 
ciam  ^^."TcJ  hix'b  vi^nt^h  t»>  K  hf«d 
Dw  ■>^M^».c^'<'  fof  ^^hjfcs  L'  » 
percent 

The  PM  f-  le^t  *ill  be  replaced  b> 
bctACen  5o  aruj  «» ne*  e^jni*.  ihjt  ' 
bcnvfc«.lt»sely  ircJ«'>  the  ^pcxiht  A»IK 
needed  m  ejch  joh  A,atCjR>r> 


1'.' 
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"I he  TbiInR  IM«eil/SprinK  I9KI 


Cenier  for  the  Study  of 

Educ*iK>n  Jtnd  PtolitiCJ 

TlMl«9CiiH[DH(c«« 

Room  iOOO 

5  B«eknun  Street 

N«w  Yofk.  N.Y 


NoA-rwTiiOrt. 
US  roMJfe 

FctmiNo  7217 


hXClRKIS  IKOMTIIL  IhSTIMONY 
of 

JOHN  CORDON  N^tlSS 
bcfofc  the 

MASSACHlfSBlTly  STATE  LEGlSL/VUJKt 
tDtCATION  COMMITTbt 

Why  N«w  York  Pa^MdTVuCh-in.rwtlnR 

Mo*  Ywi  cnKtcd  Truth' I n-Tc Ming  IcgnUtKMi  b<\auv: 
New  Y<>rV  PI  A.  New  Vixk  IJucaUKv  A\vociitK>n  New  YorV 
IVrxonncI  aiHlCoKhncc  Av«xiJt«)n,  NAACR  Puertx*  Rkjh 
Ufal  Defence  Fund.  New  Ywk  Sute  Coo^unKr  PrntecHon 
Bo*rd  New  Vmk  State  I  Jiglnh  CwtKil.  NitMXWl  C  onfer 
ciKe  of  Black  Uw>er*,  New  York\  AtK>nK%  General  v 
Ofhrt-.  and  do/en  v  of  re  ware  h  xtenti*.t*..  includmj;  three 
former  tiTS  emplos^e  v  joined  the  Mudtni  directed  New  \of  V. 
fMPIiC  IntcrcM  Research  thxHjp  iN/i  WRO*  m  cutiiu^'-^ti- 
vjUv  tuppoftinj  the  measure 

The V individual  and  «V3ni/at«Hi\  ^upjx'^cd  the  t>iil 
bcca«Ne  they  were  — 

wed  about  tcMpub'«vhcr*  rer<atcd^!jimvthat 
thev  rarely  »(  c\rr  make  procevvm|j  mivtakc^ 
*hcn  errork  affecim^  aJ  lea^i  4W  <)0()  vtudcnt^ 
M:»»ret>  has*  occurred  in  the  p*M  fev*  \earv  iThc 
next  ivvuc  of  The  Tetunii  t>n(c»  docunKW 
thCNe  errori  i 

•  w(vrt»ed  that  The  Natwxul  ConJercrxc  »>1  «la%.k 
i^vw)xrs  rerorvd  that b!«k  sch4K>l  apf  t**-*"'^ 
wh4tb»d comparable  v^radesr  *  Ki  PA  I  iden 
HcaJma^T^.  and-attended  (he  \anve  under^triduaK 
inMnutK^s  a^  ihcir  vwhiie  v*>unterpjrt^  vi»wd 
.ncr  KWp<>«ntsh>weroolhcLSAT  iSee Fall  ivst* 

•  <A;>fr»cd  (Hat  f  rS  awarded  MyKjcntvpiev IMP  jptj 
tiKk-  H^xtt  vkhenthe'r»iwn>tad*c*  iftjKatedihii 
ther'  >^  a  Ufi  ih^rnc  that  a  vtudentv  M-orc  \*tU 
lluvtujte  trter  ^»  p«>intv  in  either  direction  u  he  re- 
take ^  the  test  Thji.  ftiKtuatiori  is  imp^^ant  bcj^au>c 
on  iwwt  ETS  tc>U  a  500  iv  the  ^Hh  percentile  whtlc 
4  6(K)  »N  the  *4ih  pervcntile 

Hontirtuetlon  p^iic  Ih 


htpxrtimuU  ,\8CD  oikI  FFGUI  xfuAMi  ulmr  oil 
f<Ht\  eurpt  htne  FC»W  are  e<futlatentl  trutnuff*  <>/ 
ciiiwl  »i.t  If  (tit  f  ABC  pkned  on  ftur  EFO  so 
that  the  ifOti  K-i  oj  the  tnonxley  iX»ntiJf  hn\  mm 
t  x(x>\f J  filter  wukl  the  rewltint  mht!  htwr* 


PSAT  October  1980 


I  IS  and  the  panel  of  16  college  professor,  the  tcom^ 
ium  hirrd  r;;%tcw  sheir  mathie^ts  both  agreed  that  on  the 
jKrtc  iwm  vh4)ice  ti  i  *f\en  correct  Daniel  U>*xn.  a 
|7  \car<»ld  CtKOa  Beach  Flofida  High  School  student  von 
Mrned  the  tc^tmjs  vorppany  that  an^utr  iA}fi\e  vorrect 
(\cc  p  1^  '«*r  dilution* 

US  Senior  Vkc  P/ewdent  for  TeUm^  Pro^ram^  «»ild 
fht  Noi  MTtmeHi'l? i^l PC  /Ithat thcque^tK>n wa^  a 
i,>g^>  item  He  continued,  that  in  the  future  r>ew  vjfe^jujrd^ 
w»>u!d  be  added  lo  assure  ic^t  quality 

PSAT  sc*>rc\  arc  used  to  award  nitlltonv  of  dollatv  lof 
M.h<>Ur>htp%  and  foradnjisMons  hi  Minnesota  vwllejxs  and 
oniscrMties  Because  the  discrepjrKy  »av  idcniitied  th<Hi 
sjodx  of  ^.^lldcnt^  lest  sa)rcs  were  upjpraded  by  between  <hk 
t   4od  tw<i  pcrtentajK  pointv  -p^nntv  that  «Hjld  pros<  the 
)  ddicrensc  between  them  »  mm  n>:  and  kninpofK  of  the  4  "XX) 
jinafKul  M.h<)brvhips  and  or  50  0(X)  letters  of  somniendj 
fion  the  rj^ulti  ntiUum  d4»lljr  NatKwal  Merit  Schotarvhip 
t   l^t^rjm  4nnuatl\  aN*ardv  vtudents  »ith  hn:h  PSAT  x^xcs 
\hc  PS  AI  Mr  U»\scn       wav  vtxnp^tsed  ol  old  S<h<>^ 
I   iisiiK  \ptitude1eMtSAHquotK»nv  bTS  Pubk  KeJitK«ns 
1   DircJ^T  R«*beit  M<Hjllhroup  ^id  that  m  the  pa^t  aK>ui 
st>O0tihii:h%sh»x)!  ^udenivSATN<,x»rcs»ercKx»lo*becau>c 
thcs  velcthrd  choice  A  and  were  marked  wron^j 

Ibc  (X^>ber  V)V)  PSAT  vwav  the  hrvt  PSAT  cser  ki  be 
rcleaM^d  \o>  the  publv 
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A|)|)CiulU  l>    LSAT  (luesUoiLs  rtli'a.M-U     a  rusiilt  of  Triitli-ln  Testing  legislation 


(At  O*  tiMt  wti ti«««(  4*  to ftt<kl7 

(B)  v*w  Mt«ik^  M*9  U«it*t  kto  wtl«7 

(Cl  O*  rM  UkUik  UU4f  «•  k  U««fci  l«  Wb«««  U 

■Wtof  wto»4«T 


••I*  »^  t  >^*4to^,^  to<  to  Oc*.*'.  dW. 


1  Owii»W«#>  WcMM  •«       torn  *t  aclM.*! 

I  rfto  ito^ito  •«  l>>.tnito>  if  nktij 


OmM  tow  1^  mI«v  to  tfw  MUwtof  ;.««Mtf 

K  W  MMMkMrt  to  CM  WW  Wliff  tovk  Ur  Wr  !♦  Ml 
Km  Mri  «>m  ktMflM  !•  *t  UM«.  *t  Mtotr  aaltH  ar^l 
WbMMMaf  rfto«4lwtW«  TW«M»MM^«4lK«lil*ri*w««l 
W»Mff  *«i«Mlt«  TV  wijiw.  xoyy  Wi  <«>nwto«J  i» 
II  I*  W  MTVMi  i^mcMm*  Mm*  W  ynwhliH  hto»,  im^  ikv 
mmm*  *•  am  4iv  to  AmT  M«y«  wWtff  »*v  'ffMk 
«iMAi>f  M«M  to«  Tto  mwmt  tornvrf  ■nmwflMwiV  to  ttn  m§*. 
tot.  bwt  *•  MMlvT  til— m>4  «M  Mr4»  pw<  4wmi  Uwv  mKm 

to  *•  ttik  •«  Jtowrt  vwl«*4»y  M  y**  Ito4  Im      •'•wK  Imw 


M  If  toX  mmttm  to  to/Tiri  ^Z*^*  f< 

*•     toi«wu4  ••(ibo  tx«riA«  a^r**"^  ^ 
A«  toi«»i  W  Urn  tpt'mt  •toli>  l#  itom  htm.  w  Omi  ^ 
M  iA,„ipi«< k ^Hl  to  mii.ifcte /mt  *r l»«i4tow  W4U> 

ti  A.  U»k  »«JkW  fcMW »*«i*«»<l  "k**^ 

><tonriii.i^H>to<»«»«<K— wu»«*« 

••fwi.WrMto*.»«lM«lMvto««Mv«MMf 


M  w4  to«U  h«  W«  «W  k  «m  »«i  ^  ««• 

tal  W«r«tf«M«rfMlKft>T*«4M4rw>«w%  Kff»«*CMi^ 


(D)  Im  WCMM  Jmm*  «rf  m(  mv  i^to«  U  Wi 

IS     a.«t— y<>  ^ffoit  i>       Iffoy  fcfftffi*  »»U»*  VffCffmff 
A 

Mwffrful  ^ddk,  Uwl  ff<lff«l»tM>i»  »ffrtff>i>C»i>»>Wffl 

(XT'  » 

»<fft  »♦  >fflff»>»*.U  1*1  ff  tyr>t\h  •!       MAlffw  m«>ffWffH 


to  i^fftff  (♦«i»|rtp»  Nff  ffntf 

— ,br  —  -  t  - 

ti      Ia  tkp  f«|t*4  fftoCff  «•!•»  »•'•'♦•» 

ff^»ff»ifffflffm  pffmtiiwififf*  •*  t«M»t<  MUffMff*  »|^» 
»<ff»lft<>fffft>yy  H  tW  fftffHt*  »*»«»tj^fflff*l2  tfiMfffit 

■       kt  o 

H*  ffriffP 

 ni  1 

 T"^^ 


7.  Th«  Swpr«mc  Cown  nilcd  In  JwKt.  W7i.  ihit  tiaie» 
m»y  flrtl  iry  d«f«ft<J»n(t  on  itrif^«  criminal 
I      chJrpc*  wlthoui  •  jury  If  It  liierj)rto^ltlct  ih< 
4tUni»nit  wUh  >n  opnortumu  for  i  i»«w  iria) 
before  •Jury.  No  trror 

 D  — E — 

7^  t)N  Suf  rtrm  CMit  niM  cku  It  f>  M(  lAlitrtnclr 
WAcoo»iitMiOMl  tor  t  white  aukurk  i*  rtfuac  t» 
cnaAfc  a*nlng  mtfla  which  |>racttcaltff*ct  waa  lo 
Vktcl  ekMtnicilM  kf  rkctaliy  uufiatM  (wuaioc. 

(A)  which  rr«cticai  tfr*ct  wta  »  Mkck 

(I)  which  yr*ctlC4l  tffecti  wtrt  m  kikck 

(C)  whoac  practical  affect  waa  i*  Mkck 

(0)  kf  which  ttm  ^kcilcal  aftacta  wtrt  ktocking 

(£)  wMkt  fracttckl  tfftcta  wtrt  kItcUkd  t>y 

4.  Dorochy  Dty.  tht  foundtr  tf  tha  CthtHc  Wpfktf 

MoyemkM,  Itit  >>tn  jallkd  atchc  timta. 

most  rtctnt  aa  an  ilWnl  klcktitr  ftr  C«s«r 

— c  tP*- 

Chavtx'a  tMiktf  Farm  Wtrttra  U  1973. 

No  trror 
— 

O.  McKtnftty  aptafca  revcfcntly  of  Du  Kola  the  acholaf 
tnd  di»ml>aca  aa  i  Nt  •(  aldtrly  foktlahAt^a 

— ns — 

DuOkla^a  jkfntwi  t>t  Ckrnmuniat  fany  at  ^>c 
ace  ft!  ♦S.  .Wo  tffof 

-*Tiyi  E — 

22.  ThttvtmaofSwtmhef.  1»7I.  U  SkA  frMClaco 

llkiatnic  not  wly  the  ttnilpna  »Mi  lyf lc*lly 
ff 

wtrwur4  tf«»«f  rtpiicvi  but  atao  ihc  Mlotvncfattc 
clrci»m«unct»  that  makt  eaci"  cliy'a  a»(*tfitoc« 

 ^   ^ 

with  tte  l<%»c^fw>re  unique.  No  ^J"^*" 

(.  A/rlUkAi  la  the  Unfukft  ol  the  mlint  Mrry  In 
South  ^ifrlck  a«<  of  tha  AfrlUntra.  whoa*  vo<t» 
malncain  the  auhta        Ho  *f  rOf 


33.  UfttthY  MwemklayTTstwt  kfttn  win«t«  »  choae  who 
CAIMWM  flfii  loba  tf»t  t*>»y  lli>«  Ik  Amerlc<  that 

 irn —  13 

l^kfka  Mat  kkt4a  t»4  ••fCmikke  •<  *«  «>«>n» 


ERIC 


168 


<.itortU»>  (A  Itrj»>  Kern'i  lUe  come*  frfi«r»  Crtt^C* 
»t»,  inctMiniMl).  rin*J 

,  in  l»»  fUnv  ver»loft 

*  refer;*]  lo  iHove  triv*  tMi  irw>  we  na  in- 

"i.  There  u'»n  ln>pofiiM  rfnimciion  bet»eeh 
1       4ltioninf  the  "•O  o*  • 

*      frweit  •wJtfJiipprtMt  ire  iccepiiNf 
for  lurJieXei  !•  e^'eci  cn»>»f  e  in  mtn$i^ 

m  ScneimeKilin  U  ««  •  <iiwiio«  twt  u  m 
\    CK^reiitOf^  Of  f  efw>ne  fethnf 


(A)  >0nU 

(•)  in  ofttv 


.  LSHT 

'^'Y:"!:'!— -JUIW'1980 

4.  H©«rAn^  re*ln>eflwieHe'>lin>>lcfnf*  v^e)> 
♦e'vei^checkiwftfelocne*  rc>om|^ere  tl  • 
M.mmoe*  Suiwrx   T>e  hen  profOWMllUimi 
to*ieCA>filr>  ire  •»thw»i«Ji>    And  nm<  wt  01 
un  <X  tf^rie  top  •l^^eter  h«»e  He'Min  Colof  M  In 
ttielr  lockVr»    9»c»-V3n'l  you     wiinf  11  loo» 
H  U  hkeKvttitt  the  •rp<»l  i^eritiemen? 
•k)vr  *ouW  I*  *eikf«eJ  LEAST  H  evWeiCe  thii 

(A)  He*M«V  Col»r»f  m«riuf««iureri  biij  f'ven 
coo^>?kmen<ir>  fc«iJei     coJofne  10  the 

ItlMOole  litertn)  fcelieve  •  mm 

Colof-Se^w^not  be  •  "reiJ  fMn~  no  miner 
•t»»i  evince  •»!«•  10  ifte  CO»«r*r\ 

(C)  ihe  £«r»oii*hc'*ro»e  the  nJvertliemen' 
^^e«^er  v%tt  He-M»n  CoJojne  nor  Uit  Oit 
•tereocvpe  of  ^  "re^rfMn 

(0»  nvjit  p<cijJ>  *^  M  cooiWcr  fo«b«n  ^Ii^f ri 
to  be  're»\  men" 

(E>  He'ManCoJ^  l»  «»eJ  b^  more  wonKn  tMn 


JO.  M*flyc»itrvire»*>Ao<»h*r»our  •iiumnicniih* 
-./«m<>n  tre  tAniieiji  p«iikve  in.3  tmotionit  thii 


women  •re  lAniitiji  pamvc  inw  skii^iuobi  -<•■ 
their  r»I««  rt.*i  be\(5cynemc4  ini  iMi  ih«>  c*nr^ 
ILnciion  ef/eciivel>  \t\  ^itiiont  of  ■uthoriij  " 

JO  ACConS»J»t  IP  v»*r>  eV'^'^"-  puiWIiy  It 

^  Jtote?  rJlm^  tc\u\k  .p.th>  1«  '""^f ,  , 
Mvknt  renrtcied  ihe  f*riic»p*i»3«  of  it*  %t9Jp  \ 
M<«tt>  fUHJ»  IMS  iMCtivu)  (•  ift  IhMSe  iroof  ^ 
"chirtcterUiic 

U  $«».^MMite.h*..'^»l*«>»*»"^P"'**^ 
vtlUe.  Mr 


1 


or  on  relrviilon  ofien  g«^»">' 
>  »hic>pfU'^rm  imMinf  fe»{i  m 


.  C*txott\t  in  ffwevin 
'  ^ei<^  or  ^>e^o^^e  »>>c>  pf't I 
?rjer*i(>><V  «''^^"'"<''"''  Wiciimi 
(A>  co^Mikft*  •  hero  or  he^Mn*  »Ko  perform 
(  r^)  cc*(i»»«  •  r>er<»or  her^^*^  perform 
(C)  tortui'-  »  here  f>r  herolftt  »ho  perfftrmi 
ID)  <ccri»n»*  •  htt^oT  heroine  ^rform 
iti  <orl»ift  •  hero,  or  herN^  fchich  perform! 


-»         ''tt.nit%l:in  rom'YLS2-2 
Ftmltlit   OpfuMMroToTe  E^I  Kl^ii  Amend' 
mcM  eUlmcd  0\t  the  »m«n<Jm«fti         <Jeprlv«  women 
•f  witn't  tradKloMt  proteciiooi.  »y  wneiitnt  ttiii 
•omen  moil  >e  proieaed         Urjer  •ociei>.  *eie 
(PMAemi  «Kre>)  tmplie*  th*l  wonr»en  c«flfto<  prceeci 
»»efii*elTei,  Tho*t  who  wtih  lo^oiect"  women  ^ 
•houkJ,  ^  ellmwKiMn  MCiet\     "pecui  proeectiont. 
flitentf  to  women  m  e^u*!  opportunux  of  Mn-pr^ceChoft 

He«i  commentwor   iul  tfie  ivfrtfe  womtn  li 
■ttyilCilii  wtiker  thi»      $vttk$.t  mm.  therefore, 
onl)  ••rrin  nee^      ihouWMve  »e  %ptci*)  prceecuwt 
of  lociet)  V 

Jl.  v^7i»eho*thefoJk>»ingcoukJcooirJtwieioi  imnS 
»nj  rc}ev4nt  ttg^mtt*  i(itnii  the  ne«i  com* 
meniiior'i  clu"?' 

I  M*n\  or»oclet)*i  iridliloful  frtXecUoni 

M\e  fu3#tln|  10  do  wtih  fhyilctl  harm 
n   PrcvvWinf  »oe»et>  '•  prcxectloo  onl)  yo  womefk 

»kU  kive  (tf)>ilciM>  weik  m<A  unpro<eeieJ 
III   A  ipectfic  difference  b«»een  iverife. 
lAdivkXiU  In  1*0  clitKi  of  people  doei 
not  neceiiMile  Ireiilnt  thoie  t»o  CUiie» 
dl^ercnil) 

(A>  I  onl*  \, 
(8)  UotiU 

(CMllool)  f 

(D)  lanillonN 

(E)  I.  II.  inJ  Ml 

22  In  her  •rjument,  the  fem»niii  freiuppoiei  which 
ofihe  foIk>»lnt'* 

I  The  fMln  fwnctton  of  loclet)  !•  lo  f  rceeci 
liimemberl. 
*  M  All  men'md  *omen  ire  eqyiHv  Ctpeble  of 
f  rcteCilni;  themielvei 
III   ThOM  who  wlih  10  •"proceci"  women  bise 
tfte  po«er  10  extend  i*  women  the  opporiunux 
9t  ftelf-pro(eeiton< 
(A)ionl>  * 
(fl>  Hfw') 

(C)  Itt  onl) 

(D)  larx^llonh 

(E)  I.  II.  «n3  HI 

13  Of  the  follo»int.  which  eipreiiei  the  rr»»t  u^fii 
ind  retevinKrliichmofthe  femlftUfi  miln  powj 
(A)  Self- protect  ton  »nd  protection  b>  the  Urfer 

»oeiei>  ire  not  lncom^«ilble  * 
(S)  Tht  ort(in«l  ntotlvet  letdmi  tot***  to 

prMeei  women  were  •dmlr*Me  one* 
to  All  ptopitht\e  the  rig)t  tnUtt,  llben),  •tvJ 

the  pur*uli  0(h*ppine** 

(D)  E^*l  rlfhi*  Im^t  ^u*l  re*poniibilitie« 

(E)  Men  ■*  well  a*  women  Aeed  cociet)  **  pro 
"""" 


«  T7»ewomenenrolIHlnthejudocour*elnof4erto 

(A)  le*rnw*y*i»K«ea  oneMlf  from  *ne«perl- 

(S)  le*  M'lljrt'Jfrraea  »>«rMlf  from  tn  eipef »' 

enc«d  Inftructor 
(C)  le*rn«*)*ofFfaecilr«  them*eNe*  from  in 

t»penence<l  in*irwct»r 
(0)  te*rn.  from  «  "perieftC«J  ••>• 

t»proiea«h«mielTe*  ^ 
(E)  le*rn,  from  m  eipertenc^J  Innraciof.  in 

what  w»jr  to  Pfotea  oneKlf 


\ 
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•f  a  CMJiin  Urm.  h«<}  left      M»te  bwiuit  CMiholw 

•«<lil«Jt»4**»,  IWtmln  m(v*«<  lM»lf<*  rirml«M>ic  Jn 
ihit  y«r  »»0  «ci«J  ••  it*W^n  he  r*>no.\  ihe  It 
Miv«4iMri  ffmi  mthii.  •<tiil»<«liy  •»•>' 

Ht       ih«  f  •ftf»  iht  !•<«>  if****  ^^e 

toMM  M  «M  Mthlx  kcliKt    th«  f r*feny. 

-nwNliKCh*}  •finally  l*^w«J*or 

^  «rrtM«Jin  >f7l  tttj  M(wtct«4  •! «  erin^r  trO  «••  In 
•  Uii.      I*7J.         ••»/t»n  •  «CMKwi, 

Hrtiti  umJ  ihf  firnf»r»»«te  fw  mi^  She  ciwicJ 
'**m*fe^••»»•^lher•wn»^y•^•^lrl#•^irt.  TK- 
rvvm  Ml  •inci  km  ktp  »r  B^^ln.  «t«  haJ  , 

M«d  h  h«{pri  tfic  fir*  Wt  w  l«ri(rr  rfK*  itierMdrr, 
»t  l*7t.  Uarfiu,  a  n«i»hhM,  c*rile»il)  M»rw<  • 
rtrt  vulck  cvMMi  the  tf«iirwcti«n  •(  im 
Lcrtnr  4  J      htvt  ••Uln'*  f«rmiiit«M  i*  k«  ihc 
•rtrriiM.  Ai  tl»  Jimi  af  th*  fire,  i^^in  l»M  hetn 

4U  M  r«f«^  f**  Mr>4lwrr«  k)  fir*. 


MAlMlm  appltai  i*  XYZ  Iniwrir**  Catr^ptny  ifj  a 
lift  lMvr*flcr  polity  "htch      p«  r«>«lre  m 

the  whwhtr  ihf  ipfJKiM 

•wff«f><«  rr«meinctr.  Mjle»lm  tnawf  r«J  in  l»* 
dMAiivC.  MakMin       !»•  >rir>  ifirr  ihc  p*liC]r 

hli  life  Uiw«»,  •«<  ih*  premium!  w*ri 
mUMIvII.  WMn  in  f*r^rmM. 
XYZ  IMI  M«le*lm*l  #«Hh  hwn 

N»rin4.  ih*  fctrxfklif)  ftHhf  H»rmi 

TM  Mr;««t«iirU<iiit  iMi  f  MKxaW^  tulilwi 
mil  'fffi  M  rv'^'^c 
glymtoirx  cut.  IT- 

%t4  iM  aMipilanl  wi^trtt^tn  in  ihc  cm* 
iriei  e*w*  tMrMfiw  fct  inviMitttf. 
r  I  >  A  ctwrta        ^        >y  •       «• ' 

•      t  •tittn>«M  U  tt>«  ftrwn  miMftC  tf*« 
imimtM.  tliher  the  Mhcr  f«fiy»f  Mi 
f»pr*»ewtU«.  **** 
rtii9i»l#fctl.«vi  ih»t  Ihf  «itemt«  »ii 

^ '  '  tme!»»tf*i     -f^h  •  »• 

urkM<  littr  cUlm  th»i  the  ctfttfici  it 

*  M»t**chke«n-rerttdfcyrnt»ther») 
I      rtiioa  •(  the  fitttty     iinfmw  •« 

ihe  *y  fcrwch*' 

yr»mliti  miJi  eomtici 


teltrt  he  «  iMtttf  ky  hit  ^her  In  lt3l. 

King  Shiki  Wlh  •  ZmIw  empire  tiitfJiftg  »»tr 


cwt\t>**  t%mt  tw  iniltt«<>  tnfti^iinn. 
(A)  tittMinc  •^r  hwfv4rt4i    tri*uiin4i  •(  i^i;  * 

inlltitMihit  c«ni«irie() 
(I)  tUtniJvtVf  rh«n<r»k»i  •!  it>»«iih*i  •(  i*iirt  ^ 
mllei.  iM  »  e»«<unc4  / 
(C)  Ihtt  ttxttSti  •vtr  fttfh*rt<i»rih»«ii«<iol  / 

i^rt  mlki  t>r4  e»«il«iX 
(0)  ihtt  ««it«4t(l  •vf  r  hvf»4rt<i    thMtitM  •! 

«^irt  mllti  tM  c«witAe4 
(E)  *hUh  *ii  t»ttn<if»c       ir«»yiihdi  •(  iiwtrt 
mltci  int)  coMiining 

11.  Krvftr  •wmn*  the  iMiml  Secwriiy  aci  th«i 
^T9i\^%  fur  the  trvkfiniic  dctcmlon  withotx  trUt 
•r  My  f«rMn  wh^m  Ihe  polkt  rtiir^  w  fce 
•icwrlty  Tliti. 

(A>  vtem  Ihe  p*nee  regir4 1*  ke  tccurliy  rtiki 
(0)  wh*  l^t  roXec  rrgjrJ  «i  KCwrUy  riiki 

(C)  wh*m  iht  foflct  rc(ir4  «i  «  tecurliy  nik 

(D)  wh*  U  rtgir^4  ii  tecurtty  rliki  ^  ihe 

<C)  the  pvlkt  here  rrfirJN  i*  l«  a  MCurny  ritk 


U.  Me<li>*rv  ttiki  ftvtr«wthr  W  IXt  »»U  the  •ch«lar 

^^Itmlttei  tt»  Ml  W  •Ucrly  fMUthM^t 

IT  » 

IXBtlt't  jf<nl<»c  »>•  Cemmuwlil  y»rr»  tt  »>• 


Cirli  wit  Aurryir^  (Sewn  ihe  inJtwjlk  i«»ird  i 
Mk«i)  ttition  on  htt  wiy  to  ihe  iirpori  when  her 
wiy  wii  klxk«4  ^  LtnnoKi  «  till  )Oun/  mm 
LffTwoK  iiU  Ihit  tvtryone  who  piii«d  t>>  tneit  ht; 
to  ^y  (Oil  ind^efliinilfj  twty^iy-liyc  ctfiti  Cijtt 
wit  infvrvOI.  rcfvic\3  topiy,  lurfx-l  iM  wjlltJ 
lit  Iht  »iy  irouni]  Ihe  Voni  ti»:k  lo  her  iii'ica 
At  I  rtiul',  the  miiiAS  ihe  f  ii»«  %f\t  wit  gomp  ic 
rike  ifd  rMdfoiaic  i  ;riin  i«  iruiher  ci().  wncrt 
ihcK*J  *n  ippcNfumcN  tor  Ancn>pl(>jnw.ii  inn,r« 
vir*  The  jppi>iMincn«  ri*J  ro  >c  retcvJ^  fp»  awi. 
CirU  Ion  iw&OJy<'  r')  (torn  her  CvrivYi;  }iti< 
t<cj>jie  of  ihc^u>   Oil*  v>o>J  i,(w.>i  rs>i  i^u 
ImprtwnmtM  an!  clJtmeOI  O.nucc*  tot  hit  ioi» 
•r  f ijr    Mew.  tot  Ltrtrok 

The  nirro^tjitt  prift<.i*ly  thjt  KJtoftiKv  «2£ili^* 


ihli  rtJuSi,  jfO  <i  nwtKfefiiUK'M  «  

t*yfo  in  >he  p»e<«dtrig  <-Jtr  tt 

(  A)  FJl»e  im?n»#»wntf>i  Cinnot  octwr  In  tn  open 

irU  PuWk  f  liCt 
(R)  Ktiirlctitnot  <  perton't  movtntm.  i(  im 

rtttneiion  retvUt  in  OeliyiPg  kui  no< 

4dei  r>o<  f*f>ii>lvtt  fjUt  trr>f ritofvr>tn 
<C)  Rtitr  iini  •(  movtmtni  it  not  irnrrisor- 
mtrvt  il  jn  Alteinittvt  ««)  ct  <lr^tutt  i» 
Itff  of^eo  1 

(D>  Dinijj>tt  (er  fJiw  irnprttoturiC'rHt  m4)  rvx  N 
ree»vtrni  fc^  d«lj>t  occJtio'^.nJ  ty  iv 
«npntow.?/v' 
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THE  EDUCATIONAL  TESTING  ACT  OF  1981 


/ 


WEDNESDAY,  JULY  22,  1981 


House  of  Representatives,  Subcommittee  on  Elemen- 
tary, Secondary,  and  Vocational  Education,  Joint- 
ly With  the  Subcommittee  on  Postsecondary  Educa- 
tion, Committee  ON  Education  and  Labor, 


Washington;  D.  C 


The  subcommittee  m^t,  pursuant  to  notice,  at  9:30  a.m.,  in  room 
2175^  Ray  burn  House  .Office  Building,  Hon.  Carl  D.  Perkins 
presiding. 

Members  presj^nt:  Representatives  Perkins,  Weiss,  Simon, 
Erdaiil,*  Bailey,  and  Erlenbqrn. 

Staff  members  present:  John  F.  Jennings,  counsel;  William  A. 
Blakey,  counsel;  Betsy  Branil,  minority  legislative  associate;  Rich- 
,ard  DiEu|enio,  minority  legislative  associate. 

Chairman  Perkins.  The  subcommittee  will  be  in  order. 

A  quorum  is  present. 

The  Subc^immittee  on  Elementary,  Secondary,  and  Vocational 
Education  and  tbe  Subcommittee  on  Postsecondary  Education  will 
continue  its  hearings  that  we  started  yesterday  on  H.R.  1662,  a  bill 
introduced  by  Mr.  Weiss  and  other  Members  of  the  Congress,  a  bill 

.to  require  certain,  information  to  be  provided  to  individuals  who 
take  stcindardized  educational  admissions  tests  and  for  other  pur- 

*  poses.  / 

Chairman  Perkins.  We  are  glad  to  welcome  here  this  morning  a 
panoJ  of  experienced  Wst^takers  and  testing  expert  Carolyn  Ben- 
nett, a  studen|:  from  Johns  Hopkins  University;  Michael  Galligan, 
graduate,  Clarkstown  South  High  School,  New  City,  N.Y.;  Dr. 
Banesh  Hoffman,  professor  emeritus.  Math  and  Physics  Depart- 
ment,'Brooklyn  College;  and  Dr.  Michael  D.  Priddy. 

All  of  you  come  around  aHcJ  get  aYound  the  table, 
t  We  will  hear  from  you  first.  Miss  Bennett. 

Yes,  Congressman*  Weiss? 

Mr.  Weiss. *We  have  a  very  outstanding  group  of  panelists  today, 
and  I  especially  want  to  take  note  of  the  fact  that  Michael  Galli- 
gan, who  is  sitting  at  the  table,  got  up  at  4  o'clock  this  morning  in 
order  to  get  to  New  York  City  and  catch  the  shuttle  and  get  to 
Washington  on  time. 

Chairman  Perkins.  Very  energetic. 

Mr.  Erdahl.  I  would  be  quite  concerned  because  anybody  with 
that  ambition  is  a-potential  opponent  down  the  road.  That  is  what 
you  have  to 'do  oftentimes. 

Chairman.  PbrIcins.  Go  ahead,  Carolyn. 
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ST.VTKMENT  OF  CAROLYN  BENNETT,  STUDENT,  JOHNS  HOPKINS 

UNIVERSITY 

Ms.  Bennett.  Good  morning,  Mr.  Chairman  and  members  of  the 
committee.  Thank  you  for  allowing  me  to  speak  very  briefly  this 

morning.        .         i  ^        ^       ^  ^ 

My  name  is  Carolyn  Bennett.  I  grew  up  as  the  dependent  daugh- 
ter of  an  Air  Force  pathologist.  I  recently  graduated  from  Johns 
Hopkins  University  with  a  bachelors  degiee  in  natural  sciences 
and  will  be  attending  Johns  Hopkins  Medical  School  in  the  fall. 

Several  summers  ago  I  \Yorked  as  a  summer  staff  member  at 
Educational  Testing  Service  in  Princetoi^,  N.J.  My  duties  included 
reviewing  items  for  the  SAT  to  insure  that  any  racially  or  sexually 
sensitive  words  or  phrases  were  removed  befot"  the  items  were 
printed.  I  also  worked  on  several  task  forces  to  provide  a  college 
student's  perspective  on  testing  issues. 

I  have  also  served  on  an  informal  advisory  group  whose  function 
IS  to  exchange  information  between  ETS  and  some  of  the  groups  it 
affects.  Since  then-I-have  worked  a  variety  of  summer  jobs^  as  a 
medical  secretary. 

I  am  here  this  morning  to  talk  about  my  experiences  with  stand- 
ardized testing. 

My  first  encounter  with  a  nationally  admmistered  standardized 
test  was  in  1976  when  I  took  the  PSAT.  At  that  time  I  was  a  junior 
at  a  Department  of  Defense  high  school  in  Wiesbaden,  West  Ger- 
many. 

the  school  was  average  academically.  Accelerated  classes  such  as 
AP  English  and  AP  biology  were  not  offered^Though  not  certain  of 
medicine  as  a  career  choice  at  that  time,  I  was  certain  that  I 
wanted  to  attend  a  4-year  college.  ,  . 

Taking  the  PSAT  helped  me  out  in  a  number  of  ways:  It  mtro- 
dured  me  to  standardized  test  format.  It  started  me  thinking  seri- 
ously about  what  colleges  and  degree  programs  were  most  suited 
for  me.  It  served  to  identify  me  as  a  candidate  for  a  national  merit 
scholarship  for  outstanding  Negro  students  which  helped  pay  for 
my  first  year  of  college.  And,  most  importantly,  it  let  me  know 
where  I  stood  in  comparison  to  other  college-bound  high  school  stu- 
dents. ...  ,  . 

This  was  par'.icularly  important  as  I  was  tackling  college  deci- 
sions from  uv<?rsea&.  There  was  a  small  percentage  of  college-bound 
students  in  my  graduating  class  and  very  little  academic  interac- 
tion with  students  from  other  schools.  I  took  the  PSAT  and  knew 
that  I  could  compete  for  a  spot  in  a  selective  collet^e.  It  was  a  posi- 
tive, motivating  experience  with  standardized  tes'ing,  arid  not  an 

unusual  one.  .   ...r,r,  t  i- 1         i   t  u 

I  took  the  SAT  the  following  year,  in  1977.  I  did  not  take 'a  coach- 
ing course.  I  went  into  the  exam  armed  only  with  my  4  years  of 
public  high  school  course  work,  and  I  walked  away  thinking  that 
the  answer  sheet  I  turned  in  was  a  fair  representation  of  my  math- 
ernetical  and  verbal  skills.  In  all  honesty,  I  am  not  a  test-taking 
wizard.  I  struggled  with  a  lot  of  items  and  found  others  simple. 

The  scores  I  received  a  few  weeks  later  made  me  feel  good-about 
myseii"  anu  r^v  academic  abilities.  I  did  not  receive  700's,  but  I 
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thought  that  my  bcureb  would  give  me  a  crack  at  a  good  premedical 
program,  and  they  did.  The  SAT  did  not  hinder  me  academically. 

As  I  took  the  test,  I  did  not  feel  as  though  I  was  falling  into  a 
test  trap  or  that  I  was  being  manipulated  in  some  way.  I  did  not 
find  items  that  offended  me  as^  a  black  woman.  The  items  were  fair 
game,  to  evaluate  me  as  a  high  school  student.  I  benefitted  from 
taking  the  SAT.  It,  too,  was  a  pbstive  test-taking  experience. 

In  my  third  year  as  an  undergraduate  at  Johns  Hopkins  Univer- 
sity in  Baltimore,  I  began  making  plans  to  apply  to  medical  school. 
I  worked  har(j^jn  college  and  received  good  grades  but  was  not  at 
the  very  top  of  my  class.  Knowing  too  well  how  competitive  medi- 
cal school  admissions  procedures  are,  1  relied  very  heavily  on  the 
MCAT>  to  show  me  and  to  show  the  schools  considering  me  for  ad- 
mihsion  just  how  my  academic  strengths  stacked  up  against  thJse 
of  other  students.  / 

True,  I  dreaded  taking  it  and  sweated  through  it,  but  it  was 
worthwhile.  Without  it  I  would  not  have  made  tha  same  decisions 
about  what  schools  to  apply  to,  and  I  would  not  have  received  the 
^ame  favorable  consideration  I  received  from  Johns  Hopkins  Medi- 
cal School. 

The  experiences  I  have  just  described  are  not  newsmakers.  Up  to 
now,  there  has  not  been  much  interest  in  a  string  of  stories  about 
students  who  do  not  despise  standardized  and  use  test  data  objec- 
tively. I  owe  the  fact  that  I  am  going  to  the  medical  school  of  my 
choice  because  standardized  tests  identified  me  to  the  school  I  am 
headed  for  as  being  capable  of  doing  the  work,  this  was  the  biggest 
benefit  of  all. 

The  single  point  I  would  like  to  leave  with  you  this  morning  is 
that  I  am  not  alone.  I  am  not  the  only  college  student  to  have  bene- 
fitted from  standardized  testing.  My  personal  circumstances  are 
not  too  unusual  to  be  shared  in  some,  part  by  thousands  of  other 
students,  from  both  public  and  private  high  schools,  attending 
public  and  private  colleges  and  universities  and  working  toward  all 
kinds  of^professional  degrees.  ' 

They  would  agree  with  me  that  standardized  testing  is  the  means- 
to  broader,  not  narrower,  educational  opportunities  and  tha^t  stand- 
ardized |tests  are  critical,  fair  and  accurate  tools  to  use  in  academic 
decisionmaking  and  that  they  open,  not  shut,  doors. 

I  would  be  happy  to  answer  any  questions  you  may  have. 

Thank  you. 

Mr.  Simon.  Thank  you. 
Mr.  Galligan? 

STATBMENT  OF  MICHAEL  (JALLIGAN,  GRADUATE,  CLARKSTOWN 
I        SOUTH  HIGH  SCHOOL,  NEW  CITY,  N.Y. 

.  Mr.  Galligan.  Good  morning,  Mr.  Chairman  and  members  of 
I  the  subcommittee. 

,  I  would  first  like  to  thank  Congressman  Weiss  for  inviting  me 
I  here  this  morning.  It  is  an  honor  for  me  to  be  here. 
^  In  the  past  couple  of  months,' I  have  been  called  upon  to  ex^min^ 
,  my  feelings  about  standardized  testing  very  closely.  I  have  also  had 
,  thf.  opportunity  to  hear  the  opinions  of  other  students  whose  fu- 
!  tures  will  be  affected  by  the  scores  they  will  receive  on  these  tests. 
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!  therefore,  hope  to  speak  for  a  large  population  of  students,  that 
their  opinions  and  feelings  may  be  co'nkidered  in  the  important 
issues  which  are  decided  here.  ,  oxm 

In  October  1980,  as  I  was  taking  the  College  Board  SAT  examma- 
tion,  I  noticed  that  to  question  No.  16  of  section  2,  two  correct  an- 
swers were  listed  as  choices.  This  was  in  contradiction  with  the  di- 
rections which  indicated  that  there  was  one  and  only  one  correct 
answer  for  each  question.  _  v   i       i.  t 

As  the  truth-in-testing  law  is  in  effect  in  New  York  btate,  1  was 
able  to  receive  a  copy  of  the  SAT  exam,  the  answer  key,  and  my 
graded  test  paper.  Upon  reviewing  the  question,  I  confirmed  that 
.there  were  two  correct  answers  listed  and  only  one  was  being 
counted  as  correct.         '  ,  .  .       ,  ^,        . , , 

I  then  wrote  to  the  College  Board  and  informed  them  of  the  ap- 
parent mistake.  In  March  1981',  I  was  notified  by  the  Educational 
Testing  Service  that  I  was  correct  and  that  both  answers  would  be 
-counted  as  being  correct.  As  a  result,  the  grades  of  almost  20,000 
students  who  had  chosen  the  alternative  answer  were  raised  10  to 

'^Vlsa'a'n  additional  50  students  were  awarded  Regents  scholar- 
ships as  a  result  of  their  raised"  scores.  Unfortunately,  students  out- 
side of  New  York,  where  the'  truth-in-testing  law  is  not  in  ellect, 
have  not  had  their  scores  adjusted.      „     .  .   ,  ^ 

Are  not  the  students  in  those  other  States  just  as  correct  as  the 
students  in  New  York?  '  '      c  ^i.  ^' ^u  ■  f^^f 

I  support  the  proposal  to  extend  the  concept  of  the  truth-in-test- 
ing  law  nationwide.  Any  test  should  be  based  on  a  mutual  agree- 
ment between  tester  and  test-taker  that  there  exists  a  body  ol 
knowledge  which  mankind  agrees  upon  as  being  true.        ,  . 

It  is  perfectly  possible  for  a  young  person  to  recognize  truth  by 
way  of  insight,  even  without  the  formalized  education  to  know  it.  It 
is  also  conceivable  that  a  person  with  more  education  but  less  in- 
sight would  not  oce  what  the  student  was  able  to  recognize.  Twice 
this  has  been  proven.  .  '  if  •„  o 

Truth  is  what  men  live  by.  To  protect,  praise,  and  preserve  it  is  a 
most  holy  endeavor.  To  compromise  it  is  to  msult  the  way  we  live 
.  and  degrade  the  very  thing  students  are  told  to  search  for.  I  know 
the  reason  that  I  wrote  away  wag  because  I  Jove  mathematics. 
When  I  saw  the  mistake,  I  felt  that  a  terrible  injustice  had  been 
done.  I  had  nothing  to  gain  from  challenging  the  question  but 

D6BC6  of  mind  ' 

I  feel  that  if  we  deny  a  student  the  right  to  see  his  test,  we  are 
breaking  -a  trust  with  studentS  and  ourselves.  This  country  has 
never  been  one  to  deny  a  person  of  rights.  I  think  a  right  that  al 
-  people  have  and  which  is  one  no  person  would  want  to  live  without 
is  the  right  to  know  the  truth.  .       u     t  „  „  fu^  f r.,fi, 

I  think  I  speak  for  all  students  in  America  when  I  say  the  truth- 
in-testing  law  is  a  step  in  the  right  direction.  The  promotion  of 
such  a  concept,  as  this  bill  would  do,  is  a  positively '  righteous 

^'^Furthermore,  the  Educational  Testing  Act  would  assist  the  Stu- 
dent in  educating  himself  by  allowing  him  to  recognize  his  mis- 
takes and,  in  so  doing,  learn  more  about  himself  and  how  he  func- 
tions in  testing  situations. 
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While  the  bill  propobes  some  necessary  rights  for  test-takers,  I 
have  to  expresb  m>  feeling  that  it  misses  some  of  the  major  faults 
of  the  Standardized  Testing  System  as  it  is  now.  I  think  the  Educa- 
tional Testing  Service  £\ould  feel  a  sense  of  obligation  to  inform 
the  students  of  what  they  wilLbe  tested  on. 

Students  as  well  as  universities  should  be  aware  of  how  this  test 
bhould  be  interpreted  and  how  accurate  or  inaccurate  it  may  be. 
This  should  be  followed  up  by  studies  of  how  the  tests  are  being 
used  and  how  much  weight  is  given  to  them. 

Are  they  a  primar}  criterion  or  are  they  used  to  highlight  other 
information  about  a  student?  The  testing  organizations  themselves 
rriust  take  responsibility  for  how  the  tests  are  used.  If  they  don't, 
jno  one  else  will. 

No  test  is  able  to  perfectly  measure  that  which  it  is  designed  to 
measure.  There  is  always  a  margin  for  error.  This  is  true  of  all 
tests  and  other  indicators  by  \vhich  students  are  evaluated.  Look- 
mg  at  all  the  indicators  and  otheir  personality  characteristics  is  the 
only  way  to  get  an  accurate  picture  of  a  person's  accomplishments 
and  potential. 

I  have  been  a  person's  dream  ruined  because  he  scored  20  points 
too  '  )w  on  the  SAT  exam.  I  think  when  an  exam  is  given  more  con- 
sideration than  factors  such  as  motivation,  insight,  virtue,  and  de- 
termination, there  it>  something  wrong  with  our  system  of  evalua- 
tion. 

To  provide  equal  opportunity  for  the  individual  and  for  the 
•  strength  and  growth  of  our  country,  our  testing  system  must  be  im- 
proved. It  should  be  consistent  with  the  values  of  our  society.  If 
standardized  tests  are  to  be  used  as  widely  as  they  are  now,  they 
should  be  available  to  everyone  regardless  of  geographic  and  eco- 
nomic status. 

The  users  of  such  tests,  namely  the  educational  institutions 
which  require  them,  should  also  share  in  the  responsibility  of 
making  the  tests  available  It  may  involve  financial  contributions 
to  cover  additional  expenses.  Also,  they  should  be  keenly  aware  of 
the  limitations  of  such  a  test. 

By  limiting  our  interpretation  of  others  to  a  number  on  a  piece 
of  paper,  we  are  losing  those  qualities  ahjut  a  person  which  truly 
serve  the  needs  of  our  country,  qualities  such  as  honesty,  integrity, 
charity,  compassion,  and  wisdom,  all  of  which  have  marked  the 
great  men  of  our  country. 

There  is  no  way  to  test  for  this  type  of  gift,  there  is  no  way  to 
measure  one  s  ability  to  perform,  to  contribute,  or  to  care.  There  is 
no  way  to  see  if  a  person  will  succeed  or  fail  at  something  except  to 
give  him  a  chance.  There  are  those  who  have  little  chance,  vvho 
have  to  strive  to  overcome  barrier^  of  culture,  poverty,  and  location 
to  try  to  educate  themselves. 

It  is  not  possible  to  provide  everyone  with  a  very  fine  education, 
but  It  is  possible  to  give  everyone  the  facts  about  what  they  should 
learn  for.a  particular  test  so  that  those  who  do  have  the  motivation 
can  educate  themselves  and  also  seek  i^t  at  their  schools  where  it 
should  be  taught. 

Our  fine  government  should  be  an  example  for  the  efficiency  and 
integrity  of  a  system  of  checks  and  balances. 
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Mr.  Weiss.  I  think  we  will  go  to  the  questioning  of  the  two  people 
who  just  testified  since  they  are  the  test-taker  part  of  pur  witnesses 
this  morning.  After  that  we  will  go  to  Dr.  Priddy  and  perhaps  Dr 
Hoffman  will  be  hereby  at  that  time  as  well 

Carolyn,  I  think  I  perhaps  did  you  an  injustice  in  not  asking  you 
how  long  it  took  you  to  get  here. 

Ms.  Bennett.  Twenty  minutes. 

Mr.  Weiss.  I  wonder  if  each  of  you  could  give  us  some  idea,  not 
just  of  your  own  personal  experience,  but  of  your  involvement  with 
other  students'  attitudes  toward  the  tests,  as  to  their  impression  of 
whether,  in  fact,  there  is  sufficient  information  given  about  them, 
whether,  in  fact,  they  have  sufficient  opportunity  to  study  for 
them,  whatever  <  ^  ,  ,  ^ 

You  are  bpth  obviously  outstanding  students  and  you  may  .not 
have  some  of  the  same  proble/ns  others  might. 

Carolyn?  ' "  **         ' .     .    .  .  ^C  - 

Ms.  Bennett.  Thank  you.  My  feeling  is  that  my  peers  and  the 
students  that  I  have  spoken  to,  both  about  the  SAT  and  MCAT,  is 
generally  positive.  I  emphasize  that  for  the  MCAT  as  well.  It  is 
better  if  I  discuss  the  MCAT  in  particular. 

Mr.  Weiss.  When  did  you  t-ake  it? 

Ms  Bennetp.  In  the  spring  of  1980.  It  is  critical  to  the  pre-med 
population  at  Hopkins  to  do  well  on  the  exam  and  everybody  was 
coaching  and  practicing  and  they  want  to  see  as  many  of  the  items 
as  they  can.  It  is  competitive  and  takes  hours,  but  generally  it 
is  a  positive  feeling.  The  feelings  of  the  people  that  I  took  the  exam 
with  was  that  when  they  came  out  of  it  it  was  a  fair  representation 
of  the  work  that  they  had  one  in  college  and  it  was  going  to  be  a 
good  index  as  to  how  they  were  going  to  perform  in  medical  school 

Mr.  Weiss.  Did  most  of  the  people  who  took  that  test  study  tor  it.'' 
Did  they  attend  coaching  or  preparation  school? 

Ms.  Bennett;  About  a  fifth  of  the  medical  class  took  a  coaching 
course.  ^  ^ 

Mr.  Weiss.  That  was  the  new  MCAT? 
'Ms.  Bennett.  That  is  right.  ,    ,     „  ... 

Mr  Weiss  In  1979,  I  believe,  the  medical  college  testing  group 
decided  that  they  really  needed  a  new  test.  They  were  unhappy 
with  the  old  test,  I  guess  from  the  point  of  view  of  reliability,  and 
they  decided  that  they  would  try  a  new  series  of  types  of  questions, 
a  new  area  of  limitation  as  to  where  they  would  ask  the  questions 

&Jen  the  testmakers  themselves  do  not  contend  that  they  have 
always  given  tests  which  they  have  been  fully  satisfied  with. 

Ms  Bennett.  I  believe  that  the  students  that  were  taking  it 
when  I  was  taking  it  believe  that  the  material  on  the  exam  was 
appropriate  for  the  purpose.  ..^.^  ■    i-       j  ^  *u 

Mr.  Weiss.  My  understanding  is  that  MCAT  is  jimited  to  the 
second  year  college  equivalent  biology  course  level. 

Ms.  Bennett.  Yes.  -    .       .....  1 

Mr.  Weiss.  Everybody  knew  going  into  that  test  what  the  general 
area  would  be  that  would  be  covered? 

Ms.  Bennett.  Level  of  difficulty?  . 

Mr.  Weiss.  Well,  the  subject  area  that  would  be  covered. 

Ms.  Bennett.  Yes. 
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Mr.  Weiss.  That  is  sort  of  different  from  the  SAT,  though. 
Ms.  Bennett.  True. 

Mr.  Weiss.  Did  you^  have  a  clear  idea  going  into  the  SAT  what 
areas  would  be  ^overed? 

Ms.  •Bennett.  Yes,  I  did,  but  because  of  a  different  reason,  from 
the  PSAT. 

Mr.  Weiss.  Michael,  what  was  your  experience? 

Mr,  Galligan.  Going  in  to.take  the  SAT  exam,  I  had  very  little 
idea  as  to  what  specifically  the  format  would  be.  I  had  not  taken 
the  PSAT  so  I  had  no  idea  in  that  respect,  nor  did  I  receive  infor- 
mation from  my  school  as  to  what  the  format  was. 

However,  I  was  fortunate  enough  to  have  a  fine  educational 
background,  so  that  I  was  able  to  handle  what  was  presented  to  me 
OK.  A  particular  experience  which  I  would  like  to  tell  of  is  when  I 
went  to  visit  the  Jackie  Robinson  Foundation  Youth  Convention  in 
Columbia  University  a  couple  of  months  ago. 

The  students  there  also  did  not  have  the  information,  the  appro- 
priate information,  as  to  what  the  test  would  actually  test,  as  to 
what  the  format  would  be  and  what  the  necessary  levels  of  math 
and  verbal  bkills  had  to  be  attained  so  that  one  could  actually  do 
the  exercises  of  the  test  and  display  his  knowledge  in  that  manner 
to  make  the  test  valid. 

Nor  did  they  hfi.ve  the  necessary  skills  in  many  cases,  OK,  so  I 
feel  that  the  responsibility  really  cannot  lie  with  the  school.  If  you 
are  going  to  say  that  there  has  to  be  complete  equality  for  this  test 
which  IS  designed  to  measure  aptitude  so  you  have  to  have  com- 
plete equality  as  much  as  you  can,  then  each  student  has  to  be  per- 
sonally given  the  information  and  it  is  necessary  that  all  the  infor- 
mation gotten  to  each  student  so  that  he  is  fully  aware  of  what 
the  tests  will  be,  because  in  many  cases  the  students  did  not  know 
what  they  had  to  attain  educationally  nor  were  they  taught  it  at 
their  schools. 

I  can't  speak  for  myself  in  that  manner.  I  have  to  speak  for  them 
because  that  is  where  the  fault  is.  I  was  fortunate  enough  to  go  to 
a  very  fine  school  but  there  are  ^  lot  of  other  people  in  this  world 
who  aren't. 

Mr.  Weiss.  How  do  you  feel  about  the  policy  which  ETS  and  that 
which  the  College  Entrance  Examination  Board  people  have  now 
adopted,  of  disclosing  upon  request  the  answer  sheets  together  with 
the  questions,  in  I  think  five  out  of  the  seven  major  administra- 
tions of  the  test? 

How  do  you  feel,  Carolyn? 

Ms.  Bennett.  I  support  it. 

Mr.  Weiss.  Expand  on  it  if  you  will.  Why  do  you  think  that  that 
is  a  good  idea? 

Ms.  Bennett.  I  think  it  is  important  to  give  students  an  opportu- 
nity to  see  a  copy  of  their  exam  but  I  also  think,  from  what  little  I 
know  about  testing,  that  it  is  important  to  keep  some  of  the  exam 
secure* 

Five  out  of  seven  is  a  good  decision  for  ETS  to  have  made  in  that 
case.  If  I  was  taking  the  SAT  and  I  wanted  a  copy  of  my  exarti,  I 
would  take  it  at  one  of  the  disclosed  administrations,  and  not  at 
one  of  the  secure  ones. 

Do  you  see  what  I.  mean? 
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Mr.  Weiss.  Yes.  Wliy  do  you  think  it  is  worthwhile  for  students 
to  be  able  to  get  their  answers  back? 

Ms.  Bennett.  Well,  in  all  honesty,  I  don't  know  if  I  would  re- 
quest a  copy  of  my  SAT.  On  the  MCAT,  that  I  would  but^not  on  the 
SAT. 

Mr.  Weiss.  Why  would  you  request  it  in  the  MCAT? 
,  Ms.  Bennett.  Level  of  difficulty  of  the  exam,  particularly  on  the 
quantitative  analysis  questions  where  the  answer  takes  quite  a 
while,  and  I  would  be  able  to  check  levels  of  difficulty,  but  I 
wouldn't  feel  the  need  to  on  the  SAT. 
Mr.  Weiss.  That  has  to  do  with  some  extent  with  your  sense  of 
.  confidence  about  the  subject  matter  in  the  two  tests,  is  that  right? 
Ms.  Bennett.  That  is  right. 

Mr.  Weiss.  Michael,  how  do  you  feel  about  the  disclosure  policy? 

Mr.  Galligan.  I  support  it  for  two  reasons:  First,  as  I  said,  there 
is  an  educational  benefit  in  seeing  a  test  which  you  took  and  what 
you  got  wrong;  OK.  For  just  the  sake  of  knowledge,  knowing  what 
you  got  wrong  and  learning  that. 

Second,  for  seeing  how  you  test,  which  is  a  very  important  skill. 
The  second  reason  is  that  no  one  has  a  corner  on  truth.  Truth  is 
something  which  everybody  has  to  contribute  to,  young  and  old,  re- 
gardless of  age  or  religion  or  anything  else.  Everybody  should  be 
able  to  see  what  they  did  so  that  they  are  convinced  that  either  it 
was  wrong  or  right  and  graded  accordingly. 

My  experience  with  the  SAT  testifies  to  that.  J  was  dissatisfied 
with  the  particular  question  from  a  personal  standpoint,  and  I 
think  it  is  very  important  that  a  person  is  able  to  satisfy  that  lin- 
gering feeling  about  a  particular  question. 

It  IS  very  important  to  make  the  truth  consistent  with  the 
person.  He  has  to  understand  what  is  right  and  what  is  wrong.  A 
very  good  way  to  do  that  is  just  to  allow  people  to  see  the  tests. 

Mr.  Weiss.  Carolyn,  did  you  make  application  to  get  your  MCAT 
results  and  were  you  able  to  get  them? 

Ms.  Bennett.  No;  they  are  not  available. 

Mr.  Weiss.  Thank  you  very  much. 

Mr.  Bailey? 

Mr.  Bailey,  l  don't  have  any  questions. 

Mr.  Simon.  Let  me  add  my  commendation  to  both  witnesses. 

I  think  it  is  a  great  thing  to  have  student  witnesses,  meaning  no 
disrespect  to  other  witnesses,  but  w^  too  often  hear  from  profes- 
sionals in  the  field  and  not  often  enough  from  people  like  the  two 
of  you.  Thank  you.       ^  i       u  -4. 

Mr.  Weiss.  Again,  my  appreciation  and  that  of  the  subcommit- 
.tees  to  both  of  you  for  taking  time  out  of  your  leisure  or  worktime 
to  be  with  us  today.  Thank  you  so  much. 

We  will  proceed  with  the  rest  of  the  panelists,  so  if  Patrick 
Shields,  Dr.  Schafer,  Dr.  Kasteen,  Mr.  Sjogren ^and  Dr.  Robinson 
will  join  Dr.  Priddy  at  the  witness  table,  we  will  have  one  large 
panel  and  Dr.  Priddy  will  be  the  lead  witness. 

You  will  have  to  move  the  microphones  back  and  forth  in  front 
of  you. 

Dr.  Priddy,  why  don  t  you*  proceed. 

Do  you  have  a  prepared  statement  that  you  submitted  to  us? 
Mr.  Priddy.  No,  sir. 
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Mr.  Weiss.  I  should  tell  all  of  the  witnesses  that  if  you  do  have 
prepared  statements  we  will  enter  those  statements  in  their  entire- 
ty in  the  record  without  objection. 

You  may  read  it,  extrapolate  or  excerpt  from  it,  handle  it  what- 
ever way  you  like. 

If  you  wish  to  add  additional  material  to  the  testimony  you  give 
here  the  record  will  remain  opeh  fcr  a  10-day  period  and  if  you 
submit  it  to  the  committee  during  that  time.  We  will  include  other 
additional  material  in  the  record  as  well. 

Dr.  Priddy? 

STATEMENT  OF  MICHAEL  D.  PRIDDY,  DIRECTOR  OF  RESEARCH, 
PLANNING,  AND  EVALUATION,  GUILFORD  COUNTY  SCHOOL 
SYSTEM.  GREENSBORO,  N.C.,  ACCOMPANIED  BY  MARIAN  EP- 
STEIN,  EXPERT  IN  TEST  DEVELOPMENT 

Mr.  Priddy.  Thank  you,  Mr.  Weiss.  I  would  like  to  thank  the 
other  members  of  the  subcommittees  for  the  opportunity  to  speak 
before  you. 

I  am  MichaeJ  Priddy,  and  I  live  in  Greensboro,  N.C. 
.  I  work  in  a  school  system  in  that  area.  It  is  in  the  Piedmont  sec- 
tion of  North  Carolina,  industrial  service  area  with  a  strong  agri- 
cultural base  and  a  county  of  about  315,000  .people. 

I  work  for  the  Guilford  County  School  System,  25,000  students, 
sixth  largest  in  North  Carolina,  and  made  up  of  44  schools. 

Before  I  proceed  with  some  detail  about  my  work  and  some  expe- 
riences, I  would  also  like  to  make  the  Chair  aware  that  I  am  ac- 
companied by  Dr.  Marian  Epstein,  nationally  recognized  expert  in 
test  development,  and  she  can  respond  to  specific  questions  by 
types  of  tests  administered  by  ETS. 

My  work  involves  planning  for  instructional  and  administrative 
purposes,  research,  that  is  the  conduct  or  the  oversight  of  it,  evalu^ 
ation  of  curricular  programs  as  well  as  administrative  programs 
and  the  standardized  testing  program. 

That  program  is  made  up  of  a  State-mandated  program  that  in- 
volves grades  1,  2,  3,  6,  9,  11,  and  is  completed  by  a  local  compo- 
nent that  fills  in  at  some  of  the  other  grade  levels. 

If  I  may,  I  will  limit  my  remarks  to  that  area  specifically,  test- 
ing, and  as  it  is  related  to  program  evaluation. 

The  plain  thrust  of  the  office  and  its  staff  is  to  serve  as  an  advis- 
er to  the  superintendent  on  the  board  of  education,  and  if  you  will, 
functions  as  a  gyroscope  for  the  school  system  in  a  sense  of  at- 
tempting to  keep  us  on  track  and  insuring  that  our  resources  and 
efforts  are  pointed  toward  things  that  will  improve  the  curriculum 
and  instruction  for  the  students. 

For  that  reason,  we  draw  on  multiple  sources  but  one  is  stand- 
ardized te$t  results,  and  I  will  share  some  of  those  experiences  with 
you,  particularly  6he  effect  of  those  results  oil  curriculum  instruc- 
tion. 1,1 

For  years  we  have  been  accused  of  letting  others  dictate  what  we 
do,  test  developers,  book  publishers,  and  it  is  very  easy  to  fall  into 
that  trap  because  they  are  expert  at  what  they  do  and  public 
school  people  can  easily  rely  on  them,  but  that  does  not  have  to  be 
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the  case  and  it  is  not  the  case  in  many  school  systems  and  one  is 
burs. 

We  take  those  results  each  year  and  very  systematically  go 
through  them  on  a  system  basis  and  on  a  school-by-school  basis  in 
an  effort  to  determine  where  the  strengths  are  and  where  the 
weaknesses  are. 

If  I  might  use  one  example  that  many  people  are  currently  famil- 
iar with,  minimum  competency  testing,  which  has  become  a  perva- 
sive force  in  America  in  the  last  4  or  5  years,  and  I  think  because 
of  public  reaction,  that  is,  a  perception  that  we  were  not  producing 
p)eople  who  were  minimally  literate  in  reading  and  hiath. 

That  wasn't  the  case  in  Guilford  County  when  tests  were  first  ad- 
ministered. We  did  have  a  small  percentage  of  students  who  were 
identified  as  needing  additional  help,  but  the  point  is,  even  with 
the  better  students,  we  could  see  trends  in  those  test  results  that 
indicated  that  the  curriculum  and  the  instructional  program  in  the 
sixth,  seventh,  eighth,  and  ninth  grades  needed  some  mending, 
needed  to  be  defined,  refined,  and  revised. 

Why  do  yoiTserthinflnd  of  trend,  this  trailing  offlater  in  the 
grades  and  \ve  were  looking  at  the  text  and  curricular  guides  and 
finding  various  resons  for  it?  We  were  and  we  are  making  decisions 
on  the  basis  of  standardized  test  results,  feedback,  program  evalua- 
tions, feedback  from  committees,  and  so  on. 

Then  there  is  the  other  group  that  are  affected  besides  teachers, 
and  that  is  ihe  students,  and,  of  course,  that  is  what  we  are  all 
"about-: — - 


We  found  that  using  multiple  indicators,  as  a  way  to  detern:'^e 
where  those  students  stand  is  a  far  more  appropriate  method  for 
insuring  that  we  are  addressing  their  needs,  the  individual's  needs, 
as  opposed  to  random  processes  that  vary  from  year  to  year. 

I  would  like  to  stop  with  that  for  a  moment  and  move  to  an  earli- 
er part  of  my  career  when  I  was  teaching.  I  chose  to  teach  in  an 
area  of  North  Carolina  for  4  years,  rural,  deprived,  made  up  pre- 
dominantly of  minority  populations. 

When  I  first  arrived  at  the  school  system,  I  learned  many  things 
about  it,  and  most  of  them  were  biases  and  prejudices  of  the  people 
that  were  there.  One  prejudice  I  formed  very  early  is  that  students 
were  being  encouraged  not  to  strive  but  to  do  what  others  before 
them  had  done,  and  that  had  been  based  on  experience  of  guidance 
counselors  and  principals  and  particularly  with  admission  to  post- 
secondary  institutions. 

Students  were  being  encourage^  to  accept  a  lower  quality  of  post- 
secondary  instruction  than  they  could  handle  and  that  was  often 
absociated  with  standardized  test  scores,  and  things  like  that.  Those 
schools  will  not  consider  you,  things  like  that. 

We  attempted  to  alter  that  view,  some  colleagues  and  myself, 
and  began  pointing  out  to  students  that  the  test  scores  are  only  one 
of  many  indicators  used  by  colleges  and  universities  to  make  deci- 
sions, and  particularly  in  North  Carolina  I  can  think  of  two  or 
three  schools  at  that  point  in  history  were  making  sincere  efforts 
to  look  at  grades,  community  involvement,  school  involvement,  so 
on,  and  used  in  the  standardized  test  scores  as  an  indication  of 
present  ability,  and  the  others  as  independent  indicators  of  poten- 
tial. 
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I  say  that  with  some  confidence,  ^because  my  wife  worked  in  ad- 
missions at  one  of  those  schools  and  I  am  drawing  on  her  experi- 
ence rather  than  mine  there. 

I  think  the  critical  point  there,  though,  is  the  tests  for  both 
achievement  and  ability  were  providing  some  indications  of  where 
people  stand  and  those  in  turn  could  assist  the  student  and  the 
educators  with  decisions  about  where  they  could,  can,  and  should 

go- 
lf I  might  drop  back  and  catch  some  of  that  in  another  phase, 
yesterday  I  had  the  opportunity  to  work  with  a  group  of  people  rep- 
resenting various  organizations,  universities,  political  world,  the 
State  bureaucracy,  and  so  on,  and  a  question  which  this  group  has 
mandated  be  addressed  and  that  is,  what  is  adequate  education  in 
the  United  States,  and  how  should  that  be  promulgated  by  the  Fed- 
eral Government. 

Congress  has  asked  that  position  papers  be  prepared  on  the  sub- 
ject and  submitted  by  December  and  we  were^  in  fact  working  on 
one  of  those  yesterday. 

Among  other  things,  we  concluded  that  adequacy  must  be  de- 
fined in  terms  of  society  as  well  as  the  individual  and  to  have  some 
indications  of  what  is  adequate,  one  must  have  some  indicators 
which  can  be  many  different  kinds  of  things. 

In  particular,  regardless  of  limtiations,  because  they  are  in  our 
world,  we  need  some  things  that  allow  comparisons  across  groups 
and  among  individuals,  and  standardized  testing  for  us  allows  that, 
particularly  things  like  minimum  competency  testing.  We  need  to 
know  whether  or  not  students  can  read,  write,  and  recollect  and,  if 
they  can't,  what  are  we  going  to  do  about  it. 

Then  you  get  into  some  questions  when  you  are  talking  about 
things  like  that,  whether  or  not  students  are  adequately  prepared 
to  deal  with  those  matters,  and  I  think  that  is  the  responsibility  of 
the  public  schools. 

We  can  do  that  by  informing  parents,  students,  and  working  with 
teachers,  and  so  on,  and  that  matter  can  be  addressed  very  easily. 

In  summary,  I  would  simply, leave  you  with  the  idea  that  when 
you  have  a  school  system  like  Guilford  County  that  was  already 
performing  above  national  norms  when  the  mandated  tests  were 
first  administered  in  North  Carolina,  that  does  not  leave  you  in  a 
position  of  satisfaction. 

That  leaves  you  in  a  position  of  being  able  to  do  more  and  we 
just  reported  to  our  board  last  night— our  board  of  education— al- 
though I  was  not  there  because  I  came  up  here,  that  over  a  4-year 
pericKl  scores  have  continually  gone  up  in  all  areas  across  the 
system,  and  in  every  school  in  all  the  areas  measured. 

I  think  that  is  what  we  are  all  about  in  education,  improvement, 
and  do  tho^e  kinds  of  things  and  to  sjiow  other  people  there  must 
be  ^ome' standard  v/dy  of  doing  it. 

Mr.  Weiss.  Thank  you.  Dr.  PriHdy.        .  I 

Mr,  Shields? 
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STATEMENT  OF  PATRICK  SHIELDS,  DIRECTOR,  EAST  HARLEM 
COLLEGE  AND  CAREER  COUNSELING  PROGRAM,  NEW  YORK,  N.Y. 

Mr.  Shields.  Good  morning.  My  name  is  Patrick  Shields,  present- 
ly the  associate  director  of  an  organization  known  as  the  East 
Harlem  Career  Counseling  Program. 

My  past  experience  in  the  field  of  education  includes  workmg  as 
an  assistant  dean  in  the  admissions  office  at  Amherst  College,  m- 
cludes  teaching  literacy  up  in  Massachusetts  for  the  New  England 
Farm  Workers  Council,  as  well  as  running'^  neighborhood  center 

in  Holyoke,  Mass.  .       .       .  rt**  i  u- 

My  masters  work  is  in  educational  admmistration  at  Columbia 
University,  with  emphasis  m  Federal  policy,  aAd  I  am  also  present- 
ly serving  on  an  advisory  committee  for  the  College  Board  for  a  ^ 
program. they  are  trying  to  put  together  to  identify  tallented  His- 
panic students  throughout  the  country.  '  '  ,  xt  v  i 
I  have  been  asked  to  come  here  because  I  am  from  New  York 
State  and  we  have  a  truth-in-testing  law,  and  so  I  have  worked 
under  it  for  the  last  year  and  I  have  been  asked  to  speak  about 
that,  but  it  is  important  to  note  first  where  I  work  and  howl  work. 

I  work  in  East  Harlem  and  the  students  with  whom  I  work  range 
in  age  from  14  to  27  in  East  Harlem  and  the  South  Bronx.  Those 
names,  of  course,  ring  bells  in  your  ear^.  They  are  very  impover- 
ished areas.  East  Harlem  has  an  unemployment  rate  of  around  50 
percent,  median  income  between  $5,000  and  $6,000,  depending  on 
the  group  we  are  talking  about,  whether  or  not  it  is  Hispanic  or 

Those  particular  aspects  of  the  community,  of  courge,  have  their  ^ 
effects  on  the  students  I  work  with.  The  lack -of  employment  Oppor- 
tunities, the  welfare  dependent  lives  of  so  many  of  the  families, 
affect  students  greatly.  ,  .i.   r  . 

They  are,  of  course,  the  ones  for  whom  there  are  the  fewest  occu- 
pational jobs  opportunities  available  in  the  city.  The  educational 
opportunities  available  to  my  students  to  make  up  for  that,  in  no 
way  compensate  for  the  bleak  occupational  outlook. 

In  New  York,  45  percent  of  the  students  who  enter  high  school  in 
the  ninth  grade  do  not  graduate.  That  is  in  the  city  as  a  whole. 

In  our  local  academic  comprehensive  high  school  in  East  Harlem, 
there  are  1,800  students,  71  of  whom  graduated,  7  of  whom  gradu- 
ated with  New  York  State  Regents  diplomas.  .  ,  . 

Statistics,  of  course,  can't  really  talk  about  what  those  students 
have  to  go  through.  They  don't  really  represent  the  reality^of  ^the  ^ 
situation  there  .         ,      •  i 

Walking,  into  a  high  school  in  the  morning  and  seeing  the  kidf? 
out  on  the  steps  getting  high,  or  playing  basketball  ^ver  in  the 
park  across  the  way,  says  a  great'  deal  more  than  those  statistics 
do -yet  somehow  too  many  of  those  students  sometimes  for  our 
likes  overcome  those  incredible  roadblocks  and  continue  to  strive 
for  some  ill-defined  measure  of  success  in  their  eyes.        ,  '  ,  .  ^ 

In  other- words,  they  stay  in  school  or  they  try  to  get  hack  into 
school  During  the  school  year,  our  appointment  calendar  is  filled 
up<2  and  3  weeks  in  advance.  These  are  eighth-  and  ninth-grade 
students  who  want  to  go  into  high  school,  students  \yho  dropped 
out  and  want  to  get  back  in.  They  are,  however,  in  the  majority, 
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students  who  ar^  in  the  11th,  12th  grades  who  are  faced  with  the 
maze-like  process  of  testing  and  financial  aid  and  admission  forms 

It  is  our  job  as  college  counselors  to  help  them  through  this 
maze.  Unfortunately,  the  simple  fact  that  they  have  made  that  de- 
9ision  to  continue  their  education  in  no  way  does  away  with  the 
-obstacles  that  have  been  thrown  up  in  front  of  them  in  the  educa- 
'tion^l  process.  .  '  ^,    r  r 

Ijnfortunately,  too  many  of  those  obstacles  are  in  the  torm  oi 
standardized  tests,  and  my  students  perform  extremely  poorly  on 
those  tests.  It  is  not  my  purpose  today  to  expose  the  negative  side 
of  standardized  tests  in  America.  The  validity  of  those  tests  has- 
been  argued  back  and  forth  on  both  sides  of  the  political  spectrum. 

However,  the  facts  and  arguments  of  those  particular  arguments 
concerning  standardized  tests  are  germane,  to  the  discussion  of  how 
my  students  confront  the  Scholastic  Aptitude  Tests, 

Standardized  tests  pjay  an  extremely  important  role  in  the  edu- 
cational life  of  the  students  who  come  to  see  me.  In  such  a  large 
system  as  New  York,  there  are  many,  many  educational  options.  A 
student  coming  out  of  the  elementary  school,  going  on  into  junior 
high  school,  has  a  number  of  junior  high  schools  to  choose  from, 
and  within  the  junior  high  schools,  there  are  specialized  schools. 

Moving  into  high  school,  there  is  a  myriad  of  five  optipns  that 
the  student  has.  New  York  has  the  distinction  of  having  some  of 
the  very  finest  high  schools  in  the  country— and  some  of  the  worst 

The  decision  on  who  gets  into  the  very  best  high  schools  is  made 
upon  a  student's  performance  on  one  standardized  test.  That  is  not 
true  of  all  the  high  schools."  .     ,      u  , 

There  is  no  question  that  the.guidance  counseling  in  the  schools 
depends  a  great  deal  upon  the  students.  In  other  words,  where  they 
are  guided  to  go  to  high  schooLdepends  lipon  their  results  on  stand- 
ardized reading  and  math  tests.  Almost  all  of  the  importanLdeci- 
sions  in  a  student's  schooling  have  been  based  all  or  in  large^  part 
on  the  performance  of  standardized  tests,  and  so,  by  the  time  they 
reach  my  door,  they  have  come  to  perceive  those  tests  as  having 
some  type  of  mystical  powers.  .        .  ir 

Most  frequently,  this  is  fosterfed  in  the  form  oi  a  negative  self- 
attitude.  These  tests  have  proven  them  to  be,  in  their  own  eyes, 
somewhat  stupid.  Given  this  mysticism  of  the  test,  it^is  often  very 
difficult  for  me  to  prepare  a  student  for  the  Scholastic  Aptitude 
Test.  ,  / 

This  difficulty  is  compounded  because  the  test  is  becoming  more 
important  every  year  for  my  students  in  terms  of  their  chances  of 
attending  the  colleges  of  theiY  choice.  This  is  not  because  the.  ad- 
mis.sion  proce.ss  is  getting  tougher.  There  are  less  students  applying 
to  college  now.  It  is  because  of  the  role  of  the  test  in  the  financial 

aid  process.  ...     i  .  i  • 

As  the  Federal  financial  aid  dollar  continufes  to  shrink  in  both 
real  and  -inflationary  terms,  the  competition  for  colleges  own 
campus-based  money  becomes  much  more  keener,  and  as  a  total 
applicant  pool  decreases,  colleges  begin  to  compete  for  those  stu- 
dents by  l?uying  them.  ,  ,     ,  .  rr  j 

I  know  of  many  schools  where  scholarships  are  offered  regardless 
of  need,  any  kind  of  financial  need,  for  three-quarters  of  tuition  for 
a  certain  combination  of  SAT  scores,  and  full  scholarships  for  a 
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certain  SAT  bcurc  combined  with  a  comparabJ>  higher  rank  in 
class.' 

Very  few  of  the  btudentb  ever  receive  any  of  those  me/it-based 
moneys,  so  when  a  student  first  comes  to  me  for  assistance  in  the 
college  application  process, and  I  tell  them  that  they  have  to  take 
the  Scholastic  Aptitude  Test,  I  really  am  faced  with  a  dilemma  be- 
jcause  a  student,  the  jtype  I  work  with,  almost  always  appears  ex- 
tremely anxipys.  Their  most  frequent  response  is,  "I  kaow  I  am 
going  to  fail  it."  I  see  a  need  to  try  to  lessen  that  anxiety  but,  at 
the  same  time,  it  woiald  be  unfair  of  me  to  minimize  the  impor- 
tance of  the  test.  *       .  \ 

So,  confronted  with  this  when  I  first  began  to  work  at  the  East 
Harlem  Counseling  Program,  I  spoke  to  some  people  in  other  orga- 
nizations and  decided  to  establish  a  seminar  that  the  students.,^ 
could  attend  for  .the  3  weeks  before  the  examination  where  we^ 
could  begin,  to  deal  with  some  of  these  problems.  ^  1 

The  purpose  of  the  seminar  was  not  to  further  develop  the  stu- 
dents' verbal  or  mathematical  abilities,  unlike  commercial  prep 
courses,  we  didn!t  hand  out  vocabulary  lists  and  algebraic  and  geo- 
metric concepts.  We  set  up  a  course  in  such  a  way  students  became 
intimately  familiar  with  the  examination,  the  types  of  questions 
asked,  the  way  the  questions  w^ere  phrased,  and  the  amount  of 
time.  ; 

The  whole,  purppse  of  the  course  was  to  get  the  t^tudent  to  a  point 
that  they  were  so  familiar  with  tiie  exam  and  the  process  of  taking 
it  that  they  no  longer  harbored  the  fears  and  anxieties  that  h?  first 
encounters.  ,   '  '     "      '  ,  / 

Mr.  Wkiss.  The  bells  have  rung.  There  is  a  vote  on  jthe^floor  pf 
the  House,  so  we  will  take  a  10-minute  recess.  Ssjf 
.    [A  short  recess  was  taken.] 

Mr.  Weiss.  The  committee  will  resume  its^ hearing. 

If  you  will  pick  up,  we  can  continue.  ^ 

Mr.  Shiklds.  Thank  you^    .  .  ,       *  ' 

I  was  talking  about  the  seminars  I  had  establfshed  to  help  stu- 
dents prepare  to  take  the  Scholastic  Aptitude  Tests.  After  a  few  of 
tl)e  seminars,  two  serious  flaws'became  evident  which  are  relevant 
in  today's  discussion.  Both  of  tnese  jjroblems  re^ulted  directly  from 
my  need  to  resort  to  various  cpmnrercial  S'AT  prep  guides  in  the 
absence  of  copies  .of  the  actual  test 

Given  the  nature  of  the  seminar,  to  instill  conHHence  through  fa- 
miliarity, not  having  real  SAT  questions  in  the  students'  exercises 
abvioual>  reduced  uur  chances  cjf  success.  Without  actual  test  ques- 
tions, it  was  difficult  in  most  cases  and -impossible  in  many  to  con- 
vince the  students  that  they  weije  walking  into  tha  exam  with  accu- 
rate knowledge  of  whtit  thev  woUld  c6nfront. 

The  second  problem  resulting ^ from  lack  of^cdess  to  the  test  con- 
cerned rpy  effectiveness  as  an  instructor  of  th»prep  course.  Com- 
mercially published  prep  book^  and  Educational  Testing  Service 
publications  on  the  SAT  contain  all  the  different  types  of  questions 
that  are  asked  on  the  tests.  The  commercial  texts,  however,  do  not 
contain  questions  of  consistently!  high  quality. 

You  cannot  compare  the  text  .and  detect  subtle  emphasis  within 
certain  sections.  The  truth  in-testing  legislation  remedied  those  two 
pjx)blems  for  me.  With  actual  copies  of  the  SAT  tp  show  the  stu- 


denb,  I  havu  been  much  more  buccebiful  in  instilling  confidence  in 
my  students. 

I  believe  it  is  telling  to  note  attendance  has  doubled  since  we 
began  to  use  the  actual  SAT  in  the  course.  Oxir  preparation  has 
been  significantly  more  successful,  and  they  react  very  favorably  to 
haviii|Lthe  actual  copies  of  the  tests  themselves.  My  coaching  has 
improved  since  I  have  been  abJe  to  study  the  exams  and  compare 
the  tests.  * 

The  enactment  of  truth-in-testing  in  New  York  State  has  also  al- 
lowed us  to  add  another  dimensioa  l.>  our  counseling  services  vis-a- 
vis the^ATs.  Before  the  lavv.  if  a  student  came  to  us  after  taking 
the  SAT  with  the  feeling  that  he  had  done  poorly,  or  if  his  scores 
were  way  out  of  line  with  what  \m  had  expected,^  we  had  no  re- 
course byj:  to  sit  down  with  the  ^tucent  and  try  to  remember  what 
he  had  done.  Rarely  were  we  t  v^r  .successful  in  finding  ^my  prob* 
lem^.  <:>  -  \ 

Now,  we  can  request  a  cop.v  of  the  examination,  ^the  actual  cor- 
rected test,  sit  down  and  begin  lo  analyze  where  arid  how  the  stu- 
dent went  wrong.  This  may  afford  us  the  ability  to  reveal  concrete, 
nonaptitude  related  rpasons  for  poor  performance. 

For  example,  a  sti^deht  may  have  guessed  too  often,  rushed  an- 
swers at  the  end  of  cOr^in  set  tions  in  order  to  finish  and  not  leave 
blanks  and,  ver>  importantly  foi  some  students,  the  students  with 
the  highest  test  anxiejlfes,  they  are  able  to  sit  down  and  review  all 
the  questions  and  an^^^ers  and  realize  that  they  could  have  per- 
formed better  on  the^test,  that  tliey  were  capable  of  pnswering 
questions  that  they  missed. 

If  their  poor  performance  on  the  exam  had  been  due  to  a  test 
anxiety,  they  can  begin  to  understand  and  deal  with  it. 
*  I  came  here  today  to  speak  because  of  my  personal  experience 
with  the  effects  of  truth-in-testing  legislation  in  New  York  State.  I 
have,  outlined  that  experience,  and  showed  its  overwhelmingly  posi- 
tive effects  on  my  work,  with  students  in  East  Harlem.  I  do  hope, 
however,  that  my  discussion  today  has  attested  to  more  than  just 
this  experience. 

It  is  m>  opinion  that  if  the  Educational  Testing  Act  of  19&1  is 
enacted  and  carried  out  in  good  faith,  it  will  have-its  greatest  effect 
on  the  most  educationally  disadvantaged  of  the  students  who  take 
the  SAT.  It  will  be  my  students*  counterparts  in  the  urban  and 
rural  ghettos  across  whis  country  who  will  be  feiven  a  much  fairer 
shot  at  succeeding  in  the  educational  process. 

Truth-in-testing  promises  these  students  the  opportunity  to  con- 
front their  attitudes  toward  the  tests  directly.  As  declining  enroll- 
ments make  tests  less  important  for  the  rich  who  can  affr^rd  the 
full  cost  of  education,  the  shrinking  financial  aid  dollar  and  the 
piiujicious  practice  of  no-need,  merit-hase^  awards  make  tests  more 
important  to  the  poor. 

The  Educational  Testing  Act  of  1981  recognizes  that  *'there  is  a 
continuous  need  to  ensure  equal  access  for  all  Americans  to  educ- 
tional  opportunities  of  high  quality.'*  It  is,  however,  beyond  the 
scope  of  both  this  bilLand  of  the  p(7wers  oTthe  Federal  Government 
in  general  to  legislate  how  students  are  educated  on  the  elemen- 
tary and  secondary  levels  and  how  colleges  choose  to  spend  their 
private  moneys.  , 
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What  you  can  do,  given  the,present  situation,*  is  to  give  students 
like  the  ones  1  work  with  in  East  Harlem  just  a  little  better  shot. 
You  can  provide  tHem  Nvith  one  more  instrument  in  their  fight  to 
overcome  the  obstacles  inherent  in  our  educational  system  which 
have  served  to  keep  them  down  in  the  past. 

Turge  you  to  enact  the  Educational  Testing  Act  of  1981. 

[The  prepared  statement  of  Patrick  Shields  follows:] 

Prkparbd  Statkment  of  Patrick  Mi  Shields,  Associate  Director.  East  Harlem 
College,  a.vd  Career  Counseling  PRm;RAM.  New  York  City 

# 

Good  norni«g.    ^5y  name  as  latrick  K.  Shields,    I  am  presently 
serving  as  the^  Assoeiate  Dircetor  of  the  East  ilarlem  ColD^ege  and 
Career  Counseling  Program  in  Kew  York  City.    Ours  is  a  not-for- 
proiat  Talent* Seareh  ageney  whieh  works  with  over  one  thousand 
students  annually,  assisting  them  to  formulate -and  earry  out  their 
edueational  and  eareer  goals.    My  previous  experience  m  the  field 
of  education  includes  teaehing  literaey  for  the  Kew  England  Farm 
.■Workers'  Couneil,  diree ting  a^,  neighborhood  eenter  in  the  Puerto 
Riean  ghetto  of  Holyoke,  K^ssachusetts,  and  working  as  an  Assistant 
to  the  Bean  of  Admission  at  Amherst  College,    Hy  Masters  work 
at  Columbia  University  is  in  Fxiueational  Administration  with  an 
emphasis  In  Federal  Poliey» 

I  have  been  asked  to  speak  here  today  boeaus^  of  my  exporienee 

wit^  the  Seholastie  Aptitude  Test  after  enaetment  of  truth-in- 

testlng  legislation  in  Kew  York  State.    Our  eli<xntele  a-t  the 

East  ijarlem  College  and  Career  Counseling  Program(EHCAOCP)  ranges 

in  age  from  fourteen  to  twenty-seven  and  eomes  predominantly  from 

the  East  Ihrlem  and  Couth  Bronx  areas.    These  are  npighbofhoods 

whieh  are  desJlgnaled  by  the  fhyor's  offiee  as  poverty  areas  within 

a  eity  of  nvinife&t  poverty.    Our  mast  reeent  statistics  on  El  Barrio^ 

as  Eaat  Ilarlem  is  termed  by  its  residents, show  an  unemployment  rate 

hviverl^iJl^  around  fifty  percent  and  a  median  family  meome  of  between 

five  and  ^six  thousand  dollars.    The  laek  of  employment  opportunity 

and  the  dcyid-cnd ,  welfare-dependent-  lXves,-or  so^ciany^br  tlic  .ar£a's_  _ 

residents  has  its  most  ehilling  effect  on  the-youth  of  East  ilarlem. 
V 

I  recently  ar^cd  a  young  wu^vin  who  was  in  my  office  advertising  a 
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Yet  somehow  nnny,  very  cany  of  these  young  people,  overcome 

most  of  these  ii^credibl^  roadblocks  and  continue  to  strive  for 

some  ill-defined  notion  of  success.    The  deinand  for  access  to  our 
o 

program  is  evidence  of  that  fact.    During  the  school  year,  it  takes 
from  two  to  three  weeks  to  get  an  after-school  appointment.    These  are 
eighth  and  ninth  graders  who  are  seeking  assistance  in  choosing 
.high  school;  they  are  teen-agers  who  left  the  frequently  unbearable 
conditions  of  their  high  ocho.ols,  but  now  want  to  return  to  the 
educational  system  after  experiencing  the  frustrations  of ^an  already 
too  tight  job  market  without  a  high  school  diploma;  they  are  tenth 
and  eleventh  graders  who  need  curriculum  guidance  in  their  preparation 
for  myriad  professions;    they  are,  in  the  majority,  seniors  in 
high  school  preparing  for^college  and  faced  with  the  maze-like  process 
of  testing,  financial  aid,  and  admissions  forms.    The  EHCACCP  is 
a  community  a^iency,  not  affiliated  with  any  educational  institution, 
and  so  none  of  these  people  have  to  come  to  see  us.    Thus,  our 
clientele  is  a  highly  motivated,  self-selected  group.    This  does  ^ 
not  mean,  however,  that  they  are  any  less  educationally  or  culturally 
disadvantaged  than  their  counterparts  who,  for  the  moment,  stay  out 
on  the  street.    Our  atudents' have  simply  preached  a  point  in  their 
lives  where  they  are  able  to  take  what  they  see  to  be  long-range, 
positive  steps.    It  is  our  job  to  help  them  to  take  these  steps; 
the  fact  that  they  are  resolved  ^o  succeed  in  no  way  lessens  the 
obstacles  which  they  will  face  throughout  the  educational  process. 
Unfortunately,  too  many  of  these  obstacles  are  thrown  up  by 
standardized  tests.    Our  students  perform^extreroely  poorly  on 
these  tests. 
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It  is  not  my  purpose  hero  -today  to  expose  the  necative  side 
or  prejudicial  nature  of  standardized  tests  in  America.  It  is  a  , 
known  ract  'that  black  children  score  on  the  a/ei-age  one  standard 
deviation  below  their  white  counterparts  on  standardized  intelligence 
test.    The, validity  of  these  tests  continues  to  be  arp>ed  by  scholars 
on  both  sides  of  the  political  spectrun.    The  constitutionality 
of  the  us4l£;standar{iized  tests  to  assign  public  school  pupils  has 
teen  batt^lcd  out  in  a  number  of  Federal  Courts.    Most  recently,  both 
the  Fifth  and  llinth  Circuits  have  ruled  some  of  the  use  of  these 
tests  unconstitutional.    These  facts  and  areuments,  although  not 
the  focus  of  today's  hearing, 'are  germne  to  a  discussion  of 
how  minority  students  confront  the  Scholastic  Aptitude  Test. 
Standardized  tests  have  played  an  extremely  large  role  in  the 
educational  lives  of  our  students  in  East  liarlem.    In  such  a  large 
school  system  as  llqw  Tork's,  the  educational  options  are  much 
more  numerous  and  broader  than  they  are  in  small  systems  with  only 
a  hapdful  of  schools.    Moving  from  elementary  school  to  junior  high, 
'  students  are  faced  with  the  options  of  various  speSialized  schools 
in  addition  to  various  progKiBS  within  their  local  school.  Koving 
from  junior  high  into  high  school,  the  PPtions  are  nearly  linijless. 
Hew  York-City  has  the  distinction  of  having  some  of  the  very  best 
high  schools  in'  the  country  and  some  of  the  very  worse.  Admission 
to  the  very  best  of  the  schools  is  based  upon  a  student's  performance 
'on    one  test.    Evep  in  the  i»se  of  schools  where  admission  is 
not  tased  on  a  standardized  test,  "students  are  offn  counseled  on 
where  to  apply  or  not  to  apply  based  apon  their  performance  on  . 
standardized  reading  and  rath  test  which  «iey  take  throughout  their 
school  careers.    The  point  here:  is  that  almost  all  of  the  important 
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decisions  in  a  student's  schooiang  have  been  made  tased  all  or  in 

"a  large  part  on  their  pprXorcanbe  on  standardized  tests.    By  the   

time  they  reach  our  door,  they  have  copie  to  perceive  these  tests 
as  possessing  some  mythical  powers.    Most  Xrequejitly,  this  has 
Xostered  a  negative  self-attitude.    These  tests  have  proven  them 
to  be,  in  their  own  eyes,  stupid.    Given  this  mythicism  of  the  test, 
it  is  often  difficult  to  help  prepare  students  to  take  the 
Scholastic  Aptitude  Test.    This  difficulty  is  compounded  by  the 
fact  that  their  perf&rmance  on  the  SAX  is  becoming  more  important 
in  their  chances  of  attending  a  college  of  their  choice.  Interestingly, 
but  not  surprisingly,  this  is  not  because  the  SAT  is  becoming  more 
instrumental  in  admission  decisions.    Rather,  SATs  are  more  important 
now  because  of  their  role  in  the  financial  aid  process,    last  year 
at  the  private  colleges  in  my  state.  New  York,    only  fifty-five  per- 
cent of  the  accepted  applicants  received  sufficient  financial  aid. 
And  we  are  talking  about  a  state  with  a  generous  financial  aid  ^ 
program  of  its  own.    As  the  Federal^  financial  aid  dollar  continues 
to  shrink,  in  "both  real  and  inflationary  terms,  the^  competitidh 
for^he  colleges*  owji  campus-based  add  becomes" much  keener.  As 
the  total  a"Kpy.cant  pool  decreases,  colleges    compete  more  for 
students  by  literally  buying  them.    I  know  of  schools  where 
scholarships  .are  offered,  regardless  of  need,  for  three-q\iarters 
tuition  for  a  certain  combination  of  SAT  scores  and  class  rank,  full 
scholarships  are  pfferpd  to  those  with  better  SAT  scores  and  a 
comparably  higher  ranT<..\.yery  few  of  our  students,  even  ,our  very 
best  who  are  accepted  at  the  mo:^  selective  institutions  in  the 
country,  receive  these  solely  merit -Ij^ised  monies. 
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And  so  N,hon  a  student  first  comos  to  mo  for  assistance  in  the  , 
coUoce  application  ^process  and  I  inform  Mm  that  ho  will  noed 
to  take  tho  Scholastic  Aptitudo  Tost.  I  an  facod  with  a  dilonna. 
Thti  student  is  usually  oxtromoly  anxious  about  tho  tost.  The 
nost  fxoouent  response  is.  "I  know  I'n,  coing  to  fail  it".    As  a 
counselor.  1  see  a  need  to  lessen  the  student's  anxiety,  to  denythici.e 
the-  role  of  the  toot.    At  the  sane  ti..o,  it  would  bo  both  unrealistic 
and  unfair  to  tho  student  if  1  wore  to  nininizo  tho  importance  of 
the  SAT..  After  discussions  with  tny  colleagues  at  the  East  Ilarlom 
CoUoco  and  Career  Counseling  Progwra  revealed  that  their  students 
exhibited  the  same  intense  anxiety  and  Tear  at  the  mention  of  tjje 
SATs,  I  established  a  SAT  prejaration  seminar  for  our  students  to 
deal  with  these  problems.    The  purpose  of  the  seminar,  then,  was 
not  to  further  develop  the  students'  verte^l  and  jrath  abilities. 
Unjike  m»ny  commercial  SAT  prep  bourses,  which  are  normally  - 
nuch  longer  than  oar  three  week  seminar,  we  do  not  hand  c^t  voeabulary 
lists  and  review  all  of  the  algebraic  and  geometric  concepts.    Kor  • 
do  we  attempt  to  key  the  students  xnto  any  magical  test-taking 
tricks.    I  simply  set  up  a  course  in  such  a  way  that  the  students 
become  intimately  familiar  with  the  fornat  of  the  SATs,  the  type 
of  questions  which  .ire  askfed,  thfway  questions  are  phrased,  and  « 
the  anou:it  of  time  alloted  for  various  sections  of  the  'test.  The 
sole  purpose  of  the  course  is  to  demythieize  the  SAT,  fo  get  the 
student  to  the  point  that  he  is  so  familiar  with  the  exam  and 
the  process  of  taking  it  that  he  no  longer  harbors  the  fear  and 
anxiety  that  characterized  his  first  encounter  with  the  idea  of 
taking  the  test!    Our 'hope  is  tfat  with  a  more  realistic  perspective 
and  .a  piore  positive  attitude, 'he  will  be  able  to  perform  up  to  his 
potential. 
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After  a  few  of  the  seminars,  two  serious  flaws  became  evident 
which  are  relevant  to  today's  discussion*    Both  of,  these  problems 
resufted  directly  fxom  my  need  to  resort  to  various  commercial 
SAT  prep  guides  an  the  absence  of  copies  of  the  actual  test#  Given 
the  nature  of  the  seminar,  to  instill  confidence  through  familiarity, 
not  having  real  SAT  questions  in  the  students*  exercises  obviously 
reduced  our  chances  of  success*    Students  were  told  that  they  . 
were  taking  practice  tests  which  resembled  the  Scholastic  Aptitude 
Te^st,  but  I  could  not  honestly  tell  them  how  close  the  resemblance 
actually  was*    Without  actual  test  questions,  it  was  difficult  in 
most  cases  and  impossible  in  many  to  convince  the  students  that 
they  were  walking  into  the  exam  with  accurate  knowledge  of  what 
they  would  confront*    The  second  problem  resulting  from  lack  of 
access  to  the  test  concerned  ray  effectiveness  as  an  instructor  of 
the  prep  course*    Commercially  published  prep  books  and  Educatipnal 
Testing  Service  publications  on  the  SAT  Contain  all  the  different 
types  of  questions  that  are'^sked  on  the  *tests*    The  commercial 
texts,  however,  do  not  contain  questions  of  consistently  high  quality 
The  ETS  publications  did  not  provide  a  sufficient  quantity  of 
quesj/io^d^such  that  one  could  begin  to  detect  subtle  emphasis  within 
the  different  sections*    For  example^  there  are  certain  algebraic 
concepts  which  are  emphasized  more  on  the  math  section  than  others* 
Without  access  to  a  number  of  tests,  I  could  not  begin  to  get  the 
type  of  grasp  o/  the  exam  I  needed  ta  be  an  effective  teacher* 

The  truth-in-testing  legislation  which  was  enacted  into  law 
in  Hew  York  State  remedied  these  two  problems  in  our  semJ^nar  on  the 
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SAT-    With  actual  copies  of  the*SAT  to  show  to  the  students  and 
froo  which  to  compile  exercicesf^  have  been  more  successful  in 
instilling  confidence  In  my  students.    These  are  young  men  and 
women  who  have  grown  up  surrounded  by  a  plethora  of  social  service 
agencies  offering  to  help  then  in  some  aspect  of  their  lives.  They^ 
'are  extremely  perceptive  of  programs  such  as  ours  and  have  learned 
to  distinguish  quality  assistance  from  the  ineffective  services 
offered  by  many  agencies.    I  believe  that  it  is  telling  to  note 
that  attendance  al  the  SAT  seminars  has  doubled  since  we  began  to 
use  the  actual  SAT  exams  in  the  course.    There  is  no  question  in 
my  ciind  t)i5t  fur  preparation  has  been  significantly  more  successful 
in  easing  the  anxiety  in  our  students.    They  simply  reaet  very 
favorably  to  having  actual  popies  of  the  SAT  in  their  hands.  They 
feel  as  though  they  know  what  they  are  getting  themselves  into. 
Likewise,  my  coaching  has  improved  since  I  have  been  able  to  study 
a  good  number  of .SATs  and  begin  to  compare  the  tests. 

The  enactment  of  truth-in-testing  in  flew  York  State  has  also 
allowed  us  to  add  another  dimension  to  our  eounseling  serviees    -  i 
vis-a-vis  the  SATs.    Before  the  law.  if  a  student  cane  to  us  after 
•takfng  the  SAT  with  the  feeling  that  he  had  done  poofly.  or  if 

'   Igis  scores  were  way  out  of  line  with  what  we  had  expected,  our 
only  recourse  was  to  have  the  student  sit  down  and  try  to  remember 
everything  he  did  or  didn't  do  during  the  exam.    V/e  would  then  try  to 
figure  oat  where  he  had  gone  wrong.    Rarely  were  we  successful  in 
uncovering  the  problem.    Kow  we  can  request  a    copy  of  the  student's 
a'c^ual  corrected  test.    We  can  then  proceed  to^ analyze  where  and 

%ow  the  student  went  wrong.    i:ot  only  does  this  serve  to  further 
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'  'deoythicize  the  exam,  bivt  it  nay  also  reveal  concrete,  non-aptitude 
related  reasons  for  a  poor  performance,  -For  example,    a  student 
nay  h^ve  guessed  too  often,  or  may  have  rushed  answers  at  the  end 
of  each  section  in  order  not  to  lea ve» blanks.    Importantly  for 
some  students,  being  able  .to  sit  down  with  the  test  and  review  the 
questions  slowly  demonstrates  to  them  that  they  could  have  performed 
much  better,  that  they  were  capable  of  answering  questions  that 
they  niissed  on  the  exam.    Their  poor  performance  may  have  been,  again, 
due  to  a  test  anxiety  that  they -can  now  begin  to  understand. 

I  came  here  today  to  speak  because  of  my  personal  experience 
with  the  effects  of  truth-in-testing  legislation  in  New  York 
State.    I  haye  outlined  that  experience  and  'showed  its  over- 
whelmingly  positive  effects  on  my  work  with  students  in  East  Harlem. 
I  do  hope,  however,  thai  my  discussion  today  has  attested  to  more 
than  just  this  experience.    It  is  my  opinion  that  if  the  "Educational 
Testing  Act  of  1981"  is  enacted  and  carried  out  in  go6d  faith  that 
it  will  Kve  its  greatest  effect  on  the  most  educationally 
disadvantaged  of  the' students  who  take  the  SAT*    It  will  .be 
my  students*  counterparts  in  the  urban  and  rural  ghettos  across 
this  country  who  ^ill  b6  given  a  nmch  fairer  and  belter  shot  at 
succeeding  in  the  educatipnal  process.    These  are  the  students 
who  perform  most  podtly  on  the  SAT  and  so  those  who  have  the  most 
to  gain  from  passage  of  the  legislation.    It  is  these  students 
who  are  most  stlienated  from  the  testing  process.  Truth-in-testing 
promises  these  students  the  opportunity  to  confront  their  attitudes 
tov/ard  the  tests  directly.  As  declining  enrollments  make  tests 
less  important  for  the  rich  who  can  afford  the  full  cost^of  education, 
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the  shrinking  financial  aid  dollar  and  the  pernicious  practi|e  of 
no-need\,  nerit-tased  awards  nake  tests  more  important  for.  the'  poor. 
The  "Edlcational  Testing  Act  of  I98l'"  recocnizes  that  "there  is  a 
contiius  need  to  ensure  equal  access  fS5  all  Americans  to  educa- 
tional opportunities  of  high  qHality".    It  is,  however,  beyond  the    -  ' 
sctfpe  of  Doth  this  hill  and  of  the  powers  of  the  Federal  government 
'to  leeislate  how  students  are  educated  on  the  elementary  and; 
secondary  levels  and  how  colleges  choose  to  spend  their  private 
monies.    Vfhat  you  can  do  given  the  present  situation  is  -to  give 
students  like  the  ones  I  work  with  in  East  Harlem  just  a  little  ~ 
better  shot.    You  can  provide  them  with  one  more  instrument  in 
their  fight  ±0  overcome  the  obstacles  inherent  in  our  educational 
system  which  have  served  to  keep  them  down  in  the  past.    I  urge  you 
to  enact  the  "Educational  Testing  Act  of  1981".  ^ 

Mr.  W6I8S.  Thank  you  very  much. 
Mr.  Schafer? 

STATFMENT  OF  WILLIAM  D.  SCHAFER,  PROFESSOR,  EDUCATION- 

■7l  measIreme^^^^^^   statistics,  college  of  EDUCATK^^^ 

DEPARTMENT  OF  MEASUREMENT  AND^STATISTICS,  UNIVERSI- 
TY OF  MARYLAND 

Mr.  Schafer.  Mr.  Chairman,  members  of  the  subcommittee,  my 
name  is  William  Schafer,  associate  professor  of  measurement,  sta-  ^ 
t"E,  and  evaluation  in 'education  at  the  Univef  jjr  of  M^^^^^^ 
•  It  rives  me  great  pleasure  to  be  here  on  behalf  of  the  American 
'  Peifnnd  and  Guidance  Association,  the  National  Professional  As- 
St?on  of  over  40,000  personnel,  guidance,  and  counseling  work- 
Sand  the  Association  for  Measurement  and  Evaluation  m  Guid^ 

'Tapprt:fate  vTi^Tu^ftSro^^^  to  expres^  the  reserya- 

tionsTE^oSnrg  feveral  assets  of  the  Educational  'l^esting 

^?  wish  to  preface  my  remarks  by  poting'that  the  Association  for 
Mewifement  and  Evaluation  in  Guidance  has  adopted  a  position 
wrrSJSfto  "egSlation  affecting  testing  for  selection  m  educa- 
tional  and  occupational  programs. 
•  In  hat  statement,  we  identify  an  environment  m  which  tes^^^^^ 
contribute  most  effectively  to  society  and  indicate  that  there  is^  no 
Xious  need  for  legislation  affecting  .  testing,  since  most  test  pro- 
Hiinpr<»  already  follow  the  practices  we  recommend. 

We  drrSoLiz«,  though,  that  others  may  feel  differently  regardT- 
ine^thrnS?for  tegislation  on  testing,  and  hav*  developed  a  series 
of  provisiS  which  we  might  support  as, well  as  a  hst  of  proposals 
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which  we  recpmmend  against.  A  qopy  of  the  stateni'erlt  is  appended*** 
to  my  remarks  today.  ^    '  ^  i  .  ^ 

Oi)e  major  concern  I  have  about  H.R.  1662  is  refle(5ted '  in.  my 
association's  statement,  which  recommends' specifically  against  en- 
actment of  legislMion  whicti  requires  disclosure  of  items  following 
"  testing.  The  provisions  in.cSectioos  5(a)  (IXA)  and  5(a)  (2XA)  of  H.ll. . 
1662  would  do  just  that. 

I  see  little  value  and  much  harm  in  disclosure.  The  value,  lies  in 
examinees  being  able  to  check  their  scores  and«  evaluate  on  a  sub- 
jective basis  the  items  they  took.  On  occasion,  as  has  happened  al- 
ready, they  or  others  may  convince  a  test  producer  of  the  correct- 
ness of  a*  nonk^yed  answer,  thus  affecting  test  scores. 

On  the  surface,  this  seems  to  argue  strongly  that  test  review  by 
examinees,  available  from  full  disclosure,  is  desirable.  How^ever, 
'  this  benefit  is  not  without  qualification.  ^ 

Let  us  consider  the  value  of  score  changes.  Competent  test  use 
entails  the  interpretation  of  a  result  as  indicative  of  a  range  of.por 
tential  values  for  a  score  as  opposed  to  a  specific  point  value.  An 
analysis  of  responses  to  test  items  is  used  as  a  basis  for  e3tablishing 
the  range  and  the  extent  to  which  poor  items  exist  is  reflected  in 
its  size.  Thus,  a  change  in  scoring  for  some  items  on  a  test  is  un- 
likely to  move  the  scor»  range  of  a  given  examinee  totally  outside 
its  original  limits. 

The  harms  of  disclosure  are  many.  First,  assuming  the  items  are 
to  be  reused,  effects  of  inequality  in  access  to  information  about  a 
test  for  future  examinees  would,  probably  increase^  since  the  items 
themselves  would  be  part  of  that  information,  iffso,  the  measure- 
ment properties  of  the  items, would  be  affected,  likely  harmed. 
Thus,  disclosure  would  effectively  destroy  further  usefulness  of  the 
items. 

On  the  other  h^nd,  if  the  items  are  not  to  be  reused,  new  itenis 
would  need  to  be  developed  for  each  {est  admiiitetration.  This 
would  result  in  more  expensive  tests  as  well  as  poorer  tests,  since 
the  best  items  could  be  used  only  once.  ^ 

Second,  without  the  capability  of  reusing  items,  the  ability  of  test 
producers  to  equate  tests  would  be  impaired,  reducing  comparabil- 
ity from  administration  to  administration  and  thus  the  ability  to 
study  trends  6Ver  time^,  unless  nonscored  items  were  included  For 
equating  purpo^esr-'Wnile  some  producers  already  include  non- 
scoredjjtenisrtfie  net  result  is  often  a  poorer  test  since,  in  general, 
the  f  reater  the  number  of  itdins  comprising  a  score,  the  more  accu- 
rate it*  is.  ^  *  ^ 

Third,  attention  of  future  examinees  may  be  diverted  from  what 
could  be  valuable  preparation  experiences  to  merely  a  review  of  a 
large  number  of  previous  items.  And  fourth,  since  items  over  cer- 
tain cont^t  areas  are  likely  to  be  easier  to  produce  than  over 
others,  the  proportional  content  of  a  given  test  may  be  altered*  over 
time  front  that  which  has  been  judged  most  appropriate, 

The  net  result  of  these  factors  would  be  harmful  to  the  predictive^ 
properties  of  tests.  But  some' may  ask  what  harm  there  is  in  reduc- 
ing test  effectiveness  since  ^^ny  other  predictors  of  success  are  in 
common  use  as  well. 

To  address  this  point,  it  should  be  noted  that  the  relationship  be- 
tween tests  and  other  predictors  is  less  than  perfect.  This  means 
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that  theie  exist  individuals  for  whom  a  low  test  score  js  one  of  the 
few  inaicacors  of  a  low  likelihood  of  success-,  and  f°^..^J?J^ 
iiigh.teSt  score  is  one  of  the- few/ndicators  of  a  high  likelihood  ol 

^"if  the  impact  of  tests  on  admissi9ns*  processes  is  reduced,  as  I 
think  it  would  be  with  mandatory  disclosure,  applicants  for  whom 
a  Seh  test  score  is  one  of  the  few  positive  indicators  woald  be  the 
fosers.  in  favor  of  those  who  "can  present- other  positive  indicators 
•but  who  do  not  score. well  on  tests.  .       .   .  „co^ 

But  Is  this  harmful?  Yes,  since  the  other  indicators -w  11  be  used 
regardless  of  the  weight  given  tests,  or  whether  or  not  they  ar? 

"  Thus,1ests  are  providing  additional  infoj-'^^tion,  andMt  is  ax^^^^ 
matic  that  additional  information  cannot  harm,  that  is,  can  only 
Siprove  the  performance  "of  a  selection  prpcess.  Can  it  be  wrong  to 
SiSw  111  segments  of  society  the  full  range  of  opportunities  to  dem- 

°f  should' Hkf  now  to  examine  several  other  provisions  of  H.R. 
1662.  In  section  3(aX3),  relationships  between  "f^v 
^.iiir^Gss  ivould  be  required.  Actually  career  success  rs  not  easily  de- 
fS-  leralone  measured,  and  is  affected  by  choice  among  subspe- 
Sties'offered  at  postbaccali-ureate  institutions,  which  information 
is  not  available  at  the  time  of  application.  •  .    ^  j  •  r 

•  S  are  intended  to  be  predictive  only  of  success  in  studying  for 
a  sAcific  career  and  not  of  success  in  a  career  after  studying  for  it 
Th^efore,  no  test  with  iYi  the  range  of  tfts  specified  in  this  b  11  in 
section  2(aX3).  namely  "admissfons  ai^d  'placement,  attempte  to 
predkt  ca?eer  success^The  onW  role  played  by  the  considered  teste 
inT person's  professional  lifeil  in  selection  for  admission,  and  it. is 

^"s^cLn'Sa^^^^^^^^^  be  determined  to  what^ 

exSnt  tSst'scSes  improve  Prediction  of  grade  i>oint  ave^^^^^^^^ 
and  above  all  other  information  used.  But  the  indicators  used  oy 
various  institutions  differ,  and  with  varying  .success..It  seems  tc.  me 
?hS  if  is  sufficient  that  a  test  producer  convince  a  g'ven  instit^^^^^^^^ 
of  the  value  of  ite  product,  and  I  have  no  objection  to  this  informa- 

*  '"Howe"vlrJulu?yfng'the  use  of  any  element  in  a.  selection  p^cos. . 
-should  be  the  responsibility  of  the  institution  usmg 't.  not  of  the 
sunnlier  of  some  aspect  of  the  procedure.'  No  test  producer  can 
Sk  for  thl  vTried  procedures  used  at  all  institutions  and  surely 
it^cannot  £  the  intention  of  the  bill  to  impose  a  mandatory,  uni- 
form selection  process  on  all  institutions  imnrove-' 

In  the  same  section,  it  is  specified  that  the  extent  ol  improve 
ment  be  expressed  as  a  percentage.  This  is  ambiguous  and  has  been 
Se  source  Ef?ome  abuse  of  statistics.  The  basic  question  is;  A  per- 

"  '"^ThTm^oaTwWely  accepted  measure  of  prediction  accuracy  is  a 
•*sqL^yi:ofrei:?iol(oefffcient  or  s-e  variation  there^^^^^^^^ 
the  use  of  multiple  near  regression  for  prediction,  there  are  iwo 
relevant  sqSlre  correlations:  With  and  without  the  test  as  a  predic- 
tor the  former  being  the  larger.  Test  critics  prefer  to  use  the  dif- 
ference between  thefe,  which  can  be  interpreted  as  a  percentage. 

.  -  Test  supporters  tend  to  divide  the  difference  by  the  square  correla- 


'  tion  without  the^^test,  which  can  also  be  interpretefS  as  a  percent- 
age. ^  ^ 

I  would  Recommend  the  latter  method,  since  it,  reflects  the  ability 
of  the  other  indicators  to  predict  grade  point  average  as  well  as  the 
i^^lue'of  the  test,  itself.  As  a  minimum,  more  specific  direction  i^ 
needed.  However,,!  am. rather  skeptical  of  the  value  of  either^ of 
the^e  indidfe/for  0,  public  untrained  in  statistical  methods. 

Section  o^X4XB)  ^^^Is'i'or  an  examination  of  tlje  relationship  be- 
tween test  score  arid  income  level.  This  invites  interpretation  of^a 
casual  relationship  betweeh  th§se  variables  which  is  basfed.  on  ques- 
^  tionable  assumptions.  Moreover,  such  data  are  available  now  to 
competent  researchers  who  are  skilled  in  its  interpretation. 

Section  3(aX4XC)  would  riequire  an  analysis  of  the  value-of  test 
preparation  course.  Since  in  most  cases  the  tests  we  are^  discussing 
^  n)easure  learned  abilities,  it  is  reasonable  to  expect  that  such  pro- 
grams can  improve  test  scores,  though  available  evidence  indicates 
that  short-term  experiences  do  not  do  so  appreciably.  It  seems  to 
me  that  it  is  more  the  responsibility  of  these  programs  to  advertise 
therpselves  than  it  is  the?  responsibility  of  test  producers  to  do.  so. 
^.  -  Test  preparation  courses  are  the  province  of  numerous  private 
tutors,  schools,  and  even  books,  very  few  of  which  repoi^  to  -  testing 
agenries.  Separation  of  the  effects  of  Ihese  prograrpB  would  be  a 
monumenfal  task,  but  necessa'^y^  for  meaningful  int^fpretation  of 
the  data.  I  should  also  mention  in  passing  that  a  test,  Score,  averse 
iS'  not  suitable  as  the  base  for  a  percentage,  as  calledv  for  in  this 
✓   section.,    6*  v;  ^ 

Section  4(aXlXA)  .would  require  makiifg  public  studies  ^about  or 
using  these  tests*  This  seems  to  me  to  carry  the  potential  of  dis- 
couraging i;esearch  unjess  test  agencies  werje  also  required  to  .pro- 
^  vide  test  data  under  c^ertain  conditions.  This  area  needs  more 
'  thought,  which  should  be  undertalc^n  before  enacting  . a  provision 
^such  as  this  one.  .  * 

I  also  note  that,  while  subject  anonymity  is  guaranteed,  institu- 
tional anonymity  is  not.  This  would  also  tend  to  discourage  valua- 
-^bleresearch.        ,  .  ' 

I  would  like  to  close  by  pointing-out  that  farii  riot  at  all  against 
scrutiny  of  the  testing  industry  by  the  public.  Actually,  I  feel  the 
testing  industry,  as  a  whole,"is  turning'in  a  creditable  performance. 
-  But  I  find  H.R.  1662  to^be,  in  general,  both  harmful  and  misdirect- 
ed. I  would  prefer  to  see,  instead,  inquiry  into  the  uses  of  testS  and 
other  indicators  of  success,  as  well,  mside  by  institutions. 

Many  of  the  suggestions  in  the  Association  for  Measurement  and 
Evaluation  in  Guidance  statement  appended  her-e  are  pointed  in 
this  direction';'  ,  % " 

Thank  you.  ^ 
Mr.  Weiss.  Thank  you.  Dr.  Schafer. 
Dr.  Casteen? 
% 

STATEMENT  OF  JOHN  7.  CASTEEN  III,  DEAN  OF  ADMISSIONS, 
^  UNIVERSITY  OF  VIRGINIA 

Mr.  CASTEEhf.  I  am  John  Casteen,  the  dean  of  admissions  and  as- 
sociate professor  of  English  at  the  University  of  Virginia.' 

ERslC  ,   ^  20<i/  ; 
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I  have  come  today  as  a  representative  ;of  the  Nat^^^^^^^ 
ation  of  College  Admissions  CounseloES,  with  ^missioi^of  sharing 
S  you  a  d^ription  of  a  research  project  and  planned,  national 
forum  on  a,  publication  having  to  do  with  college  admissions  tests 
that  mv  association  will  undertake.  ,  ,  *  j 

T^i^pr^ed  materials  given  to  you  include*  a  Prepared  state- 
ment! which  will  be  a  somewhat  longer  version  as  wg^^,^^^^^^^^ 
our  proposal  and, -finally,  an  appended  article  to  which  1  will  retex 

**^^"r/WEZ' Your  entire  statement  will  be_entered  into  the  record 

'rMr""CASTE3Nr  I  am  a  member  of  the  American  Personnel  and 
6uidancrA^^iation,  American  Association  of  gllegia^^^^^^^ 
trars  and  Admissions  Office,  a  trustee  to  the  College  Board.  Ihe 
NACAC  plan  calls  for  thre^  tests,  and  the  defenses  made  wi  h . 
regard  to  it  as  it  relates  to  the  college  process,  the  college  admis- 
sions orooess.  and  not  other  aspects  of.testing.  . . 

We^nS  fiSt  of  all,  after  having  secured  proper  financial  sup- 
Dort  orobablv  from  foundations,  to  commission  a  group  ot  tour  in- 
SgSive  paplrrhaving  to  do  with  specific  aspects  of  the  contro- 
iSv  abiut  c^lege  admissions  tests.  In  my  prepared  materials  I 
hive  described  thi  likely  contents,  of  these  papers  as  Well  as  like  y 
;Xrl  fo"  «iem  as  a  way  of  indicating  the  scope  ^.nd  the  quality 
ofinvestigation,  . 

»?h'eTr1^hlKt1n1n  ^^^^^^  that  would  ex^ore 
many  of  the  issues  that  have  been  referred  to.  earlier  by  members 
S  this  panl  a  paper  having  to  do  with  admissions  tests  and  the 
admiSioSs  pr?ce'ss!^trying  fo  de«?"be  .with  some  acc  y  t^e 
number  of  different  processes  used  to  indicate  the  rating  given,  an 
fer^trt  credentials  in  the  process  and  experiences  students  and  in- 
stitutions have  had  with  the  process.  „,o+/>v,  ,m 
•  Third  a  oaoer  having  to  do  with  alternative  ways  to  match  up 
students  and  Sieges  a  paper  exploring  specifically  other  kinds  of 
ldmS^fonTLt&m&^^^^  us'ed  ^oVro.ide^^^n^^^^ 
and  comoarative  data  that  we  now  get  from  standardized  tests,  as 
well  S  wivs  to  match  up  students  in  a  larger  sense,  to  ^ee  to  it 
SSl  ?hey  do  not^ncur  the  wasted  experience  that  some  students 

.%'ou^h%*5rpeX^  will  embody  some  re*=o-mendations  to  your 
committee  entitled  "College  Admissions  Tests  and  the  Public  In- 
tS  ''t?yiS  0  define  on  the  basis  of  the  first  three  Papers  what 
in  Sree  terms  ought  to  be  the  Federal  or  congressional  stake  in 
id  egf  admSSons  tests,  arid  what  national  policies  perhaps  includ- 
ing f  document  with  legislation  like*  that  proposed  today  that 

"XftlrTavint'S^^^^  of  those  papers,  the  National 

ACAC  intends^olponsor  a  national  .forum  on  college  •admissions 
Site  and  the  admissions  process  to  invite  representatives  of  the 
r^br  wofeSonal  and  academic  organizations  that  serve  this  area, 
Ssenta?ivrof  t^^  public,  and- we  would  hope,  to  have  repre- 
^Stetfves  of  your  committee  attend  and  take  part  in  a  forum  that 
wm  deHSrate  the  findings  of  the  four  papers,  make  further  recom- 
menSons  that^^^^         sponsor  concerning  revisions  to  be  made 
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to  the  papers  and  forward  a  document  to  be  the  NACAC  report  to 
the  public  in  the  form  of  a  published  book. 

We  envision  having  the  papers  completed  by  early  fall  and 
expect  to  convene  the  conference  in  late  fall  or  early  winter  and 
publish  the  report  as  soon  as  possible  thereafter  with  an  eye 
toward  providing  a  timely  document  for  your  use. 

We  want  to  achieve  what  we  hope  will  be  a  balanced  analysis  of 
the  facts. 

In  my  prepared  statement,  I  said  we  are  apprehensive  that  the 
bulk  ol  the  material  currently  available  to  the  public  and^to  your 
committee  is  political  and  partisan  in  nature,  and  that  the  organi-  * 
zations  have  not  devoted  the^kind  of4ime,  energy,  money,  and  con- 
.  cem  to  the  project  that  we  think  it  deserves,  and  we  intend  to  do 
that.. 

We  want  to  inform  the  admissions  profession  about  the  contro- 
versy in  admissions  testing  and  to  see  to  it  that  our  organization  ^ 
'   had  practitioner^  that  have  the  best  possible  advice. 

Third,  we  do  want  to  pursue  alternative  ways  of  matching  up 
students  and  colleges.  We  believe  oth^r  methods  are  possible.  We 
are  conscious  that  in  Great  Britain  there  is  a  very  different  kind  of 
admissions  test,  the  discursive  test/ that  is  represented  by  level  A 
and  O  examinations  serves  the  system,  and  that"  students  progress 
to  college  in  other  parts  of  the'  world  and,  finally,  we  hope  to  offer 
« reasoned  recommendations  to  the  public  and  to  the  Congress  con- 
cerning the  proper  public  stake  that  exists  in  this  area  of  admis-^ 
sion  to  college. 

In  concluding  this  overview  of  my  prepared  materials,  I  need  to 
express  some  areas  of  personal  concern  that  I  recall  having  first 
expressed  to  your  committee  in  1979  when  I  came  to  you-as^^a— 
teacher  and  dean  to  express  my  personal  concerns  about  legislation 
proposed  to  you  at  that  time. 

Education  s  problems  are  at  this  point  quite  large.  We  have  prob- 
*  lems  of  funding,  serious  problems  of  teacher  morale  and  concerns 
about  the  quality  of  teacher  preparation.  Ample  evidence  that  the 
curriculum  currently  existing  in  high  schools  is  less  than  optimal 
in  its  service  to  our  students,  ample  evidence  that  we  are  less  suc- 
cessful than  we  ought  to  be  in  serving  nonmainstream  students 
with  access  to  higher  education. 

No  serious  critic  of  the  educational  scene  at  this  point  blames 
either  declining  achievement  throughout  the  system  or  the  con- 
tinuing inequity  of  opportunity  and  achievement  that  separates 
nonmainstream,  especially  racial  minority  students,  from  main- 
stream students  or  students  from  relatively  poor  economic  back- 
grounds from  relatively  rich  economic  backpounds  or  what  ap- 
pears to  be  evidence  otf'  the  diminished  overall  effectiveness  of  edu- 
cation during  the  last  15  years  or  so,  the  kind  of  evidence  that 
turns  up  in  the  report  of  the  President's  Commission  on  Foreign 
Language  Study. 

I  am  concerned  to  note  that  while  your  committee  is  deliberating 
standardized  tests,  no  serious  critic  who  has  looked  at  these  prob- 
lems blames  the  test  for  these  conditions.  We  do  have  initiative 
within  education  to  try  to  see  to  it  that  we  face  squarely  some  of 
the  problems  that  have  been  evidence. 
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You  heve  heard  one  described  earlier  by  my  colleague  from  Guil- 
ford County  in  attempting  to  decide  what- schools ;;ought  to  do  1 
have  attached  a  newspaper  article  describing  the  College  Board  s 
Project  Equality,  which  is  one  of  several  efforts-to  address  the  ques- 
tion of  what  goes  on  in  the  academic  courses  that  students  take  in 
high  school,  whether  to  prepare  for  college  or  life  m  general. 

It  seems  to  me  Congress  may  or  may  not  find  sufficient  cause  to 
enact  H.R.  1662  or  analogous  legislation,  but  that  it  ought  to  do  so 
only  in  light  of  a  broader  examination  of  American  schools  and 
schboling  than  has  yet  occurred,  and  m>  concern  in  the  largest 
sense  is  not  so  much  the  presence  of  this  proposed  bill  or  of  earlier 
bills  of  the  same  kind,, as  it  is  the  absence  of  initiatives  undertaken 
by  the  Congress  in  the  direction  of  solving  other  problems  of  which 
I  suspect  the  testing  controversy  is  merely  one  symptom. 

It  seems  to  me  we  need  to  look  into  the  whole  question  of  how 
schooling  works  in  this  country  and  to  separate  the  core  issues 
having  to  do  with  what  students  l^arn  in  schools  from  what  1  see 
as  procedural  issues  having  to  do  with  how  we  measure  and  report 
and  compare  those  results  in  student  to  student. 

Thank  you.  . ,  ,    ^  .      r  n  i 

[The  prepared  statement  of  John  Casteen  tollows:j 
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Prepared  Statement  of  John  T.  Casteen,  III, 
Dean  of  Admissions,  University  of  Virginia 

I  «  John  Casteen,  Associate  Professor  of  English  and  Dean 
of  Adnissions  in  the  University  of  Virginiii.     I  came  to  you  in 
October  1979  to  express  concern  about  what  I  believed  would  be 
the  adverse  effects  of  passage  of  H.R.  3564  and  H.R.  4949  (as 
then  written)  on  education  in  this  country.^  At  that  time-,  I 
spoke  in  my  ^own  behalf  as  a  teacher , and  dean.    Today,  I 
represent  the  National  ^ssociatipn  of  College  Adbiissions 
Counselors  (National  A.C.A.C.) ,  a  professional  association  of 
some  3000  individual  practitioners  of  college  counseling  in 
high  school's,  colleges,  and  other  settings.    My  missions  are  io 
share  with  .you  a  report  on  the  progress  of  the  National 

0 

A.C.A.C.'s  task  force  on  college  admissions  tests  and  to  urge 

c 

you  to  delay  passing  legislation  until  receiving  our  report  on 
tests  and  the  college  admissions  process. 

The  National  A.C.A.C.*s  members  voted  at  our  fall  1980 
meeting  to  call  a  national  forum  on  college  admissions  tests, 
the  admissions  process,  i^nd  other  related  educational  matters, 
and  to  provide  a  report  that  may  serve  you  and  other  lawmakers 
who  take  an  interest  in  the  controversy  about  tests.    To  this 
end,  a  special  task  force  has  produced  a  comprehensive 
description  of  the  project,  and  the  National  A.C.A.C.'s 
Executive  Director  has  begun  seeking  financial  support  for  it. 
I  have  provided  for  the  record  a  copy  of  this  description  as  it 
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now  exists.    Our  plan,  for  the  forufi  are  all  but  complete  at 
this  time,  and  our  leaders  are  working,  to  recruit  the  best 
available  talent  to  write  investigative'' papers  for  our  eventual 
report. 

We  pian  to  cowiission  four  investigative  reports: 
—What  IS  the  Truth  about  Testing? 
—Admissions  Tests  and  the  Admissions  process 
—Alternative  Ways  to  Katch  Up  Students  and  Colleges 
—College  Adaissions  Tests  and  the  Public  Interest 
Each  investigator  will  work  with  an  advisory  committee  to 
develop  a"  suitable  outline  and  to  agree  on  basic  methods  and 
goals.    A  special  National  A.C.A.C.  task  force  will  oversee  the' 
designs^of  all  four  investigative  papers  in  order  to  guarantee 
that  all  relevant  topics  are  covered.    We  exoect  to  receive 
complete  drafts  of  these  four  documents  by  early  fall.    We  can 
provide  draft  copies  for  you  at  that  time. 

in  late  fall  or  early  winter,  depending  on  funding  and  on 
the  progress  of  oux"  focr  papers,  the  National  A.C.A.C.  will 
convene  a  national  forum  on  college  admissions  tests.  The 
formal  description  identifies  likely  participants.    We  hope  to 
persuade  members  of  this  committee  to  take  part  or  to  attend  as 
.observers.  Each  investigator  will  present  his  or  her  draft 
report  to  this  forum,  and  forum  members  will  advise  the 
investigators  and  "their  advisory  committees  on  the  content,  ^ 
methods,  and  conclusions  that  ought  properly  to  appear  in  the 
final  report.    We  expect  to  hold  this  forum  in  the  Washington, 
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D.C.,  area  and  to  attract  participants  who  will  bring 
expertise,  commitment  to  thoughtfiil  deliberation,  and 
credibility  to  it. 

Following  the  forum,  the  National  A.C.A.C.  will  publish  its 
report  on  college  admissions  tests.    This  report  will  include 
the  four  investigative  papers  in>  their  final  forms,  a  suitable 
introduction  and  perhaps  afterword  written  by  the  moderator  of 
the  forpm,  and  any  other  documents  that  may  seem  appropriate 
to  the  National  A.C.A.C's  Executive  Board,    We  will  provide 
copies  of  the  final  report  for  you  and  for  others  interested  in 
the  issue  as  soon  as  possible  after  the  forum.    We  will  offer 
additional  copies  for  sale  to  th^  public  at  cost. 

The  National  A,C,A,C,  has  entered  into  this  project  on'ly 
after  the  most  serious  deliberation.    This  investigation  marks 
a  new  departure  for  us.  Our  previous  endeavors  have  addressed 
the  professional  concerns  of  high  school  counselors  and  colleg^^ 
admissions  officers.    We  have  not  previously  addressed  issues 
of  public,  policy.    At  the  same  time,  our  members  and  leaders 
include  admissions  professionals  and  others  competent  to 
conduct  investigations  in  the  field  and  to  ottet 
recommendations  that  may  prove  useful  to  you.    By  voting  to 
sponsor  this  investigation,  the  members  of  tl^e  National 
A.C.A.C.  committed  themselves  to  collect  the  facts,  to  seek 
conclusions  based  on  the  best  evidence  and  experience 
available,  and  to  share  this  information  with  you  and  with  the 
public.    Everyone  in  education  probably  has  some  opinion  on 


(3) 


2io 


91- HP  0-S2  M 


204 


college  admissions  tests.    We  want  to  get  beyond  opinions, 
whether  outs'  ot  others',  and  to  offer  the  substance  that  has 
so  fat  not  appeared  in  the  controversy  about  admissions  tests. 

When  I~ca««.,to  you  in  1979,  I  spoke  about  my  concerns  about 
the  accountability  of  our  systems  of  education  and  especially 
•y  sense  that  Cof>gress  might  well  enhance  the  quality  of  life 
in  the  U.S.  by  addressing  the  problems  of  our  nation's  schools 
and  colleges.    Since  that  time,  little  has  occurred  to  allay  my 
concerns  about' our  schools.    In  recent  months,  the  Secretary  Sf^ 
Education  has  found  it  necessary  to  speak  out  on  what  he  terms 
the  flabbiness  of  our  public  high  schools.    National  news 
magazines  have  repeatedly  told  us  that  schooling  does  not  work 
as  well  as  it  should  for  many  of  our  children.    James  S. 
Coleman  and  others  have  contributed  to  our  awareness  that  we  ^ 
need  to  recapture  the  excellence  that  our  educational  system 
develbped  (however  briefly)  in  the  years  between  Sputnik  and 
Vietnam.    Virtually  all  commentators  have  ^Old  us  that  we  need 
to  address  the  core  academic  skills— reading ,  writing, 
arithmetic,  foreign  laiiguages  ,"and  the  like.    With  support  from 
the  Ford  Foundation,  the  College  Board  has  begun  an 
investigation  of  college  preparatory  curricula  that  is  (from  my 
personal  perspective)  the  most  exciting  new  development  in 
edftcation  since  the  Conant  Repotjt.     (I  am  providing  a 
description  of  this  project  that  I  wrote  in  May  for  ^he 
Richmond  News  Leader.) 

With  others  in  education,  I  welcome  your  willingness  to 
explore  our  problems  and  to  seek  remedies.    We  look  forward  to 
working  with  you  to  iinder8t£ind  what  problems  exist  and  to  seek 
solutions  that  will  work. 
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July  18,  1981 


Proposal  for  the  National  AssQciation  of 
College  Admissions  Counselors 
Form  on  College  Admissions  Tests 


1,  Background 

In  both  1979  and  1980,  the  National  A.C.A.C.  annual 
^Conference  considered  motions  on  the  controversy  about  college 
admissions  tests.     In  1979,  the  National  A.C.A.C.  elected  not 
to  take  a  stand  in  the  testing  controversy.     In  1980,  the 
National  A.C.A.C.  voted  by  a  substantial  majority  to  take  this 
position. 

Resolved:    That  the  Natiqnal  A.C.A.C.  go  on  record  as 
^ppoaing  passage  of  the  Weiss  Bill  as  presently 
stated,  or  anyjegislation  currently  proposed  to 
regulate  the  design  ot^  us^  of  standardized  tests  in 
the  admissions  proces^s  or  to  regula.te^the  process 
itself;  and  that  National  A.C.A.C*  now  Tssue-^uu^urgei^^ 
call  for  a  national  conference  of  competent 
professionals,  representatives  of  appropriate 
professional  and  academic  organizations,  and 
spokespersons  for  major  test  preparation  companies  to 
provide  a  responsible  public  forum  of  professional 
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counselors'  and  admission.  -oCCicets  from  which  may  come 
creditable  independent  evaluations  of  the  development.,  ' 
construction,  and  use  of  standardized  tests. 
The  effect  of  this  action  is  to  ask  Congress  and  state 
legislatures  to  delay  further  legislation  in  the  areas  of 
admissions  testing  and  the  admissions  process  pending  a 
comprehensive  professional  inquiry  to  be  initiated  by  the 
National  A.C.A.C.    In  a  letter  dated  March  20,  1981,  National 
A.C.A.C.  president  Ann  P.  Fritts  and  Executive  Director  Charles 
A.  Marshall  cawnunicated  the  sense  of  this  resolution  to  the 
Honorable  Carl  D.  Perkins,  Chairman  of  the  Subcommittee  on 
Elementary,  Secondary,  and  Vocational  Education  of  the 
Committee  on  Education  and  Labor  of  the  U.S.  House  of 
Representatives.    Similar  letters  went  to  others  who  have  taken 
.   an  interest  in  ps^llege  admissions  tests. 

The  resolution  does  not  commit  the  National  A.C.A.C.  to  any 
prescribed  position  in  the  controversy  about  tests.    Rather,  it 
commits  the  Natis^^al  A.C.A.C.  to  investigate  the  charges 
currently  made  *ith  regard  to  college  admissions  tests,  the 
predictive  validity  of  the  credentials  used  in  admissions,  and 
the  ad:jissions  process  itself,  and  to  publish  its  findings. 
The  members  of  the  National  A.C.A.C.  believe  that  the  relevant 
facts  about  college  admissions  tests  have  not  been  fully 
examined.    As  a  professional  association  whose  members  deal  on 
a  daily  basis  with 'college  admissions  tests  and  the  admissions 
process,  the  National  A.C.A.C.  feels  responsibility  to 
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undertake  an  appropriate  investigation* 

This  proposal  calls  for  the  National  A.C»A»C»  to  commission 
a  group  of  studies  on  the  Various  elements. of  the  controversy 
abd^  coUege  admissions  tests,  then  convene -a  national  foru« 
of  competent  and  scholarly  professionals  from  relevant 
disciplines  to  conduct  a  full  inquiry  and  publish  its  findings • 

Three  constituencies  stand  to  gain  by  a  properly  prepared 
report:    the  general  public,  whose  confidence  in  the  admissions 
process  may  have  deteriorated  in  recent  years;  admissions 
counselors,  who  look  to  the  National  A.C.A^C^  for  guidance  on 
professional  matters;  and  federal  and  state  legislators,  to 
whom  the  National  A.C.A.C*  ought  to  present  a  thorough, 
competent,^  and  reasonable  explanation  of  the  controversy  about 
admissions  tests.    To  date,  no  balanced  investigation  of  the 
charges  and  responses  has  appeared*    The  controversy  has 
developed  through  a  series  of  partisan,  polemical  documents* 
The  National  A.C*A*C*  believes  that  public  policy  ought  to  be 
grounded  in  more  objective  and  complete  evidence  than  we  now 
have  • 

2.    The  Investigative  Papers 

The  National  A.C.A.C*  inquiry  is  to  move  in  three  stages: 
advance  preparation  of  four  investigative  papers,  each 
addressing  a  discreet  topic  relevant  to  the  controversy  and 
each  prepared  by  a  prominent  investigator  in  an  appropriate 
discipline;  convocation  of  a  national  forum  to  receive  these 
four  papers,  debate  the  issues,  and  propose  revisions; 
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publication*f  the  National  A-C*A-C*  report  on  the  controversy 
about  college  admissions  tests,  this  report  to  include  the  four 
investigative  papers,  any  other  materials  that  may  seem 
sufficiently  important  to  the  National  A.C.A-C*  Executive 
Board,  and  a  general  overview  of  the  ooijtroversy •    The  National 
h.C.h.C.  is  Kby^eeking  foundation  support  for  all  phases  of 
this  project.    The^Executive  Board  believes  that  the 
arrangwnents  can  be  conpleted  by  late  summer  1981*  The^ 
National, A^C^A^C*  -is  now  negotiating  with  persons  qualified  to. 
prepare/the  four  investigative  papers,  "our  goal 'is  to  convene 
the  nati^l  forum  in  late  fall  or  early  winter  1981,  and  to 
'publish  the  National  AX.A.C.  report  as  soon  as  possible  / 
thereafter • 

The  National  A.C.A-C.  will  commission  special  investigative 
papers  on  these  topics: 

—What  Is  the  Truth  about  Testing? 

« 

'     —Admissions  Tests  and  the  Admissions , Process 

—Alternative  Ways  to  Match.Up  Students  and  Colleges 

c     —College  Admissions  Tests  and  the  Public  Interest 
in  each  instance,  the  National  A.C.A.C.  will  seek  an' 
investigator. whose  name  is  known  to  the  community  of  counseling 
and  admissions  professionals,  and  whose  accompl ishments^pr ior 
to  this  project  quIl^S^im  or  her  to  render  advice  useful  to 
Congress  and  to  admissions  professionals. 
•     '"What  is  the  Truth  in  Testing?"  will  be  directed  to  a 
general  audien.ce,  ij;^cluding  the  public,  admissions 
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professionals,  and  federal  and  state  legislators      Topics  to  be 
addressed  include:    What  are  college  admissions  tests  supposed 
to  predict?    What  can  such  tests  determine,  and  what  can  they 
not  determine?    Within  what  limits  can  test  score  reports  be 
said  to  be>  accurate  or'  inaccurate?    How  faithfully  do  the 
makers  of  college  admissions  tests  tell  the  public  and  the 
admissions  prof ession.  the,  facts  about  their  products?    fo  what 
extent  doea  reliable  evidence  suggest  that  admissions 
professionals  use  test  results  properly  or  improperly?  ' 

-   -aAdmissions  Tests  and  the  Admissions  Process"  will  also  be 
directed  to  a  general  audience.    Topics  to  be  addressed  include 
the  variety  of  admissions  systems  used  by  our  colleges  and 
universities  and  the  predictive  value  of  all  ^'commonly  used 
admissions  credentials.    As  the  investigation  may  bring  to 
light  non-traditional  credentials  or  unusual  combinations  of 
credentials  that  can  improve  the  quality  of  admissions 

Q 

decisions,  the  National  A.C.A.C.  investigators  will  describe 
their  findings  so  that  the  public  and  the  admissions  profession 
may  know  about  alternatives  to  current  practices.    With  regard 
to  minority  students,  this  investigation  should  consider 
whether  reliable  evidence^  supports  the  claim  that  admissions 
tests  discriminate  or  support  discrimination.    These  questions 
are  likely  to  matters     What  role  have  college  admissions  tests 
played  in  opening  oc  closing  access  to  higher  education  for 
populations  that  were'excluded  before  the  tests  came  into 
widespread  use?    To  what  extent  have  admissions  professionals 
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used  te«.t  score  reports  properly  or  improperly  in  assessing  the 
credentials  of  non-»«instream  populations?    In  instances  of 
genuine  abuse,  how  can  adaissions  professionals  protect 
applicants  trm  the  use  of  inappropriate  selection  criteria? 

'    •Alternative  Ways  to  Select  Students"  will  be  directed 
primarily  to  a  more  specialized,  professional  audience,  whose 
expertise  in  admissions  will  jrequire  that  the  author:  be  a 
prominent  admissions  professional.    Topics  to  be  addressed 
include  alter niClTves  to  the  college  admissions  tests  currently 
used  {no  tests,  discursive  tests,"  and  so  on),  and  their 
implications  for  education,  alternative  ways  to^fit  colleges  to 
students  and  students  to 'colleges,  and  the  essential  strengths 
and  weaknesses  of  ^curren"^  methods. and  available  alternatives. 

"Admissions  Tests  and  th'e  Public  Interest"  will  be  directed 
to  a  general  audience,  with  special  concern  for  the 
requirements  of  lawmakers.    Topics  to  be  addressed  include  an 
overview  of  the  controversy,  suggestions  for  further  or  related 
research,  and  the  Piiblic  policy  implications  of  college 
admissions  tests  and  the  sundry  processes  by  which  students  , 
progress  from  secondary  to  higher  education. 

The  National  A.C.A.C.  will  designate  advisory  committees 
made  up  of.  admissions  professionals,  academics  in  appropriate 
disciplines,  and  distinguished  citizens  to  referee  these  papers 
as  they  are  produced.    Each  author  w*ll  confer,  with  his  or  her 
advisory  committee  before  beginning  work  and  will  submit  an 
outline  to  the  National  A.C.A.C.  bask  force  charged  with  seeing 
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thafe  the  topics  detailed  above  are  treated  in  Sufficient 

breadth  and  de^-    Each  author  will  submit  a  complete  draft  to 

the  appropriate  committee  of  leferees  iit  eufficiept  time  to 

permit  revision  as  the  author  and  the  committee  of  referees  may 

agree.    The  National  A.C.A.C.  will  provide  .clerical  support^ 

copying  services r  and  reasonable  p&pport  funds  for  orivjinal 

researcJrin  accordance  with  the  principles  of  go6d  practice 

that  appl*y  to  the  research  co«imuhity.  '  ,  ^ 

The  National  A.CA.C.  Executive  Board  envisions  an  initial 

report,  (prior  to  the  national  forum)  of  ca^.  150  pages, 

including  the  four  investigative  papers,  a  suitcble 

introductory  statement  by  the  Executive  Director  of  the  ^ 

National  A,C.A.C.,  and  perhaps  brief  notes  to  be  prepared  by 

« 

the  designated  moderator  of  the  forum.    To  be  produced 
inexpensively  and  as  a  draft,  this  document  will  go  in  advance 
to  forum  participants  and  to  fed^rjl  and  stalEe  legislators  who 
may  request  drafts,  with  notes  indicating  tliat*  the^f inal* 
publication  will^ differ  from  Jthe  pre-publication. 
3.^    The  ri'ational  Forum     «  "  ^  ^ 

In  late  fall  or  early'winter  1981,  the  National  A.C.A.C. 
Executive  Board  will  convene  a  national  forum  to  assist  the 
lnves£igators  and  advisory  committees  in  revising  the  draf.ts  of 
the  investigative^  ^pers  *and  to  debate  the  issues  of  the 
controversy  about  college  adm.issions  tests*.*  Certain  * 
constituencies^  must  be  represented  in  this  forum;  othersj  may  be 
invited  as  they  express  inter-est  in  participating  and  asr  the 
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national  A.C.A.C.  Bt«cutiv«  Board  oo«es  to  bjlieve  that  they 
■ay  contctbute  significantly  to  the  deliberations.  The 
professional  leaderahip  of  the  national  A.C.A.C.,  the  A^sr^can 
Personnel  and  Guidance  Association,  of  national  pyscho-etric 
and  psychological  associations,  and  of  other  acade.ic  or 
prof  essional;,.groups  with  an 'interest  in  college  admissions  • 
tests  will  be  included,  along  with  recognized  individual 
practitioners  In  ad»ission*,.peychc«etric8,  V^A  related  " 
fields.    After  oonsulation  with  the  national  A.C.A.C. 's. 
iCentual  finan'cial  backers,  the  nation*!  A^C.A.C.  Executive 
Board  will)lecide  hqw  to  include  the  College  Board,  the 
Merican  College  Testing  Ccpany,^  the  Educational  Testing 
Servibe,  and  perhaps  other  test  .akers  and  test  sponsors,  as 
well  as  their  .ore  prominent  critics...  Commissioners  of 
■  Education  fro.  states  where  testing  legislation  has  been  an  . 
.   issue  (New  York-,  California,  LouisiVia,  and  so  on)  will  be 
included,  if  they  have  conducted  independent  research  into  the 
validity  of  admissions  tests  or 'the  practicality  of  legislation 
proposed  or  enacted  in  their  states.    Testing's  lay  critics, 
will  be  included  if  they  provide,  academically  sound  ^ 
•   documentation  in  siippport  of  their  published  claims.        \  ^ 

kepresenfcatives  of  other  constituencies,  including  the  U.S. 
Department  of  Education,  the  National  Science  Foundation,  the 
American  Academy  of  Science,  members  of  Congress  concerned  with 
legislation  al^ut  tests,  aAd  i«rhaps  the  National  Education 
-'  Association  and  American  Federation  of  Teachers,  will  be 
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invited  to  take  part. 

In  the  public  interest,  the  National  A.C.A.C.  will  seek  to 

enlist  prominent  particijpant«  fro*  the  lay  public,  including 

citizens  who  haive  not  previous  y  tak<*ii  part  in  the  cojit rover sy 

but  whose  capacity  to  judge  the  evidence  and  to  speak  clearly 

on  it:  is  well  established. 
* 

All  forum  participants  will  be  invited  to  offer  written 
coowents  on  any  aspect  of  the  topic,  with  the  understanding 
that  the  National  A.C.A.C.  Executive  Board  will  exercise  sole 
discretion  in  determining  what  documents  in  addition  to  the 
four  commissioned  papers  ought  to.  appear  in  the  final  National 
A.C*A;C.  report  on  the  controversyabout  college  admissions 
tests.  *  t 

4.  Outcomes 

jhe  National  A.C.A.C.  realizes  that  this  topic  is  a 
volatile  one,  and  that  this  project  may  matter  to  groups 
outside  the  admissions  profession,  including  lawmakers.  The 
National  A.C.A.C.  intends  to  produce  ^  comprehensive  report 
embracing  relevant  issue*!  that  may  present  themselves  in  the 
course       rcccdrch  and  debate,  and  to  share  this  report  as 
widely  as  possible  with  concerned  citizens.    The  National 
A.C.A.C.  realizes  that  testing's  critics  and  friends  will  have 
equal  motives  to  "win"  the  debate;  at  the  same  time,  the 
National  AiC.A.C.  believes  that  its  members,  general  public, 
and  the  nation's  students  deserve  uncommonly  hi gh^  standards  of 
objectivity  and  professional  responsibility.    We  seek  to  offer 


(9) 


9  J. 


214 


a  cewoned  report,  perh.p.  offering  alternative  judgments  of 
the  validity  of  the  evidence  or  the  cog^l^^l^'^.^'^i^"^ 


The  ll.tion.l  A.cTa.C.  wint.  this  report  to  be  the  definitive 
word  on  the  "truth-  in  testing,  as  well  as  a  durable  guide  £or 
the  i««edl«te  future  for  legislators,  students  and  their 
parent,  and  teachers,  and  admissions  professionals.    We  believe 
that  these  persons  have  tj^  right  to  know  what  college 
admission,  tests  are  worth,  how  they  work,  and  what  they  c«. 
and  cannot  do  for  or  to  an  individual  student.    In  addition, 
this  report  will  treat  the  Integrity  of  admissions  credentlml., 
guidelines  of  good  practice  for  admissions  officers,  and 
perhaps  also  for  admissions  test  takers  and  makers,  and 
statement?  of  specific  advice  to  federal  and  state  legislators 
who  must  decide  whether  to  regulate  college  admissions  tests. 
With  the  seriousness  of  these  purposes  in  mind,  the  National 
A.C.A.C.  will  enforce^  throughout  this  ptoject  the  strictest 
standards  of  professional  ethics  and  academic  rigor,  for  itself 
and  for  all  participants. 

prepared  by  John  T.  Casteen,  III 
for  the  National  A.C.A.C. 
Task  Force  on  Admissions  Tests 
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Mr.  Weiss.  Thank  you,  Dr.  Casteen. 
 -  -Mr.-Sjogren?  -  -  /  - 

STATEMENT  OF  CLIFF  SJOGREN,  DIRECTOR  OF  ADMISSIONS, 
UNIVERSITY  OF  MICHIGAN 

Mr  Sjogren.  Mr,  Weiss,  my  name  is  Cliff  Sjogren,  director  of  ad- 
missions at  the  University  of  Michigan,  and  pr^jdent  of  the 
American  Association  of  Ck)llegiate  Registrars  and  Admissions  Utfi- 

C6rs  * 

I  appreciate  this  opportunity  to  testify  on  H.R.  1662. 

My  comments  will  supplement  rather  than  summarize  the  more 
generalized  statement  that  was  submitted  earlier,  and  I  will  speak 
from  the  perspective  as  an  undergraduate  admissions  officer. 

The  University  of  Michigan  is  a  large,  public  supported  universi- 
ty that  practices  a  highly  selective  admissions  policy.  We  are  selec- 
tive because  the  number  of  applications  from  qualified  students  far 
exceeds  the  places  available.  *    .  \  j- 

The  University  of  Michigan  is  also  characterized  by  a  great  di- 
versity in  terms  of  the  racial,  economic,  ethnic,  age,  and  geographi- 
cal composition  of  the  student  population.  . 

AACRAO,  founded  in  1910,  is  an  important  higher  educational 
association  with  over  7,000  members  representing  over  2,000  col- 
'  leges  and  universities.  AACRAO  is  a  member  of  the  ACE  secretar- 

I  would  like  to  mention  that  this  statement  has  been  prepared 
after  I  have  thoroughly^  examined  the  previous  testimony  since 
1979,  both  pro  and  con,  and  I  might  add  I  have  learned  a  great  deal 
*  from  that  examination,  and  my  comments  today  are  going  to  be  di- 
rected toward  those  critical  and  controversial  issues  that  I  saw  as 
important  in  that  earlier  testimony.         .  .      .  ^  t_  -^u 

My  colleagues  at  the  university  and  m  AACRAO  share  with  the 
sponsors  of  H.R.  1662  their  wishes  to  insure  equal  access  for  all 
Americans  to  educational  opportunities  of  high  quality,  As  we 
pursue  that  lofty.goal,  we  are  continually  reminded  of  the  fragile 
nature  of  standard  measurements  of  educational  achievement,  but 
we  will  challenge  any  effort  to  remove  those  evaluative  devices. 

I  will,  therefore,  speak  in  opposition  to  H.R.  1662.  Some  provi- 
sions of  that  proposed  legislation  if  enacted  would  severely  restrict 
our^ability  to  carry  out  our  responsibilities  to  conduct  and  improve 
educational  access  for  the  citizens  of  this  country. 

Specifically,  t  refer  to  sections  3(A)  3  and  4  which  reveal  a  seri- 
ous misunderstanding  on  how  tests  are  actually  used  or  what  ad- 
missions officers  expect  from  them  and  section  5(A)  d)  and  U)  test 
disclosure  provisiohs,  which  will  likely  reduce  test  flexibility  m 
terms  of  the  numbers  and  locations  of  test  sites  would  also  increase 
costs,  and  add  little,  I  feel,  if  any,  benefits  to  consumers  beyond 
those  now  provided  by  the  recently  disclosed  plan  by  ETS  to  dis- 
close test  answers.  *u  * 

At  first  glance  an  admissions  officer  might  assume  inat  n.it. 
1662  is  an  anfitesting  effort  rather  than  a  consumer  interest  pro- 
posal Indeed,  the  catch  phrase  associated  with  this  effort  is  truth 
in  testing,''  which  implies  that  existing  tests  are  untruthful. 

« 
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I  shall  assume  that  H.R.  1662  is  not  an  antitesting  bill  and, dem- 
onstrate, I  hope,  that  consumer  interests  will  best  be  served  by 
properly  used  and  educationally  reliable  standardized  tests. 

As  an  admissions  officer,  I  hope  we  can  preserve  the  educational 
features  of  testing,  however,  because  I  feel  a  few  of  the  provisions 
in  the  proposal  are  counter  to  sound  educational  principles,  my  tes- 
timony will  in  part  be  a  defense  of  currently  practiced  responsible 
*  college  admissions  testing. 

A  key  provision  of  H.R.  1663  is  test  item  and  answer  disclosure. 
If  the  committee  feels  that  such  disclosures  serve  consumer  inter- 
ests, the  recent  actions  taken  by  the  College  Board  and  ETS  in  its 
announced  plans  for  the  1981^82  administration  of  the  Scholastic 
Aptitude  Tests,. should  satisfy  that  provision  of  the  proposal. 

The  College  Board  reports  that  students  taking  the  SAT's  on  five 
testing  dates  will  have  the  opportunity  to  obtain  questions,  the  an- 
swers, and  their  responses  on  test  items.  The  dates  selected  will 
affect  approximately  75  percent  of  all  SAT  takers  in  1981-82.  It  is 
a  responsible  initiative  that  will  allow  the  ETS  to  maintain  test  in- 
tegrity and  important  data  for  test  validity.  There  is  little  evidence, 
however,  that  test  item  and  answer  disclosure  will  "demonstrate" 
the  process. 

The  College  Board  found  that  in  New  York  where  similar  legisla- 
tion was  passed  only  5  percent  of  the  test  takers  requested  the 
service  during  the  first  three  administrations.  Further,  the  average 
median  family  income  of  all  test  takers  was  $24,500,  while  that  re- 
ported by  requesters  was  $32,300. 

Orientals  and  whites  requested  disclosure  at  a  substantially 
higher  rate  than  blacks  and  Puerto  Ricans.  Of  all  students  whp 
took  the  SAT's  during  those  three  administrations  only  2.2  percent 
of  the  Puerto  Ricans  and  only  1.5  percent  of  the  blacks  requested 
test  item,  answer,  and  their  responses  be  made  available  to  them. 

The  best  predictor  of  academic  behavior  is  previous  academic  be- 
havior. Nearly  all  colleges  and  universities  that  employ  selective 
admissions  base  decisions  on  a  complex  and  interrelated  set  of  fac- 
tors that  combine  to  provide  evidence  of  academic  potential  and 
educational  readiness. 

Th^  secondary  school  record,  which  includes 'grades,  class  rank, 
selection  of  courses,  and  the  educatiohal  standard  of  the  high 
school,  provide  the  most  significant  influence  on  admission  deci- 
sions. The  entranqe  test^  in  varying  degrees,  will  also  be  an  impor- 
tant factor  in  many  cases..  Numerous  studies  have  proven  that 
standardized  tests  when  properly  used  significantly  improve  the  ca- 
pability of  predicting  academic  success  in  college. 

The  importance  of  the  test  score  diminishes,  however,  as  consist- 
ency and  quality,  both  at  high  and  low  levels,  are  revealed  in  the 
high  school  record.  It  frequently  occurs  that  a  student  with  border- 
line grades,  or  one  from  an  unaccredited,  rural,  or  innercity  school 
will  demonstrate  very  high  promise  by  scoring  well  on  a  test. 

That  student  would  probably  be  overlooked  if  test  scores  were 
not  a  part  of  the  process.  Admissions  officers  generally  consider 
low  test  scores  as  ambiguous  and  high  scores,  on  reliable  tests,  as 
relatively  free  of  ambiguities.  For  minority  students,  for  poor  stu- 
dents, and  rural  students  coming  out  of  very  small  high  schools, 
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test  scores,-it  has  been  our  experience,  will  tend  to  work  for  those 
students  rather  than  against  those  students.  .  „ 

Reliable  test  data  helps  hold  back  the  negative  influences  of 
grade  inflation.  It  would  be  impossible  for  the  University  of  Michi-^ 
Ian,  for  example,  to  assess  the  quality  of  the  more  than  1,000  high 
schools  from  which  applications  are  received.  Standardized  meas- 
urements are  needed  to -maintain  our  efforts  to  treat  fairly  all  can- 
didates for  admission  and  to  not  rely  solely  on  subjective  teacher 

^^Interestingly,  if  we  were  to  remove  tests  from  the  admissions  de- 
cisio'n,vit  would  be  likely  that  students  coming  out  of  the  preparato- 
rv  schools,  private,  prestigious  schools,  would  have  a  clear  advan- 
tage over  students  coming  out  of  schools  where  counselors  were 
le^  sophisticated;  lower  paid,  and  did  not  have  the  ability  to  ar-  - 
ticulate  thoughts,  on  evaluations  and  the  types  of  commentary  that 
we  typically  get  out  of  the  more  suburban  schools.  .-^ 

The  admissions  process  at  Michigan,  therefore,  depends  on  and  is 
strengthened  by  a  relatively  low  cost,  frequently  administered  ex- 
amination plan  that  will  allow  students  to  demonstrate  their  apti- 
tudes and  achievements  without  coming  to  Ann  Arbor  for  a  locally 
constructed  and  administered  entrance  test.  Standardized  examina- 
tions were  originally  designed  with  that  convenience  for  the  stu- 
dent in  mind.  .  .     j-   i     j  .  :„  *  „„ 

Also,  test  information,  when  properly  displayed  in  an 
institution's  ipreapplication  literature,  will  allow  and  encourage 
students  to  "sSelect  a  college."  One  might  argue  that  the  ultimate  in 
consumerism  is  to  require  institutions  to  display  a  profile  on  which 
are  described  important  institutional  characteristics,  thereby  allow- 
ing self-selection  to  become  the  single  most  significant  factor  in  the 

^'^FlnSlv,  a  few  comments  on  some  things  that  admissions  officers 
agree  tes^  cannot  do.  Generally,  college  entrance  tests  cannot  help 
predict  success  in  a  career.  Tests  are  of  little  value  in  predicting 
academic  achieveinent  beyond  one  year  of  college,  but  for  fresh- 
men, particularly,  that  one  year  is  critical.    ,  .     „  ,  . 

Tests  are  almost  useless  when  used  as  a  sole  criterion  for  admis- 
sion A  recent  AACRAO/College  Board  survey  revealed  that  less  , 
than  2  percent  of  U.S.  higher  educational  institutions  consider  teste 
as  the  Single  most  important  criterion  in  the  selection  process. 
Probably  none  consider  teste  as  the  only  criterion.  ^^^„;r,n 

Teste  should  not,  and  generally  are  r^'^^t'-P'-^tf XiJr 
scores  but  rather  as  ranges  within  which  falls  the  margin  of  err^r. 
Thus,  it  is  unlikely  that  the  occasiop^.  incorrect  answer  that  sur- 
faces will  influence  an  admissions  decilon.  ^f„j„nfc 

Teste  administered  by  companies  that  do  not  provide  studente, 
counselors,  and  admissions  personnel  with  complete  descriptions  as 
generally  described  iaH.R.  1662,  section  3,  with  some  exceptions  in 
SSvislons  section  3A  (3)  and  (4),  should  be  removed  from  the 
market  and  the  companies  responsible  should  be  punished. 

Failure  to  obtain  adftiission  to  a  college  of  first  choice  because  of 
unacceptable  academic  qualifications  will  almost  always  disap- 
pointing to  the  applicant  and  sometimes  traumatic  Dismissal  from 
rcollege  because  of  insufficient  ability  or  preparation  will  almost 
.always  be  traumatic  and  sometimes  tragip. 
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Properly  developed  and  administered  tests  when  fully  understood 
by  the  student  and  admissions  officer  will  greatly  increase  the 
probability  that  the  college  choice  will  be  a  wise  one.  There  have 
been  abuses  in  the  past,  and  there  will  undoubtedly  be  some,  al- 
though fewer,  I  suspect,  in  the  future. 

The  responsible  testing  agencies,  however,  have  responded  quick- 
ly and  positively  to  the  issue  of  test  misuse.  Admissions  personnel 
have  been  increasingly  knowledgeable  on  what  tests  can  and 
cannot  do  and  are  adjusting  their  practices  accordingly.  And  the 
public  attention  that  has  focused  on  this  critical  issue  in  recent 
months  will  likely  flush  out  further  abuse. 

J^ast  experience  has  shown  that  when  well-intentioned  laws  are 
submitted  to  the  regulatory  agencies  for  the  preparation  of  the  im- 
plementation plan,  the  intent  of  Congress  is  frequently  misunder- 
stood or  ignored. 

Traditionally,  education  in-the  United-States  has  been  relatively 
free  of  unnecessary  political  influence.  That  is  a  tradition  which 
must  be  preserved  as  it  has  served  this  country  well. 

We  would  do  well  to  remember  that  at  the  turn  of  the  century 
liberal  and  progressive  thinkers  demanded  that  a  national  testing 
plan  be  devised  to  encourage  college  access  on  the  basis  of  demon- 
strated ability  and  not  as  was  practiced  at  that  time  by  chance  of 
birth  or  attendance  at  the  proper  prep  schools. 
'    Let  us  not  return  to  the  19th  century.  ; 

Thank  you.  ^ 

[The  prepared  statenteht  of  Cliff  Sjogren  follows:] 
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I  SlflllT  THIS  STATEfCffT  FOR  .Tl€  RECORD  FIRST  AS  T^C  DiREaOR  OF  ACfUSSIONS  Al 
T»€  UnVERSlTY  pF  MICHIGAN/  A  LARGE  irtSTITUTiai  OF  HIOCR  LEARNUKi  THAT  CONSISTS  OF 
EIGHT  UOOIGRADOATE  SCHOOLS  ATO  COLLEGES  ATO  TEH  GRADUATE  AMD  PROFESSiaiAL  SCHOOLS.  ^ 
tACH  Or  WHICH  EfnOYS  SEUCFIVE  AND  COMPETITIVE  ADfllSSIQfiS.  • 

!  ALSO  TESTIFY  On'kH^LF  OF  T«  Pt^Him  ASSOClATIWi  OF  COULEGIATE  REGISTRARS 
NO  ADMfS5ia«  0FFICERS  CMCRAO).  A  fWTiaiAL.  JXXhPf^lt  EixJCATIOMAL  ASSOCIATiai 
WHICH  IS  caVOSED  OF  APPROXiAtELY  2.000  ACCREDITED  COLLEGES  A?1D  DIVERSITIES  THAT 
ARE  REPRHSEIfTH)  BY  OVER  7/100  HOIVIDUAL  ^€MBERS  FROI  T>£  FIELD  OF  RECRUlTMBfT/ 
AOIISSIOflS/  REGISTRATlJOfI  WO  RECORDS/  STUDETIT  FIIV>NCIAL  AID/  AND  INSriTUTiaiAL 
ReS£Af«:HAT  mLNDCRGRADUATE/-^^      m  PROFESSiaVU.  LEVELS/    1  CU^REfOLY  SERVE 
AS  PRESIDGIT  OF  THE  ASSOCIATiaip 

tV  coa£AGues  and  I  s^wre  with  t>c  spaisoRS  of  IIR 1662  ticir  basic  philosopk/  - 

OF  PROVIDIHG  EQUAL  AND  T}€  BEST  POSSIBUS  HIGJCR  IXUCATION  OPPORTUHTIES  FOR  AU  OF 
T»€  VOOTH  OF  OUR  HATIONr-AMD  1  MIGHT  AM)  WE  SUPPORT  T^CSE  OPPORTUNITIES 'FOR  ALL  ADULTS 
AS  WELL.   V€  DO  NOT.  SHARE  WITH  T>€  SPOfiSORS  A/O  TIC  PROPONEffTS  OF  THIS  PROPOSED 
LEGISUTION  T>£  T>£SIS  T>ttT  TESTS^ARE  T>C  SOLE  OR  PRIMARY  CRlTERIOrl  FOR  ADfUSSIONS 
TO  HIGICR  FJXCATialf 

Tjc  Executive  CamnEE  of  mm  has  rcviewed  carefuxy  t>€  controversy  ^ 

SUtmSOm  tie  imRPRETATION  Of  ADMISSIONS  TESTS  AS  DISCUSSED  IN  TIE  NADER/NAIRT- 
RUWT/  P.«aTICUU«LY  aiARGES  THAT  ADMISSIOflS  TEST  SCORES  ARE  GROSSLY  MISUSED  AS 
INHIBITORS  KM  UrCERGRADUATE  AEMISSiafi  DECISiaiS.    AACWs  PROFESSIONAL  JOUaWL/ 
mm^^PMmmiO  IS  REPL£TE-Hmi  rW^ROUS  RESEARCH  ARTlCUS  EMPHASIZIIXJ  A 
BAUVJCE  OF  CRITERIA  THAT  SJOUU)  BE  REVIEWED  IN  T>E,ADf>!ISSIOtfi  PROCESS/  E.G./  HIGH 
SCKX>L  G'lADES/  COUNSELORS^ECCMlETOATiaiS/  LEADERSHIP  POTBfTIAL/  INDIC^.TIO^S  OF  UTBn" 
AC^IC  ACHIEVBW  b7C./  AS  WELL  AS.ADMISSiaiS  TEST  SCORES,    ALSO/  T>€SE  JOlKiAL 
'a^TICUS  PARTICUUy^LY  STRESS  T^E  PROPER  INfERPRCTATiai  OF  ADMISSiafi  TESTS  IN  DETERfllNIlNG 
TIE  POTENTIAL  OF  SUCCESS  FOR  MINORITY  A/O  DISADVWfTAGED  STlOEJfTS.   ThE  ASSOCIATION'S 
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R£CEKT  COOPERATIVE  STlDy  ON  ADMlSSlOtiS  POLICIES  Af©  PRAaiCES  \U  THE  1930' S  CLEARLY 
IfCICATES  THAT  ADMISSIONS  TEST  SCORES  ARE  USED  IN  ISOLATION  ONLY  IN  A  REUTIVELY 
SWLL  NUffiER  OF  INSTITUflOHS. 

Trt  /WM)  ExECin-IVE  CorWITTEE  reviewed  A  PAPER  PREPARED  BY  A  SUB-CaillTTEE  OP 
ITS  PROFESSiaiAL  CatJITTEE  ON  UNDERGRADUATE  ADMlSSIOTiS.    MCRAO  BiDORSES  THIS  STATEMENT 
AS  IfCICATIVE  OF  TfC  ASSOCIATION'S  PERSPeaiVt  Otl  T>C  CO^f^ROV£RSY  ABOUT  AMISSIONS 
TESTING  M€  T>C,USE  OF  TESTS^  IN  T>C  ADMISSIONS  PROCESS. 

A  CURRENT  PERSPEaiVE  CN  STAM)WC12ED  TESTING  IN  ITCERGRADWTE  ADMISSIONS 
AN  AACRAO  POSITION  PAPER  PREPARED  BY  A  SUBCOIIITTEE  OF  WE 
COrrilTTEE  CN  UCEfiCmXJATH  AOIISSIONS 

As  ACRICAN  HIG^CR  EDUCATION  ms  MATURED.  IT  HAS  BECOME  MARKED  BY  INCREASIMaY 
DIVERSE  MODELS  OF  HiSTITUriONAL  PIFPOSE.  OF  GOVER^JANCe>  MD  OF  ACCESS  BY  STl/DENTS. 
Paws  T>C  EVIDENCE  OF  THESE  TREMK  MOST  ViSIBti  TODAY  IS  A  GEf^ERATiaj  OF  STUEk'ilfTS  VW 
ARE.  MORE  DISSIMILAR  TO  EACH  OT>€R  SOCIALLY^  ECONailCAUiY>  AT©  I^fTELL£CrUA^LY  THAN  m 
WHICH  mS  PRECEDED,    ThIS  DIVERSITY  REFLEas  A  BROAD  SPECTRUM  OF  AailSSlWiS  PRACTICES 
>«ICH  RANGL  FRai  SKimiNG  ONLY  A  SMALL  FRAH-ION  FROM  A  HIGHLY  QUALIFIED  APPLICANT  POOL 
TO  ACMmiNG  ANYONE  PAST  A  GIVEN  AGE  OR  WITH  ANY  KIlO  OF  EDUCATIONAL  HISTORY. 

Few  OF  /VCRICA'S  NEAUY  twee  thousand  colleges  HAVE  AailSSJOf^S  POLICIES  IVHICH  ARE 
EXACTLY  ALIKE.   BY  MC.IARGE,  T>CS£  DIFFERENCES  ARE  NOT  ARBITRARY^  SIMPLISTIC.  OR 
CAPRICIOUS.  BUT  UCEED  REFLEa  REASONED  CONSTRAUffS  BASED  ttJ  RESOURCES  AVAILABLE. 
PHILOSOPHIES  OF  INSTRUCTION.  QUALITY  AT©  MISSION  OF  T>C  RcSPEaiVE  FACU.TY.  A^O 
COftllTMEffTS  TO  VARIOUS  CONSTITUE/JCIES.    JUSTAS  T)CSS  C0(  IS  I  DERATIONS  ARE  DIVERSE.  SO 
IS  TIC  DESIRED  MIX  OF  STUDENT  AHRIBUTES  WHICH  T}C  MWiY  COU^GES  PURSl£.  ATO  [POti 
WHICH  ADMISSIONS  DECISIOMS  ARE  JUSTIFIED, 

TVPICAaY.  SELEaiVE  ADMISSION  IS  BASED  ON  A  COMPLEX  AT©  INTERREUTED  SET  OF 
FAaoes  WHICH  CO^HJE  TO  PROVIDE  CONVINCING  EVIDEfiCE  OF  ACADEMIC  PROMISE  AfO  EDUCATiaiAL 
READINESS.  ALTHOUGH  COLLEGES  WITH  SPECIAL  PURPOSES TAY  ALSO  VALl£  SUCH  OTf£R  QUALITIES 
AS  RELIGIOUS  COfMaiON.  INTERESTS.  AND  CHARAaER  TRAITS,    THE  BEST  PREDICTOR  OF 
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toxeilC  BCH^VIOR  UX«  HAS  BEEN  ACWO^D  AS  PREVIOUS  ACADEMIC  BEWVIM.  USUALLY 
THIS  Ca«ISTS  OF  PERFKm^  ABSTRACTED  FRC«  T>€  HIGH  SCHOOL  RECORD,  I«TABLV  V€  .Wl«E 
OF.COURSES  TAKEN,  GRADES  RECEIVED,  A«  RANK  k       GRADUATING  CLASS,  , 

,  rtoCWLESS,  AS  STRONG  A  PREDiaOR  OF  SUCCESS  AS  V€  SECOMJARY-RECOgD  IS,  IT  IS 
FM  FRCM  PERFEa.  QUALITATIVE  DIFFERENCES  >«0N6  HIGH  SCHOOl^  ACROSS^TK  NATION,  YEAR 
TO  YEAR  FLUCTUATIONS  AfCNG  GRADUATING  CLASSES  WITHIN  SCXtiS,  V^IONS  IN  GRADIIB 
ffiAaiCES  /WONG  TEAC«RS  A»  SCHOOLS,  HO  twm>  INCONSIS^E^«:IES^^m^IN  A  STUfiff'S 
m  RECOa)  ALL  HAVE  BORNE  OUn«  ICEd'fOR'A  SECOND  MEASUIING  DEVICE  VWICH  CWARHS  T« 
ACADEMIC  ATIRIBUIES  OF  IICIVIDUAL  CAfDInATES  WITH  TK)SE  OF  A  f^ATIONAL  C0li£GE-B0UO 
TOPXATION  SPAmiNG  MANY  YEARS. 

■        tollNISTRATORS  CWRGE6  WITH  IWCIMG  RESPONSIBU  ADMISSIONS  DECISIONS  LDHG  HA'/S 
WELCCKD  T>£  EQUALIZING  INFLUENCE  TWT  TESTS  WITH  WELL  ESTAELISrtO)  PROPERTIES  OF  . 
STABILITY  AM)  PREDiaiVEf€SS  ADD  TO  T«  USE  OF  T«  SECONDARY  RECORD  HSXE.   'iMlS.  Tie  . 
.    „«KWOTr  THAT  STANWRDIZED  TESTS  LEfC.TO  T>£  PREDiaiON  OF  FIRST  YEAR  PERFORIW^  IS 
NOT  ALWAYS  U«GE,  IT  CONSISTENTLY  AH)  SIGNIFICAfTTLY  ENHANCES  T>£  PROBABILITY  THAT  AT 
LEAST  ^  EARLY  PHASE  OF  T>£  APPLICANT'S  ACADEMIC  CAREER  WILL  BE  A  SUCCESSFU.  O.C. 

(N  PREDiaiie  PERFOfWUCE,  CBLUEGES  MAY  CO^UE  SUttD  OR  AVERAGED  SCORES  FROM 
WHATEVER  BATTERY  OF  TESTS-IS  AVAIum  ^11™  PREVIOUS  GRADES,  *,  Hf£H  PREDiaiON  IS- 
MWE  SOPHISTICATED  OK  SPECIALIZED,  GIVE  ADDITIONAL  WEIGHTING  TO  CERTAIN  SCORES  OR 
S»SCOR£S.-  6miU«LY,  A  WMR  OF  SUCH  SO^ES  m  BE  VIEWED  AS  A  PROFILE  OF  IIDIVIDUAL 
ABILITIES,  ««RE  REWTIVE  STRa«THS  NAY  BE  EVEN  MORE  REVEALING  m  I€LPFU.  TO  T>£ 
Sn«Hr  IN  ARISING,  Pl>CE«Nr,  m  GRA/^ING  credit  -  equally  IMPORTANT  DlANSiaS  OF 

TJ£  ADMISSIONS  FUHaiONS. 

STAfDARDIZED  TESTS  ALSO  ARE  INSTRl^ENTAL  IN  T>£  STU)EMr'S  CHOICE  OF  A  COLLEGE  - 
A  IMWilC  WHICH  IS  FAR  WE  TOTENT  IN  NATIONAL  EhROLUtNT  PAHEHNS  THMI  IS  THAT  0= 
COLUGES  CfCOSING  STUDENTS.    TYPICALLY,  T>€  PROSPEaiVE  STICENT  CONFRONTS  A  NU«ER  OF 
PofEHTIAL  INSTITUTIONS,  NARRWS  TT€SE  TO  T>£  ONES  TO  V«ICH  APPLICATIO.-  IS  me,  VfSi 
OOOSES  Af««  TK)SE  WHICH  E)CTEND  T>€  OFFER  OF  AB1ISS10H. "  Tl€  IKTERPRETATIO.K  V«ICH 
STUJENTS  m  T>£IR  AWISORS  AHACH  TO  ItOIVIDUAL  SCORES  WITHIN  T>£  CONIEjaS  OF  PREDIHED 
SUCCESS  IN  TIC  PROSPECTIVE  COLLEGES  ARE  VITAL  ELEMENTS  AT  EACH  STAGE  OF  T>£  DECISION- 

3  ■  . 
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PROCESS.    MOReOVER.  THE  EFFEaiVEICSS  WITH  WHICH  PROSPECTIVE  STUDENTS  CAN  COMfVilCATE 
WITH  A  HU*ER  OF  iriSTITUTIOriS  IWDER  COtlSIDERATlai  IS  GREATLY  FACILITATED  BY  TfC  NATia4AL 
.TESTING  fWGRA^6,  WHO  DISSEMINATE  AT  VERY  REASOfUBLE  COST  TO  THE  STUDENT  NOT  ttJLY  TEST 
DATA^WHICH  IS  NATIONAtLY  CO^FARABLE  *0  READILY  INTERPRETED/  BUT  A  BODY  OF  PERSONAL  AND 
ACADEMIC  INFORMATION  ALSO  COLLECTED  DURING  THE  TESt'InG  PROCESS, 

Were  t«s£  services  not  available/  coli£GEs  Afi)  studd^ts  alike  would  face  prohibitive 

COSTS  of  C0HiUNICATIN6  IWIVIDUALLY  WITH  A  LARGE  MmR  OF  INSTITUTIONS/  SU»1iniNG 
SETS  OF  INFORMATION  UNIQUE  TO  EACH/  M€>  SIHING  FOR  A  NMER  OF  LOCAL  EXAMINATIOfIS  WHICH 
CAN  EVALUATE  APPLICANTS  OflLY  WITHIN  A  LIMITED  CONTEXT.   OUT  OF  COST  AND  INCONVENIENCE 
ALONE/  OPTIONS  FOR  STXJDCITS  WOULD  SEVERELY  BE"CURTAIL£D  -  AN  INTOLERABU  SETBACK  TO 
FREEDOM  OF  CHOICE  AfC  DEMOCRATIZATION  OF  ACCESS,   AT©  WERE  T>€R£  NOT  AVAILABLE  THIS 
FCANS  OF  DISTRIBUTING  TO  A  NlWBER  OF  COH£GES  SUCH  INFORMATION  RELEVANT  TO  PREDICiH) 
/CADQilC  PERFORMANCE  Aft)  THE  DESIRED  CAMPOS  MIX/  T>CY/  TOO/  WXU)  FI^D  Tl£IR  FREEDOM 

OF  CHOICE*  TO. Search  for/'to  attract/  aw  to  serVj  students  similarly  constrained, 

PERHAPS  THE  most  COffVlNCING  EVIDENCE  OF  THE  VALUE  OF  THIS'SERVICE  HAS  BEEN  T>€ 
opportunities  for  minority  AM)  OTtCR  DISADVANTAGED  STUDENTS  WHICH  HAV^  INCREASED 
COINCIDENTLY  vilTH  TtfIR  PARTICIPATION  IN  THE  ADMISSIONS  TESTING  PROGRAMS* 

.  So  THAT  THE  USE  AND  UMDERSTATOING  QF  ADMISSIONS  TEST  INFORMATION  MIGHT  CONTINUALLY 
K  ErtWCED/  THE  TEST  PUm.ISHERS.ADVOCATE  THAT  COLLEGES  SYSTEMATICALLY  EVALUATE  T>C 
PREDICTIVE  VALIDITY  OF  THE  FACTORS  E/CH  USES  IN  THE  SELECTION  OF  STUDENTS.  CONSEQUENTLY/ 
THE  RELATlW  WEIGHTING  OF  GRADEsl  SCORES/  AM)  OTHER  '€ASURABLE  QUALITIES  CAN  BE  AWUSTED 
EWRIfALLY  TO  CHAN6ES  IN  THE  SOCIAL  AM)  EDUCATIONAL  MILIEU^  AS  WELL  AS  TO  CHANGES  IN 
THE  COLLEGES'  OWN  AIMS.    SO  LONG  AS  W  H!G^€R  RESTITUTIONS  CAN  DEMONSTRATE  TO  THEIR 
OWN  ttTISFACTION  TmT  WHATEVER  DEVICES  T>CY  EMPLOY  BRING  ABOUT  THE  MOST  EFFECTIVE  MATCH 
/^UNMTUDENT  ABILITIES/  ACADEMIC  SUCCESS/  AND  THE  EDUCATIONAL  RESOURCES  AVAILABLE/ 
ACWD  AFFIIWS  TWT  THE  USE  OF  STAfWWIZED  TESTS  IS  A  LEGITIMATE  AM)  VALUABLE 
dOVWCNT  IN  THE  EVALUATION  AM)  SEUCTION  OF  UM)ERGRADUATE  STICEMTS, 

It  IS  NOT  W  UCOftON  TENDENCY  FOR  THE  lAtim  TO  MISTRUST  A  TEOfDlOGY  WHICH  JC  OR 
SfC^DOES  NOT  FUUY  UTCERSTAII)/  AM)  TO  CASTIGATE  IT  IN  T»£  EVENT  OF  ACCIDENTAL  OR^INTBJDED 
MISUSE.   BUT  A  PROPERLY  REFINED  TECrtOLDGY  IS  BLAMELESS:  IT  IS  PEOPLE  WHO  USE  TESTS/ 
Ml)  WHOSE  PROFESSIONAL  AOfCN  MUST  BE  ADEQUATE  TO  THE  STRENGTHS  AM)  LIMITATION* OF 
THE  TOOLS  T>Cy  EmjOY.         IT  IS  THE  EDUCATED  JUDGfCNTS/  HUWC  AM)  SCIENTIFIC/  ON 

rye  rm  of  those  who  match  students  with  institutions  vhich  will  continue  to  improve 

EDUCATIONAL  OfPORTlHITIES  FOR  Aa  WHO  SEEK  T)€M, 
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Mr.  Weiss.  Thank  you,  Dr.  Sjogren. 

Dr.  Robinson?  '  / 

STATEMENT  OF  SHARON  ROBINSON,  DIRECTOR,  INSTRUCTION 
AND  PROFESSIONAL  DEVELOPMENT,  NATIONAL  EDUCATE?. 
ASSOCIATION    .  0 

■  .»  Ms  Robinson.  I  am  Sharon  Robinson,  director  of  instruction  and 

■  ^professional  development  for  the  National  Education  Association.  ' 

I  am  pleased  to  testify  today  on  behalf  of  the  NEA  and  in  sup- 

•  port  of  H:R.  1662,  the  Educational  Testing  Act  of  1981. 

Before  I  get  into  the  remarks  that  I  would  like  to  share  with  the. 
panel  this  morning,  let  me  take  an,.opportunity  to  perhaps  clear  up 
a  common  misunderstanding.      .  ,     -      ^  ' 

■  I  would  like  to  share  with  you  the  NEA  resolution  on  testing. 

The  National  Education  Association  recogni^ses,  that  testing  of 
'students  preschool  through  job  entry  may  be  appropriate  for  such 
.    purposes  as  identifying  learning  needs,  recommending  instruc; 
tional  activities,  apd  describing  opportunity  progress.  , 

The  association  opposes  the  use  of  tests  that  deny  students  tuH 
access  to  equal  educational  opportunities  or  that  are  used  to  evalu- 

^^The^aswdation  believes  that  standardized  tests  should  not  be  ad- 
ministered/when they  are  potentially  damaging  to  students  self- 
'  concept,  biks,  used  as  the  only  criterion  for  student  placement,  in- 
valid, unr^able,  or  out-of-date,  used  as  a  basis  for  the  allocation  of 
Federal,  State,  or  lodal  funds,  used  by  testing  companies  or  publish- 
ers to  prSiote  their  own  financial  interest  a^the  expense  of  sound 
educatioi^al  uses,  used  to  compare  individual  schools,  used  in  an  ex- 
ploitive rhanner  by  the  media,  used  as  the  sole  criterion  for  gradua- 
tion or  Promotion,  and  appropriate  for  the  use  intended,  and  last, 
used  as  i  criterion  for  the  development  of,a  State  system  of  classifi- 
cation of  schools  and/or  school  systems..  ^,  .     I  nr„ 

Clearly,  the  NEA  has  recognized  that  tests  have  their  place.  We 
do  not  dispute  that  testing  h?w  value,  and  that  through  testing  we 
are  aidfd  in  making  some  very  difficult  discriminating  choices  by 
students  and  by  educators.  . .  , 

But  too  often  test  scores  result  in  an  assumptive  pronouncement 
about  itudents,  about  schools,  and  about  educators.  Such  a  pro- 

•  nounc/ment  is  based  solely  on  those  scores  as  it  often  is  likely  to  be 
invalid  cmd  incorrect.  .  . 

Cleatly,  the  measure  of  accountability,  some  measure  of  account- 
abilitj  for  the  testing  induLry  and  for  the  uses  of  teste  is  long 
overdie.  NEA  research  confirms  that  test  usage  [standardized  test 
usacel  is  pervasive  throughout  this  countrv,  and  a  recent  survey  in 
1980  of  various  school  systems,  the  sample  reported  81  percent  of 
the  school  districte  are  using  some  form  of  group-administered 
standardized  intelligence  teste.  u-  * 

Usage  of  some  group-administered  standardized  achievement  test 
was  reported  by  99  percent  of  the  sample.  Ninety-five  of  those  dis- 
'  tricte  reported  using  group-administered,  standardized,  reading- 
readiness  teste;  91  percent  of  those  districte  ^J'^'^^^^^'^^'^l^ 
aptitude  teste,  and  89  percent  used  some  forrrt  of  group-adminis- 
tered  standardized  interest  teste. 
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^  I  will  supply  a  written  copy  of  this  report  to  the  reporter  for  the 

Mr/WEiM/Wlt|iourobj6ctioft,  that  will  be  entered. 
[The  information  referred  to  follows:]  « 
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Survey  of  School 
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NEA  Research  Memo     "  September  1980 

SURVEY  OF  SCHOOL  PROGRAMS  AND  rRACTICES-l9M 

This  1910  survey  of  school  $yslcms  rcfardingsomc  oflhcir  progrims  ind  practi^w^sscnt  to 
805  school  systems.  The  school  systems' were  selected  to  be  representatunjr^thc^ipprox.* 
malely  1 1  600  public  school  systems  in  the  United  States  with  300  or  more  students.  Exactly 
506  uMblp  questionnaires  were  reiuriied  for  a  «.|  percent  response.  The  stindard  error  Tor 
population  est!  males  is  5  percent  or  less  and  for  estimating  popuUtion  differences  is  (0  percent 
or  more.    »  \ 

Each  topical  area  includes  highlights  of  the  responses  |)!us  a  more  detailed  analysis  of  each 
question  ^y  rr.gi:>n  and  by  size  of  school  system.  The  topical  areas  arc  as  follows: 

Numbers  of  students  and  teachers 
School  organisation  patterns 
^Curriculum^^^,^  . 

Instruction  ip,siw:tal  areas  ■  ^ 
Student  evaluation 

Student  discipline  -        .        ,  ^ 

Finanang  '  * 

*  Censorship  ^  , 
Handicapped  students 

*  Professional  development .  ,  .  ^ 
Tea<Jhcr  evahiation                     *  v 
s<Discrimination 

Specialists  ^  *  * 

The  states  comprising  each  region  are  as  follows: 

Northeasr  Connecticut.  DcUware-,  District  of  Columbia.  Maine,  Maryland.  Massachusetts. 

Nciv  Hampshire.  New  Jersey.  Pennsylvania.' Rhodelsland.  and  Vermont. 

Southeast:  Alabama.  Arkansas.  Florida.  Georgia.  Kentucky.  Louisiana.  Mississippi.  North 

Carolina.  South  Carolina.  Tennessee.  Virginia,  and  West  Virginia. 

Middle:  lllinoU.  Indiana.  Iowa.  Kansas.  Michigan.  Minr»esota.  Missouri.  Nebraska.  North 

Dakota.  Ohio.  South  Dakota,  and  Wisconsin. 

West'  Alaska.  Arizona.  California.  Colorado.  Hawaii.  Idaho.  Montana.  Nevada.  New  Mex- 
ico. Oklahoma.  Oregon.  Texas.  Utah.  Washington,  and  Wyoming 

School  sy«cms  by  stratum  are  Small:  300-2.999  students;  Medium.  3.000  to  24.999  students; 
Lartf:  25.000  or  more  students. 
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SumUnotSytdenu/Ttmthtn 

•  School  systems  in  the  Southeastern  and  Western  regions  are  leneratly  larger  than 
Khooi  systems  in  the  Nonheastern  and  Middle  regions— in  fact,  more  than  twice  as 
large  on  the  average. 

•  Almost  two-thirds  (66  percekt)  reported  that  student  enrollments  have  decreased 
over- the  past  three  years  ie..  since  1976-77).  More  school  systems  in  the 
Northeastern  and  Middle  regions  reponed  a  decrease  than  d  id^hool  systems  in  the 
Soatheastern  and  Western  regions. 

•  "becreaws  in  the  number  of  teachers  (reported  by  41  percent)  were  accomplished 
primarily  by  normal  attrition  (Si  percent)  rather  than  by  reduction  in  force  (iO 
percent).  »  ^ 

•  About  half  feh  that  the  number  ofstuoents  (52  percont)and  number  of  teachers(48 
percent)  should  decrease  within  the  next  three  years  (i.e.,  by  1982-83).  Only  abou^ 
one*sixth  (17. percent)  felt  the  number  of  students  and  teachers  should  increase. 
Northeastern  and  large  school  systems;  were  more  likely  to  think  that  the  number  of 
both  students  and  teachers  would  decrease  in  the  next  three  years. 


NUMBERS  OP  STUDENTS/TEACHERi) 


Region  Stratum 

300-   3.000-  25.000* 

Qucsiion  Tolal  Northeast   Southeast   Middle  W«i  2.999  24.999  .or  more 


Whai  was  the  total  number  o'trachers  in 
your  school  system  as  of  Octot^r  1979? 
(Percent  responding) 


Elementary  (lC-6): 


  16 

12 

6 

20 

15 

48 

0 

0 

12 

4 

9 

1 

27 

0 

0 

27 

14 

16 

17 

23 

23 

0 

29 

22 

14 

9 

2 

42 

0 

9 

14 

13 

'16 

0 

29 

6 

3 

1 

13 

17 

0 

2 

40 

5 

34 

14 

19 

.0 

3 

55 

221 

1,531 

439 

1.114 

44 

213 

2.102 

91 

247 

121 

22t 

31 

149 

1.039 

Secondary  (7-12): 

1 

S 

20 

16 

46 

0 

0 

IS 

S 

10 

II 

2t 

3 

0 

17 

13 

16 

13 

23 

18 

0 

33 

24 

15 

10 

1 

44 

14 

11 

12 

13 

1 

27 

6 

 13 

6 

15 

13 

21 

0 

5 

4g 

.  7 

27 

12 

16 

0 

3 

45 

211 

1.117 

414 

179 

41 

289 

1,751 

116 

216 

121 

205 

34 

150 

941 
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NUMiEHS  OF  STUnENTS/TEACHERS-HCONTlNUEO) 


Question 


Region 


SUalum 


Total  NonhcaJi    Soulh<asi    Middle  \yc>i 


300-  3.000-  25.000- 
2.999  24.999  or  more 


Please  |«vc  the  October  1979  ENROLL- 
MENTS  requested   below^    Do  n6t  s 
include  enrollment  in  adult  education 
and  junior  college/ 

a.  Nursery  and  prekindergarten  * 

Percent  responding   27  23 

Mean   391  105 

Median   86  44 

b.  Kindergarten  and  prefirst  grade 

Percent  responding*.   90  90 

Mean   M33  540 

Median   312  215 

c  Elementar)'  (i>6) 

Percent  responding   94  93 

Mean  -   8.646  3.568 

Median    2,100  L600 

d.  Secondary  (7.|  2) 

Percent  responding   95  93 

.Mean   <-«8 

,  '  Median....,   2.241  L800 

To  what  extent  have  student  enrollment 
and  number  ofteachers  changed  in  your 
school  $>'4tem  over  the  past  thrct  ytars 
(since  the  1976-77  Jchool  >eaf )? (Perftyit 
responding.) 

a.  ^tudent  enrollment 

Increased  «  »         '6  9 

Median  percent  of  Increase  i..          8  6 

^  ilUan.il:,  m.  tVyv  >9  17 

Decreased                                  66  74 

Median  percent  of  decrease  .•          9  8 

b.  Number  of  teachers 

^  Increased   "    25>  14 

Median  percent  of  increase  .  7  7 

Relatively  no  change   34  31 

^Decreased   ^ 

Median  percent  of  decrease.!  6  5 

Generally,  how  has  any  decrease  in  ihe 
number  ofteachers  occurred,— "by  normal 
attnlion  or  by  "reduction  in  force*?  (Per- 
cent responding.)      ,  . 

Numbers  have  NOT  decreased   4g  35 

All  by  normal  attrition.  .   32  27 


24 
523 
192 

96 
2.485 
'  623 

96 
15.709 
4.472 

98 
15.970 
4.082 


12 

29 


24 

2S0 
82 

93 
970 
264 

97 
6.690 
1.734 


1.750 


32 

10 

30 

44 

743 

33 

69 

832 

90 

15 

41 

303 

86 

85 

90 

97 

2.303 

SI 

442 

4.299 

616 

62 

331 

2,689 

81 

89 

95 

97 

1.901 

551 

3.073 

26.220 

4,231 

437 
• 

2,395 

17.55i 

95 

89 

^98 

99 

11.560 

565 

3,356 

26.247 

4.429 

416 

2.354 

17.909 

10 

3^ 
7 
34 
30 
10 


60 
24 


t 

7 
18 


17 

6 

40 
43 

7 


30  20*  15 
10  10  7 
15  26 


H  53—55- 

II         7  9 


34  25 


34  47 
32  21 


41        57    63  44 

39        27    22  29 


34 
47 
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NUMBERS  OF  STUDENTS/TEACHERSHCONTINUED) 


Qucsiion 


Rcfton 


,Toial  Noriheait   SoulKcast  Middle 


300-  3.000-  25.000- 
We$t  2.999  24,999  or  more 


About  IhreC'rourihs  by 

normal  allrition   

About  halF^  by  atintion  and 

about  half  by  "reduction- 

tn  force"  

About  three-fourths  by 

"reduction  tn  force**  «... 

All  by  "redaction  in  force"  

How  do<$  your  school  system  estimate 
that  student  enroUnMnt  and  numbers  of 
teachers  will  change  in  the  n^xl  three 
years  (by  the  1912-13  school  year)?  (Per- 
cent responding) 

a.  Student  enrollment 


3 
"2 


'236 


17 

8 

14 

12 

31 

23 

18 

10 

Should  remain  relatively  • 

31 

28 

35 

37 

23 

41 

28 

22 

52 

65 

51 

52 

46 

36 

54 

♦  68- 

b.  Number  of  leadiers 

17 

7  • 

18 

10 

29 

20 

18 

11 

Should  remain  relatively 

36 

30 

42 

40 

29 

48 

29 

31 

4S 

63 

41 

50 

43 

32 

54 

58 
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Sdiool  Orfaniulioii  Ptttcrm 

.     .     Oncfourih  (25  perccnl)  of  the  school  $>«cm$  reported  a  6-^3  ^^^^ool^orgamz^^^^^^ 
for  fra<!cs  I  through  12.  5.>4  and  6-2.4  orpnizations  were  reported  by  «bout 

•  one^iixth  (15  and  19  perccnl,  respectively). 

♦  The  5-3-4  and  6-3-3  organizations  were  most  common  in  the  Northeastern  region, 
and  lhc6.3-3  organization  most  common  in  the  Southe^tern  region,  and  the  6-2-4 
oJ  6-3-3  organizVlion  most  common  in  the  Middle  and  Western  regiorts. 

Thc^rger  school  systems  were  more  likely  to  have  a  6-3-3  or^nizalion.  with  a 

wJ"eVe1y  to  have  a  6-6  organization,  with  a  significant  number  havmga 
6-2-4  or  8-4  organization* 


SCHOOL  ORGANIZATION  PATTER^IS 

Region 

Stratum 

300- 

3.00O-  25.000- 

Question 

Total  Northeast   Southeast  Middle 

West  2.999 

24,999  or  more  ^ 

What  type  of  SCHOOL  ORGANIZA- 
TION  by  Vide  (not  including  Icinder- 
fiftcn)  is  the  most  fieneral  practice  tn 
your  school  system? 

3.»3.r.   ..'     ~  [ 

»6  -  •  .  I 

4-  1-4   ^ 

5-  3-4    1^ 

 ::::::::::: 

tr!.::::::;::::::::..:   ' 

Other  


3 
I 
S 

23 
13 
18 
II 
I 

4 

20 


1 
I 
4 

IS 

9 
33 
10 
5 
6 
12 


1 

1 

1 

1 

2 

0 
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1 

0 
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4 

11 

6 

2 

16 

1$ 

8 

16' 

23 

20 

21 

16 

22 

17 
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26 

8 

30 

12 

3 

22 

'  4 
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1 

I 
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3 

13 

S 

16 
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5 

9 

20 

16 

15 

II 
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TIm  Cwricvlirai 

•  A  nuijofity  of  (he  schodt  systems  $*id  iheir  school  system  has  fell  pressure  (o 
**enforcc  stricter  dUciphne**  (61  percent).  That  pressure  was  less  likely  to  be  felt  in 
srnall^  school  systems.  A  majority  of  the  large  school  systems  were  also  likely  to 
feel  pressure  to  "increase  the  time  spent  on  the  basic  curriculum**  (73  percent), 
^  **require  higher  studcnrachievement  standards'*  (74  percent),  "require  students  to 
'  pass  a  test  before  being  promoted  or  graduated**  (59  percent),  and  to  "enforce 

stricter  attendance  requirements**  (62  percent). 

•  At  the  elementary  level,  reading.  American  history,  general  Kien^.  mathematics/ 
arithmetic,  physical  educat  ion.  and  spelling  are  required  by  practically  every  school 
system.  Citizenship,  geography,  and  state  history  are  requi^d  by  more  than  I5.per<^ 
cent.  Music  is  required  by  II  percent,  world  history  by  78  percent,  and  fine  arts 
by  70  percent.  A  fbreign  language  is  not  even  offered  by  70  percent  of  the  school 
systems. 

•  At  the  junior'high  level,  almost  every  school  system  requires  English,  science, 
mathematics,  and  physicareducation;  American  history  is  required  by  92  percent, 
and  world  history  and  state  history  are  required  by  more  than  two-thirds  (67 
percent  and  71  percent,  respectively).  Fine  arts,  instrumental  and  vocal  music, 
home  economics,  and  industrial  ans  are  offered  by  most  school  systems,  but 
generally  as  an  elective.  About  half  offer  typing  (56  percent)  and  vocational 
education  (48  percent)  generally  as  an  elective.  As  an  elective.  Spanish  is  offered  by 
6/  percent.  French  by  54  percent,  and  German  by  21  percent.  Very  few  junior  high 
schools  offer  Rustian  or  Chinese. 

•  At  the  high  school  level.  English,  American  history,  and  mathematics  are  the  only  ~ 
courses  required  by  most  of  the  school  systems.  A  significan:  number  require  world 
history  (52  percent),  biology  (44  percent),  and/or  arioiher  science  (60  percent), 
while  most  of  the  other  school  systems  olTer  them  as  an  elective.  A  wide  range  of 
other  courses  \%  offered  as  an  elective  by  most  Khool  systems  with  the  exception  of  a 
state  history  offered  by  68  percent,  German  by  63  percent.  Russian  by  22  percent. 
Chinese  by  8  percent  and  agriculture  by  61  percent. 


There  hai  been  a  much' publicized  '  ^ 
demand  for  schools  to  get  'back  to  the 

bMks."  To  what  extent  has  your  school  , 
system  feit  pfctsure*to  do  each  of  the 
followini?  (ferant  responding  "much** 
or  "moderate**  preuure.) 

a.  IncretAc  the  time  spent  on 

the  basic  curricula  v   49        49  51  43       54     34      37,  ^73 

b.  Increase  the  amount  of 

student  homework  >   21        30  «       .  25  25  49 


THE  CURRICULUM 


Region 


StrSiUm 


Question 


30O-   3.000-  25.000- 

Total  Northeast   Soutlicast   Middle  West  2.999  24.999  or  more 


« 


232 
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  THE  CUltRICULUM--(CONTINUED) 

Ref[on 

Stratum 

300- 

3.000- 

25.000- 

Question 

Total 

Northeast 

Southeast  Middle 

West 

2.999 

2'.999 

or  more 

c.  Structure  the  Khools  tn  the 

2t 

6t 

32 
61 

30 
63 

22 
62 

30 
61 

19 
52 

It 

59 

31 
74 

e.  Require  hifher  student 

57 

54 

65 

56 

57 

39 

58 

77 

r.  Require  students  to  pass  a 
test  before  bejnf  promoted 

35 

27 

60 

26 

31 

15 

36 

59 

f.  Enforce  strict  attendance 

46 

39 

53 

42 

50 

36 

45 

62 

Which  of  the  following  COURSES  docs 
youV  school  system  consider  as  basic  sub- 
jects; that  is,  they  are  required  o(»\Ufgu- 
tar  students  for  ,r*<i"*»'0"  f'^m  the 
public  schools?  (Percent  responding) 

ELEMENTARY; 

a,  Reading 

100 
0 
0 

100 
0 
0 

100 

^  0 
0 

99 
0 

100 
0 
0 

100 
0 
0 

100 
0 
0 

99 
1 

0 

b.  Citizenship 

%% 

95 
0 
5 

83 
7 
10 

87 
2 
1) 

87 

5 

8 

87 
4. 
9 

89 
4 
7 

89 
2 
t 

c  Geography 

91 

95 
1 
4 

88 
8 
4 

95 
3 
2 

16 

7 
7 

96 
2 
2 

86 
8 

5 

94 

3 
3 

d.  American  history 

95 

too 

0 
0 

92 
3 
5 

96 
1 
3 

93 
1 

6 

94 
1 

6 

95 
2 
4 

97 
1 

2 

e.  World  history 

t6 

7 
7 

79 
7 
14 

77 
8 
16 

79 
1 

20 

77 
7 
16 

80 
6 
14 

76 
8 
16 

I  Stale  history 

91 

,  0 
9 

91 
4 
5 

89 
3 
9 

82 
2 
16 

89 
3 
8 

85 
3 
12 

87 

5 
8 

233 
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THE  CURRICULUM-KCONTINUED) 

<*"  ■ 

Kefion 

Stratum 

300. 

3,000* 

25.000* 

Quotion 

Total 

N  on  heasi 

Soulheasl 

Middle 

Wesi 

2.999 

24.999 

or  more 

f.  General  science 

96 

98 

98 

9t 

99 

91 

9t 

3 

0 

0 

I 

2 

0 

1 

2 

3 

1 

1 

h.  Malhenuiks/ariihinctic 

100 

100 

100 

100 

100 

100 

100 

0 

0 

0 

0 

0 

.  0 

0 

0 

0 

^0 

0 

0 

0 

0 

0 

i.  Fine  am 

70' 

82 

64 

74 

63 

70 

68 

73 

9 

23 

20 

27 

It 

22 

24 

9 

9 

12 

7 

)0 

12 

10 

2 

j.  Mukic 

92 

71 

16 

7t 

81 

80  • 

82 

$ 

27 

12 

19 

18 

17 

18 

0 

.> 

2 

2 

2 

3 

0 

k.  Phj^ical  edwolton 

96 

99 

9t 

99 

95 

9t 

100 

Etective^ 

0 

4 

0 

I 

1 

1 

2 

0 

3 

•  1 

0 

1.  A  fofeifn  languafc 

5 

'5, 

5 

4 

6 

5 

4 

7 

25 

14 

39 

17 

35 

20 

19 

42 

70 

12 

57 

79 

59 

75 

77  ' 

51 

m.  Spclltng 

98 

96 

98 

97 

96 

•99 

9t 

99 

1 

2 

0 

1 

3 

1 

-  * 

3 

0 

1 

I 

1 

JUNIOK  HIGH:  . 

a.  English 

100 

100 

100 

100 

100 

100 

100 

  0 

0 

•0 

0 

0 

0 

0 

.  ,  0 

0 

0 

0 

0 

0 

0 

0 

b.  American  \m\wy 

92 

90 

94 

,     .  92 

95 

tt 

91 

94 

4 

3 

4 

2 

3 

4 

2 

,  ...  5 

4 

10 

5 

4 

5 

6 

4 

c.  World  histofy 

72 

57 

79 

64 

66 

65 

71 

9 

20 

13 

10 

10 

'  II 

20 

19 

12 

16 

21 

24 

19 

17 

24 

d.Siaie  hislofy 

t2 

83 

75 

74 

12 

73 

77 

4 

12 

7 

4 

4 

9 

8 

14 

15 

16 

15 

12 

16 

18 
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THE  CVIimCVLVMHCONTINVEP) 


Region 


Stralum^ 


300.   3,000-  25.000. 


Question 


t.  A  science 

Required  

Elective.   2 

Not  offered   ® 

f.  Mathematics 

Required  ■  •   ^ 

/  Elective....  

Not  offered  ® 

rhys'KAl  education 

Required.  .......... 

Elective.   2 

Not  offered.....   © 

h.  Fine  arts 

Required   ^ 

Elective    ^ 

Not  offered   6 

i«  insiruflienul  music 

  J 

Elective   ^ 

Not  offered   3 

J.  Vocal  muiic 

Required  

Elective........  

Ntft  offered  -  ^ 

f Of Wfn  hngutgt: 
k.  Spanish 

•  Re((utred  

Elective,.,..  «••••' 

Not  offered  

I.  French 

Required.....  ^ 

Elective  -••  " 

Not  offered  -  

m.  German 

Required....   ' 

Elective   27 

Not  offered   '72 

n.  Russian 

Required   0 

•  Elective......  '   ^ 

Not  offered  

o.  Chinese 

Required   0 

Elective..  ■•  J 

Not  offered  


97 
3 
0 

9t 

I 

0 

99 
0 


14 

5 

15 
S3 

3 

46 

53 
I 


3 

33 

4 

67 
29 

2' 
26 
72 

0 
7 

94 


0 
2 

9t 


99 
1 

99 

at 

99 

9t 

1 

2 

0 

0 

1 

0 

1 

iOO 

100 

100 

100 

99 

0  , 

0 

0 

Q 

0 

^0 

0 

0 

0 

96 

91 

99 

97 

97 

4 

3 

3 

3 

0 

0 

0 

1 

0 

32 

54 

40 

55 

54 

61 

39 

J* 

35 

44 

7 

7 

2 

10 

2 

4 

6 

6 

10 

t 

ts 

91 

t6 

t9 

t 

3 

1 

5 

3 

16 

30 

IS 

27 

26 

75 

66 

TO 

63 

72 

9 

5 

'  10 

3 

0 

1 

z 

2 

71 

44 

63 

2* 

OJ 

£y 

54' 

33 

71 

35 

0 

2 

i 

2 

3 

69 

43 

41 

55 

31 

55 

5t 

to 

43 

0 

1 

0 

1 

1 

25 

30 

23 

31 

to 

70 

76 

69 

90 

74 

0 

0 

0 

1 

10 

2 

4 

0 

2 

90 

'  97 

96 

100 

97 

0 

0 

0 

1 

3 

3 

0 

91 

97 

100 

99 

97 
3 
0 

100 
0 
0 

9€ 

2  ' 
0 

31 

60 
2 

4 

96 
0 

23  • 
77 
0 


2 

19 

9 


U 

15 

1 

52 
47 

0 
17 
14 

0 
10 
90 


ERLC 
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THE  CUWIICULUM-4<C0NTINUED) 

Region 

Siratum 

Question 

Toul  Noriheasi   Souiheasi  Middle 

30(K  3,000-  25.000- 
Wcsl  .  2.999  24.999  or  more 

p.  Home  economics 

Required...  <..>i.. 

Elective  ..... 

Noi  offered  

q.  Typmi 

Required .......... 

EkctKe  

No<  offered  

r.  Agriculture 

Required  

Elective  ^  < 

Not  offered  

s<  An  Indutlrial  art 

Required  

ElectUe  ........... 

Not  offered........ 

t.  Vocational  education 

Required .......... 

*   Elective  ..........< 

Not  offered........ 

u.  Driver  education 

Required .......... 

Elective  ........... 

Not  offered ........ 


SENIOR  HIGH: 

a.  English 

Required ...... 

Elective ....... 

Not  offered .... 

b.  American  history 

Required  ...... 

FlectiVe  

Not  offered .... 

e.  World  history 

Required  

Elective......* 

Not  offered.... 

d.. St  ate  hisiory 
Required ...... 

Elective  ..X.... 

Not  offered.... 


34 

64 

16 

36 

1% 

37 

37- 

25 

59 

32 

77 

56 

66 

47 

57 

75 

8 

4 

7 

8 

«  6 

16 

6  - 

0 

4 

4 

0 

.  3 

4 

6 

3 

2 

52 

38 

75 

'  46 

52 

29 

51 

SI 

44 

58 

25 

49 

45 

65 

46 

18 

1 

2 

0 

2 

0 

4 

1 

0 

22 

II 

41 

17 

21 

20 

18 

29 

77 

88 

59 

81 

79 

76 

81 

71 

33 

65 

15 

36 

27 

34 

38 

23 

56 

30 

71 

52 

66 

46 

52 

76 

II 

5 

15 

\X 

7 

20 

10 

I 

5 

7 

4 

3 

4 

•  4 

4 

43 

26 

69 

38 

44 

42 

66 

52 

67 

27 

58 

53 

59 

54 

30 

3 

2 

4 

3 

3 

2 

3 

18 

12 

24 

18 

10 

19 

17 

16 

10 

17 

72 

79 

89 

77 

81 

82 

100 

100 

100 

100 

99 

100 

100  ^ 

100 

0 

0 

0 

0 

0 

0 

0 

0 

0 

.  0 

0 

0 

0 

98 

100  ^ 

99 

98 

99 

99 

98 

98 

0 

1 

3 

0 

1 

» 1 

2 

0 

0 

0 

0 

0 

0 

52 

61 

57 

41 

55 

53 

59 

42 

47 
1 

39 

42 

57 

44 

45 

40 

58 

0 

1 

2 

2 

0 

35 

46 

29 

32 

42 

41 

yy 

30 

33 

26 

34 

31 

34 

24 

34 

42 

32 

29 

3; 

37 

25 

35 

.33 

28 

/ 


ERIC 
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THE  CUIRICVLVM^CONTINUED) 

Region* 

Sirttum 

300- 

yMO-  25.000. 

QucMion 

Toul  NorthcMi   Sooihewt  Middk 

Wesl  2.9W 

or  more 

e.  Wolofy 

\  Kc<)uir«d   ^ 

Elective   55 

Not  offered   '! 

r.  Another  tcknct 

Ktqmnd  •••••  W 

Ekcthrc'   ^ 

NotofTcftd.......   I 

f.  Mthe—lkt 
Rcquirad  j^.—  ♦J 

Eliellve  jpJi......  % 

Notoireml......^.y   ■ 

l\rmeirtt  ' 

\R«i»lred..  

Xleelive    »2 

I '  ottered   ^ 

I  Performing  arts  (e  f..  dr»nw) 

Elec«iv\   91 

Notofliei«^   ♦ 

j,  iMiramcntat 
Kcqwrtd.. 

Ekdive  ^ 

Not  ffferid 

k.  Voni  music 

y     EliCtivc^   .V   •* 

Not  offered  X   ^ 

I.  Sponiih 

Kcil^ircd.M-  V  ^ 

Elective  .",  .\  »? 

»        Not  offered  \  II 

m.  French 

Kcquired   \ 

Elective   \l 

Not  offered 

n.  Gcrmon 

Ket|uircd . . 

Elective.  ^..^  ?.  62 

'    ;     Not  offered  '   37 

*0.  KUMIM 

KcqiiirW...^   0 

Elective   '^2 

Not  offered   7» 


44 

55  * 

40 

41 

50 

44 

3t 

54 

45 

60 

51 

50 

56 

62 

0 

0 

0 

' 

0 

0 

63 

66 

41 

71 

60 

59 

60 

J7 

34 

52 

29 

39 

40 

40 

0 

0 

' 

A 

Vy 

U 

96 

19 

96 

90 

91 

95 

14 

4 

II 

3 

10 

9 

5 

0  ' 

0  . 

0 

1 

0 

' 

A 
V 

22 

g 

II 

16 

19 

14 

9 

12 

,  15 

12 

74 

t3 

'  91 

1 

10 

4 

2 

7 

3 

0 

0 
91 

0 

It 

1 

M 

96 

14 

, 

92 

, 

99 

f 

12 

II 

3 

15 

t 

0 

0 

0 

1 

2 

1 

1 

' 

100 

96 

97 

9t 

97 

n 

0 

4 

1 

0 

2 

0 

0 

2 

0 

2 

91 

95 

97 

91 

97 

9t 

t 

3 

3 

t 

2 

0 

0 

\  1 

2 

2 

2 

♦7 

17 

to 

95 

6t 

95 

9t 

3 

12 

It 

3 

31 

4 

0 

0 

i 

2 

0 

2 

16 

79 

to 

53 

95 

99 

2 

13 

20 

20 

47 

4 

0 

0 

•  2 

.  2 

0 

2 

55 

51 

70 

25 

70 

91 

43 

4t« 

73 

'  29 

t 

\ 

o 

0 

0 

0 

0 

0 

33  \  - 

30 

21* 

3 

15 

53 

67  \ 

70 

t9 

79 

97 

t5 

47 

ERIC 
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THE  CURmCULUM-(CONTlNUED) 

✓ 

Rc|!on 

Sc  fat urn 

Question 

Toul  NorChcASC   SouChcasC  Middle 

WejC  2.999 

3.000-  25.000* 
24.999  or  more 

p.  Chmese 

Required  !. . .         0  0 

Efecme  ,  ......        S  8 

Not  offered   92  92 

q.  Home  economic 

Required  ,                            4  6 

Efcctrtc   96'  94 

Not  offered                                  0  0 

r.  Typini 

Required...                                3  3 

Elective.   97  97 

Kot  offered                                  0  0 

y  Another  buime^educalton 

Required.,                                  2  0 

Elective...   91  ICQ 

Nol  offered..  .                 0  0 

1.  Afncullure 

Required  . . ,                                 0  0 

Elective,..  —  61  25 

Not  offered   39    •  75 

□.Industrial  arts  ' 

Required                                     2  I 

Elective   96  99 

Not  bffered.*  «...                3  -0 

V.  Vocational  education  ^ 

Required   ,  2  0 

Elective....,   93  91 

Not  offered                                  4  9 

w* Work-study  (c.^.  I)E) 

Required  ...»  '        I  '  0 

Elective   92  97 

Not  offered.,...                          8  3 

X.  Driver  education  t 

Required   I*>  12 

Elective  ;  77  77 

.    Not  offered........                       4  12 


0 

0 

0 

1 

0 

.  0 

12 

3 

7 

2 

3 

23 

»8 

n 

93 

98 

97 

77 

0 

4 

5 

S 

3 

1 

100 

96 

9X 

92 

97 

99 

V  0 

0 

1 

0 

.  0 

1 

3 

3 

8 

2 

I 

99 

97 

96 

92 

'98 

99 

0 

0 

1 

0 

0 

# 

0 

3 

3 

4 

1 

100 

97 

97 

95 

99 

99 

0 

I 

0 

1 

0 

0 

«> 

I 

D 

0 

1 

0 

0 

76 

61 

75 

64 

53 

71 

23 

39 

24 

36 

47 

29 

0 

1 

1 

J 

92 

96 

9« 

92' 

96 

99 

8 

3 

4  ' 

3 

0 

1 

2 

3 

2 

2 

93 

93 

98 

87 

95 

•)8 

5 

4" 

0 

10 

3 

0 

\ 


0 

2 

0 

1 

2 

92 

88 

94 

79 

96 

98 

'  ^  1 

10 

6 

20 

3 

0 

16 

20 

2! 

IS 

18 

21 

80 

78 

76 

79 

77 

73 

.4 

3 

2 

3 

5 

6 

*238 


16'  .. 

Imtnictioii  in  SpccM  Artm  « 

•  Of  the  specialized  areas,  only  health  education  is  more  likely  than  not  to  hf  offered  * 
as  a  separaic  curriculum  course  in  63'perccnt  of  the  school  sj-stctns  but  iniegrajcd. 

inio  other  courses  in  37  percent.  ^  ^ 

•  Safety  education  is  offered  in  every  school  system  but  is  integraied  into  other 
courses  in  13  percent  of  the  school  ^stems. 

•  Or.uf  education,  alcohol  cduca^lbn.  metric  education,  consumer  education,  and 
career  education  are 'offered  b>  99  percent  of  the  school  systems.  More  than 

**  .  nine-lent hs,  however,  integrate  drug  education,  alcohol  ednpatiop,  and  metric 

education  into  other  courses.  One-third  (34'percent)  offer  consumer  education  and 
one-fifth  (20  percent)  offer  career  education  as  a  separate  course. 

•  More  than  90  percent  offer  sex  education,  invironihental  studies,  and  human 
relations  studies.  The  vast  inajority  (i.e.,  over  80|)erccht)Jnte|rate  these  into  other 
courses^ 

•  f  ouises  in  internaUonal  studies  are  not  offered  by  17  percent;  the  majority  (71 
pcrceiii)  integrate  such  studies  into  other  courses.  g 

•  A  little  more  than  half  (57  percent)  offer  bilingual  education  34  percent  as  a 
separate  curriculum  course  and  25  percent  as  integrated  into  other  courses.  While 
only  33  percent  of  the  small  school  systems  offer  bjtingual  education.  90  percent  of 
those  with  25.000  or  more  students  offer  Ihis, 


Question 


INSTRUCTION  IN  SKCIAI.  AREAS  ' 


Region 


Stratum 


300.   3.000-  23.000- 

Total  Northeast   Southeast    Middle  West  2,999  24.999  or  more 


In  tcneral.  docs  your  school  provide 
/      jniiruction  in  each  of  the  following  areas? 

t  a.  Drug  education 

Not  offered  n  

Integrated  into  other  Courses . . . 
Separate  curriculum  course ,  • .  • 

b/Sex  education 

Not  offered  -....'>. 

Integraied  into  other  courses. .. 

Separate  currieulum  eourse .... 
c<  Alcohol  eduealion 

Not  offered  

Integrated  into  other  eourscs... 

Separate  curriculum  eourse 

d.  Bilingual  education  ' 

Not  offered  

Integrated  i'qio  other  courvrs,  .> 
Separate  curriculum  courK .... 


0 

0  ' 

2 

0 

1 

0 

92 

»0 

95 

93 

94 

92 

91 

92 

1 

20 

5 

5 

i 

6 

9 

9 

1 

9 

9 

7 

6 

7 

8 

12 

M 

69 

S2 

17 

82 

t4 

II 

80 

23 

9 

6 

17 

9 

11 

13 

0 

0 

2 

0 

1 

1 

0 

93 

13 

96 

97 

93 

92 

93 

6 

17 

4 

'^ 

3 

5 

7 

7 

43  t 

42 

53 

33 

67 

46 

10 

23 

II 

21 

20 

26 

19 

22 

29 

34 

31 

3^ 

27 

41 

14 

33 

61 

24o 
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INSTR  UCTION  ll4  SPECIAL  AHEASMCCNTINUEO) 


17 


Question 


Region 


\  Siralutn 


\  ^  \  300-   J^.OOa-  25.000- 

Toul  Norihcj$i   Southeast    Middle  West  2.999  2<.999  or  more 


e.  Metric  educaticn 

Not  offered  

IntCf  rated  into^her  courses. 
Separate  curriculum  course  . . 

r  Health  education 

Not  offered  

Integrated  into  cth^r  courses. 
^    Separate  curriculum  course  >• 
>  g.  Safely  education  ^ 

Not  offered.... s  > 

Integrated  into  other  courses. 
Separate  curriculum  course  . . 

h.  Co'nsumcr  education 

Not  offered....  , 

Integrated  into  other  courses, 
fkparate  curriculum  course  . . 
I.  Career  education 

Not  offered ................  i 

IniegratcJ  into  other  courses, . 
Separate  curriculum>rours^  . . , 

j.  International  studies 

Not  of?ered.  

Integrated  into  other  courses . , 
Separate  curriculum  course  , 

k.  EflvirOntiKniai  studies 

Sot  offered  , 

integrated  into  other  courses* , 
Separate  curriculum  coufSe  . 

i.  Huinan\relaiions  Studies 

Nof  offered.....  

 ImegraiedjniOLOihCLfouut^ 

5>eparaie  curriculum  course  . . , 


I 

0 

0 

2 

0 

2 

96 

98 

96 

95 

96 

95 

3 

3 

4 

3 

4 

3 

2 

0 

0 

0 

0 

1 

yf 

37 

41 

32 

31 

3? 

.  35 

63 

62 

59 

67 

69 

63 

65. 

0 

0 

f  0 

I 

0 

0 

S3 

79 

83 

84 

SO 

SO 

81 

17 

21 

17 

15 

20 

20 

IS 

1 

0 

4 

0 

1 

3 

65 

67 

65 

63  • 

69 

63 

64 

34 

33 

31 

36 

31 

37 

33 

1 

0 

1 

0 

2 

79 

84 

72 

81 

79 

82 

20 

16 

27 

18 

18 

21 

^16 

tl 

9  " 

19 

18 

16 

24 

14 

71 

74 

64 

72 

n 

66 

.  73 

12 

17 

16 

to 

6 

10 

13 

•1 

3 

1 

5 

3 

4 

S7 

S2 

86 

87 

90 

W 

SI 

10 

17 

J3 

9 

5 

12 

10 

5  « 


5 

90 


7 
85 


4 
91 


7 
87 


4 

90 


0 

95^ 
5 


70  \ 


30 

Q 

77 
23 


76 
14 

.  2 

90 
9 

,3 
S8 
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Student  Evaluation  ^ 

•  Aboul  haJf  (51  percent)  of  the  school  systcrtis  require  mmimal  competency  tcstin| 
of  students.  35  percent  for  grade  promotion  and/or  for  graduation  from  high 
school  and  17  percent  for  other  reasons.  School  systems  m  the  Souihcastcrn  rcgjon 

.  and  those  with  3,000  or  more  students  are  more  likely  to  require  such  testing  than 
are  other  school  systems*  -^^ 
\ 

•  Almost  three^nfths  (59  percent)  provide  the  opportunity  iTorearly  graduation  trom 
high  school,  with  2  percent  actively  promoting  it.  About  three.tenths  (29  perceni) 
allow  it  only  under  unusual  circumstances,  whereas  13  percent  do  not  allow  it. 

•  When  elementary  students  do  not  successfully  complete  the  rcquirernents  for  a 
grade  about  two-fifijis  (38  percent!  retaiixtjicm  In  that  grade  until  they  doso.  More 
than  half  (53  percent)  promote  them'  to  the  next  grade,  with  most  of  those  giving 
specially  designed  remedial  help<  Only  9  percent  assign  them  to  specially  designed 
programs. 

•  lhcmaiorilyrequireiheuseofOROUPSTANDARDIZ5Dachievementtcsts(88 
percent)  and  reading  readiness  tests  (67  percent).  About  half  require  the  use  of 
intelligence  tests  (52  percent)and  aptitude  tests  (46  perceni).  About  one.fourth  (28 
percent)  require  the  use  of  interest  tests.  Large  School  systems  are  slightly  more 
hkcly  to  require  achievement  tests  but  lesr  My  to  require  the  other  four  than  arc 
small  school  systems. 

•  No  published  GROUP  STANDARDIZED  achievement  lest  is  used  by  a  majority 
of  the  school  sv  stems,  although  the  California  AchievemenvTests.  the  Com  prehen* 
iive  Test  of  Basic  Skills,  the  Iowa  Test  of  Basic  Skills,  an^J  the  Metropolitan 

'Achievement  Tests  are  required  by  a  Iitile  more  than  onc-third  of  the  school 
systems.  About  onc-fourth  require  th<^SRA  Achievement  Series  and  the  Stanford 
Achievement  Tests.  Some  school  systems  require  the  use  of  two  or  more.  The 
PSAT,  SAT,  and  ACT  are  generaly  made  available  but  not  required. 

•  More  than  Ihree-fourths  (78  perceni)  of  the  school  systems  report  uSing  criterion- 
referenced  achievement  tests.  T}iesc  are  used  less  often  in  the  Northeast  but  more 
o/len  in  large  school  systems / 

•  About  two-nfths  (43  percent)  place  some  reliance  on  GROUP  STANDARDIZED 
achievement  test  scores  as  reliable  measures  of  the  effectiveness  of  individua. 


schools. 


In  almost  two-fifths  (37  percent)  of  the  school  systems,  she  mean  of  GROUP 
STANDARDIZED  achievement  test  scores  for  each  regular  school  is  reported  to 
the  media.  This  is  practiced  more  often  m  schoolsyslems  in  the  Southeastern  region 
and  in  large  school  systems  than  in  others. 

ThemajorityusescoresfromGROUPSTANDARDIZEDachievementtestsatthe 
buildins  level  for  diagnosing  individual  student  learning  needs  (87  percent)  and 
evaluating  the  curriculum  (75  percent).  A  signiHcant  number  use  the  scores  for 
tracking  h  grouping  students  (43  percent)  and  evaluating  cffeaivencss  as  com- 
pared with  that  of  other  schools  (32  percent).  Few  use  them  for  determining 
promotionyrelenlion  of  students  (9  percent)  or  evaluating  mdividualtcacherelfec 
tiveness  (5  perceni). 


\ 


\ 


2i7 
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STUDENT  EVALUATION 


300*   3.000-  25.000- 

Total  Norihcasi   SouihcaM    Middk   W«j  2,999  24:^9  or  more 


Docs  >our  school  system  rcquwe  MIN* 
IMAt  COMPi:rENCV  ICSTJNO  of 
MuJenis?  O*crccnt*rc$ponding.) 

Ye$.  for  (radc  promotion......... . 

Yo.  for  graduation  from 

high  school ......  ^  . 

Ves,  for  both  grade  promotion  and 

graduation  from  high  school 
Neither  of  |ho%e.  bui  for 

other  reasons  r .  ^  • 
No.  


4 

3 

4 

5 

3 

6 

4 

25  " 

24' 

41 

13 

23 

9 

31 

34 

6 

5 

14 

3 

8 

4 

6 

10 

17 

19 

14 

\ 

16 

14 

17 

21 

49 

51 

2$ 

61* 

50 

67 

46 

30 

Which  of  the  foltovung  BEST  describe^ 
>oor  school  system's  policy  on  fiARtY 
GRADUAIION'  (e.g.  \*hen  4  student 
meets  graduation  requirements  at  the  end 
of  the  eleventh  grade)?  (Percent 
respomiingj 

Early  graduation  is  activel> 

promoted   

students  are  given  the  oppor- 
tunity-roiraduate  early  but  it 
kAOT  actively  promoted 
Early'^raduation  is  allov^ed  only 
under  unusuarcTfCtrmsUncci. 


Early  graduation  is  N'OT  alio\«ed.. . 


2 

1 

•  4 

,  1 

3 

1 

4 

57 

47 

55 

5$ 

55 

46 

58 

68 

29 

34 

34 

/29 

26 

30 

33 

22 

13  ' 

17 

S 

13 

16 

23 

8 

7 

When tfcmentary  students  DO  NOTsuc- 
ccssfully  complete  the  requirements  for  a 
grade,  which  of  the  following  BBS  Tdes* 
cribcs  the  policy  of  jour* school  s>^iem'' 
(Percent  re^pondlng^) 

Retain  them  in  grade  until  they 

irect  the  requirements  ..«...<. x.> 
Take  then)  out  of  regular  program 

and  as  «n  them  to  specially 

dcMxrved  programs  9 

Promote  them  to  nexl^  grade  but 

give  them  specially  designed 

rriTxdial  help 


38      1  42  41  40       36      43       33  37 


49       *47  43  47      ,52      45      56  45 


Promote  them  to,  ne;^t  gr.idc........        4t0  3  5         533  6 
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STUDENT  EVALUATlON-(CONTINUtU) 

\ 

Region 

Stratum 

Question 

Total  NoHhcas'   Southeast  Middk 

300- 
Wcsl  2.999 

3.000-  25.000- 
24.999  Of  more 

Listed  below  are  some  areas  for  uh«ch 
GROUP  STANDARDIZED  TESTS 
are  availaWe.  For  which  of  these  areas 
doe^  > our  school  s>stem  require  (either 
by  state  mandate  or  local  option)  i~  :  use 
of  the  tests,  for  which  4re  ic^ts  made 
available  but  their  use  is P/>/w/itf/,  and  for 
which  arc  no  tests  made  available^  (P«- 
ctnt  responding) 

a.  Intelligence 

Required    52 

Optional.  

Not  used   19 

b  Achievement 

Required  x...— ,   »• 

Optional    ,   " 

iS'ot  used    r  .  —  ■  •  >  •  •  ' 

c  Readmg  readiness 

Required..,.,.-.-.*/ 

Optional  *«>  28 

iVot  used  *   ^ 

.    d.  Aptitude 

Required..  

Optional ...... x*".'"..  

N'otused  

c  Interest 

Required   »•  28 

Optional  -   V  6' 

N'oi  used   " 

Specifically,  which  of  the  follow- 
ing GROUP  STANDARDIZED 
ACHIEVEMENT  TESTS  does  your 

I  ^hool  iyslem  require,  which  are 
optional .  and  which  are  "o/  wrd? 

\  (Percent  responding.) 

a.  CaliforrtJj  Achievement  Tests 

\        ftequuvd..   •'O 

Optional  «.K  19 

V       »S'ot  used   •««♦" 

\ b.  Comprehensive  Tests  of  Basic  Skills 

\     Required  •  -^^ 

\  Optional.  

\^   Not  used...,  <  


57 
29 
14 

84 
15 


68 
27 
5 

49 
39 
12 

27 
57 
16 


27 
15 
58 

15 
52 


62 
25 
13 

96 
4 
0 

72 
25 
3 

J6 
37 
7 

35 
5) 
14' 


\ 


39 
\% 
44 

50 
16 
34 


63 

35 

53 

56 

43 

25 

34 

37 

27 

22 

12 

31 

II 

17 

35 

%% 

$5 

80 

89 

97 

12 
1 

II 
1 

18 
2 

lO' 

2 
1 

71 

61 

67 

74 

59 

28 

26 

28 

22 

34 

1 

13 

4 

5 

7 

44 

42 

48 

'  49 

38 

51 

43 

42 

44 

50 

5 

15 

10 

7 

12 

33 

21 

36 

28 

18 

64 

61 

51 

63 

72 

3 

19 

13 

9 

II 

42 
28 
30 

27 
23 
50 


47 

16 

38 

38 
19 
44 


37 
25 
^8. 

29 
18 

53 


38 
14 
47 

43 
19 
35 


43 
18 

59 

44 
14 
42 
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STUDENT  EVALUaTIONHCONTINUEO) 


21. 


Region 


Siraium 


Question 


300-   J,000-  25.000- 


otal 

Northeast 

Southeast 

Middle 

West 

2.999 

2^.999 

or  more 

35 

34 

18 

44 

30 

42 

33 

30 

19 

16 

26 

24 

16 

25 

16 

17 

46 

50 

56 

32 

54 

34 

32 

^  53 

17 

4 

18 

23 

20 

24 

15, 

II 

15 

II 

16 

17 

20 

23 

12 

68 

85 

67 

61 

61 

33 

74 

77 

26 

19 

38 

26 

21 

J3 

25 

17 

27 

22 

25 

31 

27 

.10 

30 

21 

47 

59 

38 

44 

52 

37 

45 

62 

29 

31 

26 

28' 

38 

38 

28 

22 

28 

31 

17 

36 

28 

34 

24 

27 

43 

39 

57 

36 

35 

28 

49 

52 

34 

39 

29 

'  31 

40 

27 

26 

24 

24 

33 

17 

31 

23 

24 

41 

29 

37 

35 

54 

>  38 

36 

49 

II 

H 

ID 

13 

7 

16 

13 

2 

78 

78 

73 

81 

75 

70 

79 

"  86 

II 

13 

6 

19 

14 

9 

12 

13 

12 

II 

13 

9 

16 

17 

2 

SI 

80 

12 

85 

77 

75 

79 

90 

7 

S 

7 

2 

14 

10 

4 

8 

9 

5 

3 

II 

10 

12 

12 

2 

76 

62 

10 

79 

77 

75 

72 

82 

16 

33 

17 

10 

13 

13 

16 

17  * 

Iowa  Test  of  iasic  Skills 

Required ...... ^  

Oplioful   

N'ol  used  

d.  lowa  Test  of  Educational 
Development 

Required  

Optional  

Not  used  .>.>.......«.  

e.  SR\  Achievement  Scries 

Required  

Optional  ....  

Not  used  

f  Stanford  Achievement  Tests 

Required   >.,v  

Optional  v../.  

Not  us<;jJ  

g.  Metropolitan  Achievement  Tests 

Required  ............. 

Optional  

Not  used 

h.  PSAT 

Required ^ ................ . 

Optional  « 

Not  used  .,,..,.^.1.1.  

I.  SAT 

Required  

Optional  

Not  used  

ACT 

Required  >>.  

Optional  

Not  used  .................... 


Does  your  school  ^item  use  any 
criterion -referenced  achievement  tests 
(these  identify  specific  learnin|  tasks  stu< 
dents  can  perform)  in  all  ormostschools'' 
(Percent  respondiog.) 

Yes.  required  by  the  slate  .<.....>. 
Yes.  but  only  recom^^ended 

by  the  stale  > 

Yes.  but  it  was  a  local  option  ...... 

No  .   


25 

10 

40 

27 

25 

ir 

25 

40 

3 

3 

3 

2 

5 

2 

2 

50 

53 

42 

47 

50 

49 

49 

22 

35 

16 

23 

23 

34 

22 

9 

21 
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STUDENT  EVALUATIONHCONTINUED) 

'  Re$foo  ^ 

SuitMm 

300-   3.000-  25.000- 

Toul  Nonheati   SoMtheast  Middle 

West  2.999  24.999  or  more 

Doe*  ydu  r  uhool  system  rely  on  G  RO  U  P 
STANDARDIZED  ACHIEVEMENT 
TEST  SCORES  •«  reliable  me«ures  of 
(he  effect ivene«  of  individual  ichooU? 
(fereent  rnponding.) 

Yes.  definitely  «...       /  5  >? 

'    Yes.  KmMwhat » . »  

No  


39  37  47 
57         63  51 


/ 

8 

3 

II 

2 

.'4 

41. 

35 

41 

3S 

38 

56 

54 

57 

5S 

55 

Does  yowr  school  sy^terrt  report  the 
m«€n  of  GROUr  STANDARDIZED 
ACHIEVEMENT  TEST  SCORES  for 
each  rfguhr  Khool  to  the  medU?  (Per- 
cent respondinit) 

Yes  ....v...  37 


No  . 


For  the  mo«i  P*rt.  how  are  uorrs 
from  GROUr  STANDARDIZED 
ACHIEVEMENT  TESTS  used  at  the 
''Khool  buiWini  level?  (Percent  respond- 
ing. Perccnit  may  add  to  more  than  100 ) 

The  teslt  are  noi  used  in 

this  school  system   

Scores  »re  no<  used  at  the 

b«i)ldin|  level  >  «  

Diagnosini  individual  student 

karnini  needs  *  >  ..• 

Tracking  or  grouptnt  students  

Deiermtnini  promotion/ retention 

of  students  rv  «  

.  Evalualini  individual  teacher 

effect ivencM  

Evalualini  the  curriculum  ......... 

Evaluating  effectiveness  as  compared 

with  that  in  other  schools  


ERIC 


2[)i 


31  55  26       42      26      34    '  55 

6)         69  45  74        58      74       66  46 


2 

5 

0 

2 

2 

2 

2 

1 

3 

3 

1 

1 

6 

2 

3 

2 

87 

86 

92 

90 

84 

86 

88 

87 

4) 

55  • 

37 

48 

37 

38 

51 

39 

9 

9 

9 

8 

13  ' 

7 

10 

10 

5 

3 

10 

5 

4 

8 

4 

3 

75 

78 

77 

69 

79 

63 

81 

80 

3. 

29 

32 

30 

40 

32 

32 

30 
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S(«M  DbdpHiie 

•  Only  7  percent  report  that  student  di$cipline  is  NO  problem  in  their  school  system. 
Although  few  (3  percent)  say  it  is «  major  probkm,  about  two-fifths  (39  percent)  say 
it  is  a  moderate^ problem.  Almost  two-thirds  (66  percent)  of  the  larger  school 
systems/ however,  report  discipline  as  at  least  a  moderate  problem,  with  S  percent 
calling  it  a  major  problem.  * 

•  On  the  average,  7  percent  of  the  individual  schools  in  the  school  systems  have 
SERIOUS  student  discipline  problems. 

•  Although  a  wide  variety  of  practiced  to  help  schools  and  teachers  with  iheir 
discipline  problems  are  mentioned,  about  half  of  the  school  systems  surveyed  say 
they  have  ^rovide^  more  extensive  vocational  programs"  (5 1  percent)  and  **pro- 
vided  special  staff  training  on  how  to  handle  students  misbehavior"  (SO  percent). 
About  40  percenf  report  "providing  more  work-study  opportunities,"  ''writing 
strict  discipline  codes,**  and  **allowing  limited  corporal  punishment."  In  addition, 
about  two-thirds  of  the  large  school  systems  provide  **$peciai  schools  or  classes  for 
students  who  are  chronic  problems." 


STUDENT  DISCIPLINE 

Region 

Stratum 

JOO- 

3.000-  25.000- 

Question 

Tola!  Northeast   Southeast  Middle 

West  2.999 

24.999  or  more 

In  general,  to  what  extent  itstudent  disci- 
pline a  probkm  in  your  school  system? 
(Percent  responding.) 

Major  problem  

Moderate  problem  

Small  problem  

No  problem  .k  


3 

3 

S 

5 

0 

1 

S 

39 

26 

59 

36 

36 

25 

39 

5t 

51 

59 

31 

56 

52 

60 

56 

33 

7 

12 

S 

7 

7 

15 

5 

2 

What  percent  of  your  schools  would  you 
estimate  as  having  SERIOUS  student 
dtKipline  problems? 

5  percent  or  less  

6lo  14  percent  

15  to  29  percent  

30  to  49  percent  , 

50  percent  or  more  

Mean  percent  

Median  percent  


63 

59 

46 

66 

72 

81 

54 

57 

2<f, 

26 

,  26 

31 

16 

13 

29 

2t 

9 

15 

15 

3 

6 

3 

12 

12 

3 

0 

9 

0 

6 

0 

5 

4 

1 

0 

0 

0 

3 

0 

0 

7 

«;  6 

12 

5 

7 

6 

S 

U 

5 

5 

10 

5 

5 

3 

5 

5 

« 

U  A/ 
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STUDENT  DISCIPUNEHCONTINUEO) 

* 

Region 

Stratum 

300- 

3.000- 

25.000- 

* 

Qtictlton 

Toll) 

Northeast 

Southeast 

.  Middle 

West 

2.999 

24.999 

or  more 

What  hti  your  school  syHem  <Jone  lo 

- 

help  Khoolj  and  letch<r»  with  ihclt  stu- 

dent diKiplInc  problems'  (Percerit 

respondirf.  Percenis  may  add  to  more 

thaft  100.) 

7 

g 

1 

s 

15 

3 

I 

Provided  more  work-iludy 

42 

29 

50 

55 

47 

46 

%  Provtded  more  exieniive 

49 

35 

59 

61 

51 

44 

63 

55 

Required  at  lean  some  schools  io 

provide  more  traditiorul  curricula 

13 

14 

15 

23 

12 

13 

18 

s 

Provided  special  staff  triining 

on  how  to -handle 

52 

50 

77 

50 

3o 

54 

49 

29 

Hired  more  paraprofessionals  to 

24 

38 

11 

^* 

26 

30 

31 

34 

Made  parents  more  responsible  for 

38 

32 

37 

31 

37 

the  diKiplinc  of  their  children 

35' 

38 

34 

Hired  more  counselo/S  and 

other  specialists  to  work  with 

21 

24 

15 

27 

41 

27 

29 

22 

Reduced  class  sires  in 

15 

12 

23 
49 

14 

13 

II 

43 

42 

46 

51  - 

38 

46 

35 

Hired  security  personnel  in 

20 

12 

26 

14 

45 

IS 

19 

2 

Given  teachers  more  authority  to 

29 

29 

21 

25 

25 

23 

IS 

19 

Provided  special  $chooI(s)  for 

students  who  are  chronic 

34 

28 

66 

31 

26 

37 

26 

8 

Provided  for  special  classes  in 

some  Khoois  for  students  who  are 

39 

31 

65  ' 
45 

31 

31 

43 

38 

17 

Allowed  limited  corporal  punishment 

39 

15 

49 

43 

48 

36 

39 

Established  broider  provisions 

32 

26 

34 

36 

32 

34 

30 

33 

Established  broader  provisions 

21 

M 

28 

22 

24 

16 

21 

27 
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FlMiiriiit 

•  The  median  budget  is  $10  million  with  a  low  of  $127  thousand  and  a  high  of  almost 
$3  billion. 

•  The  majority  (86  percent)  report  an  increase  in  their  1979-80  budget.  The  median 
increase  was  8  pcrcerit.  with  only  6  percent  reporting  a  3  percent  decrease  on  the 
average. 

•  For  1979-80. 15  percent  report  cutbacks  in  some  programs/services  and  29  percent 
report  expanding  some  programs/ services  A  slight  majority  (56  percent)  have 
maintained  the  status  quo. 

•  When  cutbacks  arc  made,  they  are  more  Itkcly.io  be  made  in  numbers  of  teachers 
(59  percent)  or  numbers  of  administrative/ supervisory  personnel  (S2  percent). 
Forty'iwo  percent  have  cut  back  on  maintenance/custo<jial  services.  Few  have  cut 
back  on  kindergarten  and/or  other  preschool  programs(5  percent)  or  food  services 
(7  percent). 

•  One*third  (33  percent)  consider  the  funding  of  their  current  program  adequate, 
another  one-ihird  (33  percent)  barely  adequate,  more  than  one-Xourth  (28  percent) 
inadequate,  and  (6  percent)  very  inadequate. 

•  To  enable  the  school  systems  to  do  a  job  in  1979-80  that  ihey  felt  was  average  would 
generally  have  required  a  median  increase  of  20  percent  over  the  1978*79  budget. 

•  Three-Hflhs  (61  percent)  report  the  funding  of  their  1979-80  budget  as  a  problem 
which  they  expect  to  continue  for  the  next  three  years.  Another  27  percent  say  that 
although  It  IS  not  now  a  problem,  they  expect  it  to  be  one  in  the  next  three  years. 
Only  12  percent  foresee  no  immediate  problem. 

•  Four-Hfths  (81  percent)  feel  funding  of  education  is  a  problem  for  at  least  three- 
fourths  of  the  school  systems  in  iheir^tate. 

•  Only  3  percent  blame  inadequate  amounts  of  federal  aid  as  the  major  difficulty  tn 
maintaining  adequate  school  funding.  More  than  half  (53  percent)  say  the  major 
problem  is  movements  toehold  the  line  on  property  taxes."  and  44  percent  say  it  is 
''inadequate  amounts  of  state  aid." 

More  than  one-fourth  (27  percent)  report  successful  reductions  or  limitations  on 
property  taxes  in  the'community  where  their  school  system  is  located,  Another  13 
percent  report  unsuccessful  attcupts.  About  one-third  (34  percent)  say  that 
altnougj)  it  hasn't  happened  yet.  it's  likely  to  happen.  Only  27  percent  foresee  no 
such  attempts. 

•  The  mean  percentage  of  current  expenditure  revenues  provided  by  the  three  levels 
of  government  are  local'  44  percent;  state:  49  percent*,  and  federal.  7  percent.  About 
one-tenth  (9  percent)  say  more  than  75  percent  comes  from  local  sources,  and  7 
percent  say  more  than  75  percent  comes  from  state  sources. 

•  The  majority  (57  percent)  oppose  the  contention  that  (he  federal  government's 
share  of  the  cost  of  public  education  must  be  at  least  one-third. 

•  Nine-tenths  (91  percent)  report  receiving«DlRECT  federal  aid  through  ESEA's  . 
Education  fpr  the  Economically/ Educationally/ Disadvantaged  Children.  73  per- 
cent through  Education  for  All  Handicapped  Children.  49  percent  through  impact 
aid.  and  12  percent  through  Teacher  Centers  and/ or  Teacher  Corps  programs. 


248 


26 


H,if » « t^rctnt\  orefer  that  federaJ  aid  be  distributed  generally  among  all  school 

onc-thlrd  (31  percent)  prefer  a  combination  of  general  and  categorical  aid. 

Onlv  about  one-third  (36  ^erccni)  of  the  school  systems  are  fiscally  independent. 
witl'moe;han"irec.fif.hsVp*rcem 

the  southeastern  region  are  more  likely  to  be  fiscally  dependent  than  others. 

T«  thi^  increased  enertv  costs  for  busing  of  students,  about  one-third  (34 
;^cTn^tcutrck^^^^^^^^^ 

findmg  new  sources  of  revenue  (16  percent)  or  reducing  services  m  other  areas  (23 
percent). 

Two.th.rds  (65  percent)  cut  back  on  the  use  of  energy  for  heating/air  conditionings 
whe^eTn^i  of  the  remaining  school  systems  (30  percent)  met  the  increas«J  costs. 


FINANCING 


Region 


Stratum 


QuSnoir^  Toul  Northeast 

What  ii  your  1979-10  school  year  budget 
(in  .thou$»ndi  of  dolUrs)  for  current 
cxpenditurw?  (DO  NOT  include  capual 
outlay  or  interest  on  building  bonds.) 
,  (Percent  reipondlng.) 

UssthanSUOOaOOO. ....... ......        6  4 

$l.000.000to  $9,999,999   ^   '  5V 

$10,000,000  to  $49,999.99   24  2^ 

$50,000,000  or  more   ^6  i3 

Median  budrt  ^..^ 

(Millions  of  dollars)   >IOM  57.5M 

Wh»t  pcrctnttge  ch»ngc  was  this  over 
your  1971-79  budget?  (Percent 
responding.) 

Incre»$ed  —  •       »J  ^ 

Median  i'iwre»Je  (percent)   »  ^ 

Retoljvely  no  <^nte  "        *  ][ 

Decreased.....   —  ^  . 

Median  d<c(e»$e  (percent)   ■» 

In  tener»l.  to  what  extent  were  you  able 
to  miintain  inslnjcltonal  services  for 
1979-W?  (Perceni  retp^ndint.) 
Cut  back  some  services/ progrims  15  16 

Cut  back  some  services  «n(i 
expanded  some  service*,  but 
generally  maintained  the  status  quo       17  i 


Southeast 


300-   3.000-  25.000- 
Mlddle  West  2.999  24.999  or  more 


3 

37 
24 

36 


9 

4 

It 

0 

0 

a 

34 

77 

46 

0 

23 

25 

I 

,49 

17 

21 

36 

4 

5 

t3 

$I6M  $I7.6M  $2M   $MM  $75M 


t4 
I 

10 
6 
4 


II 
23 


17 

14 

8t 

t6 

9 

9 

7 

7 

7 

10 

6 

10 

6 

6 

6 

4 

0 

7 

2 

2 

10  19  i  17  20 
15        15       «       "6.  " 
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HNANCING-KCONTINl/ED) 

Region 

Stratum 

300- 

3.O0O- 

25,000- 

t  Question 

Total. 

Northeast 

Southeast 

Middle 

West 

2.999 

24.999 

or  more 

Link  Of  no  cfungf  in  any 

39 

37  '  ■ 

31 

49 

36 

33 

34 

31 

Ex^ndcd  some  services/ progrints  ■ 

29 

30 

35 

26 

30 

29 

34 

22  " 

If  /^imrKA^VC   wrrr    maHr   fl    nr  ? 
il   vli  i  DA\. i^o  wcic  nwuc  |i   or  a 

J. 

- — 

checked  ibove).  in  wh*i  treas  did  'hey 

T 

occur?  (PercenI  responding  who  had 

"cuibackj,"  Percenis  n^ay  add  lo  more 

ihan  100 ) 

18 

19 

12 

P 

13 

14 

21 

15 

59 

73 

50 

74. 

53 

57 

_  63 

54- 

Numbers  of  professional 

msiruclional  support  personnel 

30 

12 

23 

3li 

41 

14 

27 

41 

Numbers  of  supervisory/ 

75 

32 

27 

58 

40 

75 

14 

47 

Numbers  of  nonprofessional 

instructional  support  personnel 

33 

23 

33 

i9 

47 

21 

26 

46 

42 

19 

50 

34 

63 

II 

44 

53 

19 

15 

13 

23 

16 

32 

21 

12 

7 

1 

4 

9 

9 

7 

10 

5 

Kindergarten  or  other  preschool 

5 

0 

13 

P 

3 

4 

2 

9 

Some  currfcular  programs  (1-12) 

34 

39 

29 

34 

36 

39 

29 

19 

12 

23 

]4 

13 

18 

23 

17 

23 

19 

27 

14 

22 

II 

24 

25 

School  construction/ remodeling.... 

27 

12 

31 

26 

3t 

21 

19 

37 

Regardless  of  whether  or  not  you  have 

made  cutbacks  in  services,  do  you  coif 

stdcr  the  funding  of  your  current  pro- 

gram adequate  or  inadequate  for  you  to 

provide  a  good  education  for  your  stu- 

dents?  (Percent  responding.)' 

33 

42 

25 

26 

39 

39 

'  34 

23 

Funding  is  barely  adequate  ..-  

33 

32 

33 

39 

21 

36 

32 

,  32 

28 

22 

33 

29 

26 

21 

29 

37 

6 

4 

6 

6 

7 

5 

6 

1 

What  percentage  increase  in  your  1971- 

79  budget  would  have  enabled  you  (odo  a 

job  you  think  would  Be  average? 

20 

23 

20 

15 

20 

20 

20 

15 

25  0 
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FINANCING  HCONTINUEP) 


Region 


Stratum 


Quoiion 


Total  Northeait  Southeast 


300-   S.OOO-  25.000- 
Middle   West  2,999  24.999  or  more 


to  what  extent  U  the  funding  of  >our 
budget  going  to  be  a  problem  in  the  next 
three  years?  (Percent  responding.) 

It  is  NOT  now  a  problem  and  Should  n't 
be  one  in  the  next  three  years..... 

Il  IS  NOT  now  a  problem  but 
be  one  within  three  years 

It  is  now  a  problem  but  should 
get  belter  within  three  years  ...... 

It  is  now  a  problem  and  probably 
will  continue  to  be  one  'he 
next  three  years  • 

To  what  extent  doe%  the  funding  of  edu* 
cation  seem  lo  be  a  problem  in  your  siatri 
(Percent  responding ) 

Sol  a  problem  for  any  school  system 

in  lh»  Slate  .  x ,  ^ . , ,  ^ ...... . 

Only  a  problem  for  a/nv  school 

systems  in  this  state   ....» 

A  problem  for  about  hJf  of  the 

school  systems  in  this  state  ....... 

A  problem  for  about  ihref/ourtks 

of  the  school  systems  

A  problem  for  most  school  systems . 

As  far  as  your  school  system  is  con-^ 
cerned*  what  is  the  major  reason  that 
keeping  the  schools  adequately  funded  is 
difficult  MPercent  responding.) 

Movements  to  "hold  the  line"  on 
local  prop^rrty  laK  increases .«.»... 
The  inadequate  amount  of  state 
aid  to  local  school  systems  ....... 

The  inadequate  amount  of 
federjl  aid-.   

"  Has  there  been  any  organized  attempt  tn 
the  community  where  your  school  system 
IS  located  to  reduce  or  limit  property 
taxes' 

Yes.  It  has  happened  successfully  ,  • . 
Yes.  it  hav  happened  but 

t     NO r  successfully   . 

No.  but  U  il  likely  to  happen  

No.  and  >t  is  .NOT  likely  to  happen  . 


9 

6 

12 

7 

12 

14 

6 

6  ' 

27 

20 

14 

35  . 

31 

37 

28 

15  " 

3 

3 

4 

5 

2 

4 

3 

2 

61 
• 

72 

71 

53 

55 

46 

\ 

76 

1 

3 

1 

0 

1 

1 

1 

2 

7 

5 

S 

9 

6 

8 

6 

10 

.10 

.8 

7 

12 

lo 

14 

7 

12 

12 

13 

8 

13 

15 

17 

1 1 

69 

73 

/o 

66 

62 

61 

76 

71 

53 

4S 

69 

56 

51 

47 

56 

"  56 

44 

51 

-28 

42 

45 

4S 

44 

40 

3 

1 

3 

3 

4 

5 

1 

4 

27 

30 

24 

14 

35 

14 

29 

39 

13 

15 

15 

14 

9 

8 

13 

It 

34 

40 

36 

39 

26 

43 

35 

21 

27 

15 

'    ^4 - 

^3;- 

29 

35 

23 

22 

ERIC 
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FINANCINGMCONTINUED) 

Region 

1 

Stratum 

V 
\ 

Question 

Total  Norihcasi    Southeast  MiJJtc 

300- 
West  2.999 

yOO(h^  25.0O(>- 
24.999  or  more 

What  percentage  of  your  current  expen* 
diturc  revenues  comes  from  local,  state, 
and  federal  snurco?  (Round  off  lo  the 
nearest  vjhMc  percent.)  (Percent 
responding.)  \ 

tocal  \ 

25  percent  ot  !c>5..>..««  >...*.... 

26  10  50  per^nt  , . , . 

51  10  75  percent..... 

76  percent  or  more  ............. 

Mean  percent  ....<«...,  

Mcdbn  percent  

.State 

25  percent  or  ks«...  

26  lo  50 percent ................ 

51  to  7$  percent   *.x  . 

76  percent  or  more  .... ^ .... . 

Mean  percent  

Median  percent  ..,„.,..>.....  x . 

Federal 

.Mean  percent  ,  

Median  percent  > . . . . 


2} 

10 

27 

15 

i30 

IS 

26 

24 

39 

24 

44 

41 

|43 

40 

37 

43 

28 

43 

2^ 

32 

21 

28 

*  28 

28 

9 

24 

4 

12 

1  6 

14 

9 

4 

44 

59 

39 

48 

40 

48 

43 

42 

45 

60 

35 

49 

|4I 

48 

43 

41 

U 

34 

4 

15 

9 

20 

12 

6 

39 

44 

35 

43 

;38 

40 

37 

41 

41 

20 

60 

39 

•  41 

36 

44 

44 

7 

3 

1 

3 

'12 

5 

7 

9 

49 

37 

S2 

47 

53 

46 

50 

52 

50 

38 

56 

48 

53 

45 

51 

52 

7 

5 

10 

6 

7 

6 

7 

7 

5 

4 

9 

5 

5 

5 

5 

6 

Some  people  contend  that  the  federal 
government's  share  of  the  cost  of  public 
educatior^  must  be  at  least  ^ne>third. 
Would  you  support  or  oppose  that  Con- 
lention*^  (Percent  responding.) 

Strongly  support 
Tend  to  support 
fend  to  oppose 
Strongly  oppose 


28 

23 

14 

12 

18 

15 

21 

29 

37 

25 

19 

Z1 

28 

25 

25 

20 

35 

26 

27 

.^2 

28 

19 

20 

2? 

43 

32 

25 

26 

Docs  your  school  receive  any  DIRECT 
aid  ihtough  any  of  the  following  federal 
aid  programs'^  (Percent  responding 

Impact  Aid  (fo**  children  of 
parents  vkho  live  or  worV 

on  federal  properly)  .  -.  

*  ESFA  rducfliicn  for  I  he 
(^conomtc.Uly'  Fducationally 
Disadvantaged  Children .....  v ... . 


St  39       61      29  40 


94  89  '     92      91       «7  k 
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FINANCINC-(CONTINUED)  U 

,  Region 

Stratum 

30Q- 

yOOO-  25.000- 

Question 

Total  Northeast    Southeast  Middle 

West  2.999 

24.999  or  more 

Educaiicn  for  All 
Handicapped  Children 
Teaeher  Centers  and/of  » 
Teaeher  Corps  

Does  your  Khool  s>'stem  prefer  that  fed- 
eral aid  be  distributed  CATEGORI- 
CALLY as  it »  now.  or  that  it  "be  prorated 
GENERALLY  among  all  school 
s>-stemi? 

Categoiical  aid....  •  

General  aid  -  

A  eombinaiion  of  categorieal  and 

general  aid  .......«..*  

Neither  

U  your  Khool  system  F'SCALLY 
INDKPENDENT  or  is  it  FISCALLY 
DEPENDENT  upon  another  level  of 
government  for  fu^nding?  (Percent 
responding ) 

Fiscally  independent  ...»......>... 

Fiscally  dependent  

Other  »  


73 
12 


36 
62 
2 


57 

7 


4t 

51 


80 
19 


81  53 
16  I 


79 

.  6 


18 
78 
4 


42 

.57 


31 
67 
2 


39  38 
60  61 
I  I 


88 
34 


15 

19 

12 

14' 

14 

16 

l« 

12 

52 

44 

58 

53 

49 

56  • 

50 

48 

31 

32 

28 

32 

36 

23  , 

33 

39 

2 

5 

1 

1 

5 

1 

1 

31 
65 
4 


tvfsing  of  students  and  heating/air  condi- 
lioning  the  sehools  are  two  big  uses  of 
energy  by  the  public  Khools.  What  has 
your  school  system  done  in  eaeh  case  to 
meet  the  increased  costs?  (Percent 
responding.) 

Busing 

a.  Cut  back  the  use  of  ene/gy  .... 

b.  Found  /If  M*  sources  of  revenue 
to  meet  increased  costs   ' 

c  Reduced  services  »n  other  areas 

to  meet  the  increased  costs  

d.None  of  these  

Hcatmgfair  conditioning 
a.  Cut  bJik  the  use  of  enerjjy  .... 
by  Fo u nd  «fH' sources  of  revenue  ^ 

to  HKCt  iiiCrcasVd  costs.  »  

c  Reduced  services  in  other  areas 

(0  meet  the  increased  costs  .... 
d.  None  of  t^ese,  


34 

X7 

25 

36 

33 

42 

33 

27 

*I6 

7 

\  24 

16 

25 

t 

II 

19 

20 

*. 

23 

19 

19 

28 

22 

23 

24 

21 

27 

37 

33 

21 

20 

25 

25 

.^2 

65 

73 

61 

59 

6H 

(A 

68 

6t 

9 

4 

13 

10 

14 

7 

10 

11 

21 

16 

21 

27 

15 

20 

20 

24 

5 

7 

5 

4 

3 

9 

3 

3 

9 
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•  About  one*$ixth  (16  percent)  of  the  school  systems  have  faced  attempts  at  censor- 
ship over  the  la%t  two  years;  however^  only  one^sevenlh  of  those  at  tempts  (2  percent 
of  the  total)  were  successful.  Attempts  at  censorship  occurred  lessoften  in  school 
systems  in  the  Northeastern  rcfion  and  in  small  school  systems. 

•  When  attempts  wcre  made.  in  a  majority  of  the  cases  textbooks  and  library  books 
were  the  main  (arf  ets.sex  and  pornography  were  thcarea  of  attack]  and  individuals 

^  '  ,  in  the.cohimuniiy  acting  on  their  .own  were  responsible.  t 


CCN'SOaSHIP 

*                       Region  4 

Stratum 

Question 

Total  N'ortheasi   Southeast  Middle 

J  300- 
West  2.999 

3.000-  25.000- 
24.999  or  more 

\\m  your  school  system  faced  any 
attempts  at  cemorshlpln  (he  last  two 
years  <i97^79  and  1979-80)? 

4.  • 

Yes,  some  successful  attempts ...... 

Yes.  some  serious  ihrrats  but 
with  Idiie  success  >.«.«..,.......« 

No  X  


If  YES.  answer  each  of  the  following: 

•  Who  was  primarily  responsible  for  the 
censorship  •attempts?  (Percent 
responding  who  uid  above.) 
Individuab  m  the  community 
acting  on  their  ownt . .  .t^ ....... . 

Orpni/ed  group(s)  from  the 
con^munliy  

Orpnized  group(s)  in  the  state 
ikrfrtlng  :his  community ......  v.* 

Orpni/ed  national  foupO) 
targeting  this  community ......... 

•  JVhat  *ere  the  largfis?  (Percent 
7espond»ng  whoutd  "^cs"  above.  Per> 
cents  may  add  to  mo'e  than  ^lOO.) 

Textbooks  

4  ibrary  books  ............ 

'NlUga/ines.  etc.  

S^ii'iC  curriculum  courses 

'Specific  te^chen  or  adminisiraiprs.. 
Other...   


2 

0  • 

0 

2 

1 

2 

1 

■^2  * 

1 

U 

10 

'  It 

II 

23 

5 

13 

28 

84 

90 

82 

S3 

76 

93 

86  ' 

70 

♦ 

71 

iOO 

37  * 

61 

65 

92 

79 

'  59 

22 

'  0 

36 

'23 

22 

8 

18 

28 

4 

0 

.  7 

0 

9 

0^4 

5  * 

4 

S.0 

0 

9' 

4 

0 

0 

8 

56 

57 

52 

62 

67 

48 

59 

59 

57 

f 

tl 

33 

t7i 

62 

49 

11 

11 

19 

0 

33 

10 

5 

40 

22 

50 

24 

50 

33 

38 

44 

9 

0 

14 

10 

4 

25 

7 

5 

9 

0 

0 

17 

0 

10 

10 
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censorshiphcontinuedT 


Rejion   Slratum 

300-   3,000-  25,000- 


Qoc»„on  Total  Nonhea^t   Somheasi    Middle  Wesi  2.999  24.999  X>t  more 


•  What  were  the  fcncral  area(})  of 
attack?  (Pcfceni  respondinj  who  iaid 
•^cs"  abo\c  Percenis  may  add  lo 
more  than  100.) 

Sex  and/or  pornography  

Druf5/tobaccoMlcoho1  . .  ....... 

,  Kellf  ion  ^  ersus  wience  « 

Political  and /or  economic  &>5(ems. .  4 

Race  and/or  ethnicity...,..*  

Sex  role  stereotyping  «... 

<*  Other»«. «....«•:•. •-...•« 


66 

78 

78 

73 

46 

83 

^75 

55 

II 

7 

9 

17 

33 

14 

3 

34 

}S 

71 

18 

33 

33 

39 

'30 

15 

11 

29 

9 

-21 

25 

14 

13 

15 

0 

14 

23 

13 

0 

7 

25 

10 

'0 

0 

9 

21 

8 

^  4 

15 

25^ 

22 

7 

14 

38 

17 

25 

28 

ERIC 
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HM^kapped  Sludcnis 

•  In  over  hair  (55  percent)  of  the  schoil  systems,  handicapped  students  attend  the 
'  school  in  iheir  atlendance  area.  One^flfth  (20  percent)  bus  them  to  selected  school^ 
and  onc'ienth  (II  percent)  have  speciflcally  designed  centers  for  handicapped 
students.  About  one*seventh  (M  percent^  have  no  dominant  practice.  School 
systems  in  the  Southeast  are  slighdy  more  likely  to  send  tl.^m  to  schools  in  their 
attendance  areas. 


Aside  from  a  r<^w  exceptions  (5  percent  or  less),  most  school  systems  provide  for  the 
instruction  of  students  who  arc  speech  im^ired.  deaf  or  hard  of  hearing.  Visually 
handicapped,  mentally  retarded,  serious!)^  tmotionally  disturbed,  orl  hoped ically 
handicapped  or  other  health  impaired. 


Students  who  are  speech  impaired  are  m  ire  commonly  mainstreamed  for  ALL 
instruction  while  studentrwitfiHifirotHcr! handicaps  are  more  likely  to  be  main> 
streamed  only  for  some  instruclion.  Students  who  are  seriously  emotionally  dis* 
turbedare  ipore  likely  than  those  with  other  handicaps  to  have  ALL  instruction  in 
special  classes, 


Ihe  estimates  ofpercentages^of  students  in)he  school  systems  who  have  the  kinds  of 
learning  disabilittcs  deHned  in  P.L,  94-M2  averaged  a  mean  of  8  percent. 


More  th^n  nine^tenthsof  the  ichool  systems  provide  the  following  for  all  or  most 
handicapped  students:  established  procedures  tO' assure  early  identiflcaton  (98 
percent),  individual  education  programs  ((95  percent),  all  education  in  a  "least 
restrictive  environment"  (94  percent),  and  scheduled  time  with  specialists  in  theif 
handicap  (94  percent).  About  rour<flflhs(Hl  percent)  provide  transportation  to  and 
from  school  for  all  or  most  handicapped  students,  rflthough  only  69  percent  of  the  ^ 
large  <^chool  systems  provide  such  transp^rtatiort.  ; 

i 

I 

In  general,  special  provisions  to  help  teaciiers  who  have  handicapped  students  arc, 
available  more  often  for  the  special  education  teacher  than  for  the  regular  classy 
room  teacher.  A  large  majority  of  school  systems  provide  information  on  P.L.94i 
142.  in*service  education,  procedures  to  rrquest  instructional  materials,  help  frorn 
y  specialists,  procedures  for  review  of  placejnenl»  involvement  in  lEP's.  information 
on  due  process  rights  of  parents,  and  help  from  special  teachers  for  both  speciiil 
education  and  regular  classroom  teachen  .  The  three  exceptions  are  as  folIQ^\si  . 

Twothirds  (66  percent)  decrease  the  a  /crage  student  load  for  special  educatu 
teacher's,  but  only  12  percent  for  regi  tar  classroom  teachers. 


Only  two'fifths  (39  percent)  provide 


teacher  aide  or  parent  volunteer  for 


special  education  teacher  when  a  student  is  mainstreamed.  and  only  28  percept 
for  regular  classroom  teachers. 
Only  onc'third  (34  percent)  provide  released  or  compensatory  time  for  spcci 
education  teachers,  but  only  13  percent  for  regular  classroom  teachers 


I. 


26 
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HANDICAP^ 

STUDENTS  (P.L,  H-UZ) 

\ 

*Rction 

Stratum 

Question 

Total 

Northeast    Southeast  Middle 

300- 
W«i  2,999 

3.00O-'  25.000- 
24.999  W  more 

In  fcneral.  how  does  your  «hool  system 
handle  the  education  of  handicapped  stu- 
dents? (Percent  responding,) 

They  attend  the  school  in  their 
ailendan<^  area  

Most  are  hMicd  to  selected  schools  . 

They  attend  specifically  designed 
centers  for  the  handicapped.  

,No  dominant  praaicc...  ...... 


55 

54 

65 

47 

55 

60 

52 

5J 

20  1 

21 

15 

25 

IS 

15 

26 

19 

n 

10 

9 

>■! 

to 

12 

II 

9 

M 

15 

>2  . 

17 

14 

II 

19 

P.L.  94<I42  tries  to  assure  that  each  han- 
dicapped child  is  placed  in  REGULAR 
claiscs  (marnstreamed)\khen  it's  approp- 
riate Id  general,  for  how  much  of  their 
inslrucf  on  are  children  who  have  the  fol* 
lowing  :inds  of  handicaps  mainstreamed 
in  your  school  system**  (Percent 
responding ) 

4*  Speech  impaired 
EUmtntary 
No  provision  for  instruction 
Alt  insTruction  *n 

special  classes.....  

Mainstreamed  for  some 

instruction  

Mainstreamed  for  all 
insiruaion  ...........>.< 

StconJary 
No  provision  for  instruction 
All  instruction  m 

special  claises  

Mainstreamed  for  some 
instruction  ...,....«<..«. 
.Mamstreanxd  for  all 
  instruclio;)  .,...«.«.»)...« 

*    b  Deaf  or  hard,  of  haunp 
Bttmtntary 
No  provision  for  instruction 
All  instruction  in 

special  classes   

Mainstreanried  for  some 
instructiorK 
*  .Mainstream^cd  for  all 

instruction-**  .-^.-.^.^--«-r 


0 

0 

0 

0 

0 

0 

0 

0 

4 

3 

■  3 

3 

3 

4 

4 

2 

34 

32 

41 

32 

36 

42 

26 

36 

62 

66 

56 

65 

61 

54 

70 

63 

0 

0 

1 

2 

2 

1 

0 

3 

3 

3 

4 

5 

4 

1 

Jl 

28 

39 

30 

30 

37 

26 

32 

65 

69 

60 

67 

64 

56 

70 

67 

5 

3 

7 

7 

10 

3 

0 

15 

18 

18 

16 

14 

18 

16 

10 

62 

49 

65 

71 

49 

57 

85 

18 

31 

13 

15 

8 

23 

22 

5 
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HANDICAPPED  STUDENTSHCONTINUED) 

Quettion 

Total 

\  Region 

Stratum 

Noiiheast 

 J  

Southeast 

Middle 

West 

300- 
2.999 

3.000- 
24.999 

25.000- 
or  more 

Stconilarv 

\ 

No  provision  for  msirucfion  . 

5 

1 

7 

S 

II 

5 

0 

All  tnsifuction  in 

12 

14 

17 

13 

9 

13 

13 

9 

MjmMre4med  for  some 

61 

44 

65 

60 

73 

47 

57 

81 

Nfainslresmed  for  all 

tnsif uction  K^t^KKw'***^  « 

22 

17 

21 

10 

30 

24 

1 1 

c  Visually  handicapped 

ElfftJifft  lo/i 

No  provision  fof  in^lfuciion  »«« 

5 

1 

7 

6 

0 

Ail  instfuction  in 

Special  classes  »  , 

12 

14 

14 

13 

l2 

14 

13 

9 

Main^ircimcd  for  some 

insif  uciion 

57 

51 

58 

56 

61 

46 

54 

73 

Mjinsi reamed  for  all 

insiruciion     «    •        •  • 

26 

34 

27 

24 

ii 

1^ 

ii 

26 

18 

Secitmhrv  ' 

No  provision  for  insiruchon  . . . 

5 

1 

7 

7 

8 

7 

0 

All  instruction  in 

9 

10 

13 

10 

10 

11 

8 

8 

Mamsircamed  for  some 

* 

54 

48 

54 

56 

57 

43 

65 

65 

Mainsireamed  for  all 

instruction 

Jl 

41 

31 

27 

26 

39 

28 

28 

d  Mentally  retarded 

Etttntniarv 

So  provision  for  instruction  . . . 

0 

0 

0 

1 

1 

1 

0 

0 

All  instfuction  in 

17 

14 

16 

15 

19 

20 

17 

16 

Mamstteamed  for  some 

Instruction  

79 

U 

84 

81 

76 

74 

82 

81 

Ma inst reamed  for  ail 

inMrcictton   

3 

0 

4 

4 

5 

3 

Sf  con  Jan 

No  provision  for  instruction  .  ,^ 

0 

0 

0 

1 

1 

U 

0 

Alt  instruction  in 

15 

14 

12 

13 

17 

16 

14 

15 

Mamstteamed  for  some 

intiruciKin  . .  .  ,  

SI 

85 

88 

77 

76 

85 

82 

Mainsireamed  for  ail 

4 

1 

0 

5 

4 

7 

1 

4 
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HANDICAPfED  STUDENTSHCONTINUED) 

Region 

Stratum 

300- 

3.000- 

25.000- 

Qgestion 

Total 

Northeast 

Southeast 

Middle 

West 

2.999 

24.999 

or  more 

Scrtously  cmoliofiaily  diiiurbcd 

EUmtnlary 

3 

No  pfovision  for  inilruciion  <>• 

1 

1 

5 

5 

7 

3 

0 

All  insiruction  m 

38 

39 

36 

43 

48 

38 

2S 

31 

M^iinitrcjmcd  for  some 

59 

57 

57 

54 

44 

54 

65 

54 

MfliKticstncd  for  ill 

inilruction  ><><.»«>•«•      ^  ^ 

4 

t 

7 

3 

2 

8 

1 

2 

,  SeconJar} 

3 

So  proviMon  for  loslruciion  .  ^ « 

4 

• 

7 

7 

4 

I 

AH  insiruaion  tn 

28 

37 

35 

34 

38 

44 

36 

Mainsircamcd  for  jomc 

5S 

65 

59 

58 

49 

55 

63 

56 

Mdinurcamcd  for  all  ^ 

4 

' 

6 

1 

2 

f  Orlhopcdtcally  impaired  or 

other  health  impsircd 

fjf/n<n(afv 

No  proviMon  for  i  ml  ruction  -  ■  • 

2 

0 

0 

4  \ 

2 

6 

1 

0 

All  msiruciion  in 

17 

10 

21 

17 

16 

16 

19 

17 

Maimtrcamcd  tor  some 

55 

55 

71 

59 

49 

64 

Mainsircamcd  for  all 

30 

23 

22 

35 

30 

17 

17 

12 

3 

iSo  proviiiori  for  intlruciion  »•■ 

3 

0 

0 

4 

3 

5 

0 

All  instruChon  in 

17 

13 

13 

13 

16 

16 

14 

9 

Mainstreamcd  for  some 

55 

55 

73 

60 

53 

50 

62 

65 

Mainslrcamcd  for  all 

26 

14 

24 

34 

34 

18 

18 

31 

What  do  you  ciKmaic  as  (he  pcrccni  of 

(ludenti  in'your  school  iyHenjwho  have 

Ihe  kmd(  of  learning  disabililici  defined 

in  PL  94- ur 

Lew  Chan  5  perceni  .»,...»..<.... » 

25 

19 

26 

23 

30 

26 

25 

24 

5  10  9 percent. <.>>.«>. <»•  ....... 

35 

33 

36 

37 

38 

35 

36 

32 

15  to  19  percent...  

20  percent  or  more  ......  ^.  ^  •«.• . 

2$ 
8 
4 

8 

30 
12 
6 
9 

A 

7 
6 
H 

28 
1 
4 

8  ^ 

10 
3 
3 

23 
10 
5 
8 

28 
7 
4 
9 

35 
6 
3 
9 

8 

9 

7 

8 

7 

8 

8 

8 

ERIC 
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HANDICAPPED  STUDENTS-(CONTINUED) 


Question 


*>(r3tum 


300'   3.000-  25.000- 

Total  Noilhcasi    Soulhcail    Middle  West  3.999  24.999  or  more 


In  ^9>wAms>^M  ni3n>  handicapped  siu- 
dcnh  are  prmidcd  each  of  the  foi!oMin|t' 
(Percent  responding.) 

a  Trantpotiaiion  to  and  from  school 


For  all  or  most 

sr 

91 

%% 

69 

«6 

85 

69 

% 

\ 

5 

4 

16 

7 

5 

14 

For  more  or  ont>  a  fCM'  . ,    « . 

11 

11 

4 

9 

15 

ID 

17 

b  Ail  education  )n  a  "least 

restriclt\ir  em  ironment" 

lor  all  or  most  .<<. 

94 

95 

S7 

97 

9J 

94 

91 

94 

4 

4 

8 

2 

4 

2 

5 

4 

For  mof  e  or  oni>  a  few  ....... 

3 

1 

5 

I 

3 

4 

2 

2 

c  An  IndiMduali^d  Education 

Program 

97 

loraUur  tnoti  .. 

95 

98 

97 

94 

97 

89 

99 

For  about  half  ...  

2 

\ 

1 

5 

0 

6 

2 

0 

For  nwre  or  only  a  fev%  .  . , . . 

3 

1 

I 

2 

3 

6 

0 

3 

d  Sehedukd  sime  N^ith  $p<eialim 

in  their  handicap 

\ 

horallormmi  

94 

99 

94 

94 

92 

S8 

98 

95 

For  about  half ,    . , 

1 

0 

4 

2 

2 

5 

1 

2 

For  niorf  or  only  a  few    . . . .. 

4 

1 

y 

4 

6 

7 

1 

3 

e  Procedutes  ^vtablithcd  to  assure 

eatly  idcnlirtcaiion 

For  all  or  moit  .«..«........, 

98 

100 

99 

98 

97 

96 

100 

9> 

2 

0 

I 

2 

2 

1 

2 

For  more  or  only  a  feu  ....... 

1 

0 

0 

1 

\ 

1 

0 

r 

what  spceulpto visions  ha\e  been  made 
10  provide  help  for  both  ipf(ia\ tducamn 
trathtrt  and  tf%uhr  chstroorn  teachen 
who  ha\e  handicapped  student)  mam- 
streamed  in  their  elassCor  (Percent 
ropondmg  "yes  0 

a.  Information  to  ALL  teachers  on 
the  implication  of  P.t  94<'l42 

Speeial  education  teachers  

Regular  dastroom  teachers .... 
b  ln«ser\ice  education  on  how  to 
work  with  handicapped  children 
Speeial  education  teachers ..... 
Regular  elasstoom  teachers  . .  ^ . 


97 
86 


95 
81 


97 


92 
89 


100 
^8 


97 
78 


98 
85  0 


94 
81 


97 
92 


97 
77 


97 

89 


92 

80 


97 
85 


96 
81 


98 
84 


98 
80 
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HANDICArrED  STUDENTSHCONTINUED) 

Region 

Stratum 

Qumion 

Total 

Northeast 

Southeast 

Middle 

West 

300- 
2.999 

3.00O. 
24.999 

25.000- 
or  more 

c.  Procedurrt  for  rfqucsiinx  and 
rtcfivm^  appropriate  inslruci tonal 
RUlcnals  ;»nd  cquipmcnl 

Regular  classroom  teachers  .... 

95 
71 

90 
80 

99 

78  ♦ 

94 

70  " 

96 
68 

92 
75 

94 

69 

99 
79 

d,  Procedures  for  rrqufsiinx  and 
rfcrmnx  help  from  a  school 
psychoIo|[isl»  counsclort  or 
other  spccjaliii 

Regular  classroom  teachers  .... 

97 
94 

93 
91 

99 
93 

96 
93 

99 
98 

96 
90 

94 

99 
96 

e.  Released  or  compensatory  lime 
for  the  extra  v*iork  involved 

Regular  cla«sroom  teachers  < . 

34 

n 

34 
IS 

26 
5 

36 
14 

33 
7 

38 

14 

34 
15 

30 
8 

f  Decrease  from  the  average 
student  load 

Regular  claMroom  teachers  > « *  < 

66 
12 

58 
II 

69 
9 

69 
15 

70 
12 

62 

74 
12 

59 
12 

g.  Procedures  for  requesting 
review  of  placement  of 
a  handicapped  student 

Regular  classroom  teachers .... 

94 
87 

90 
86 

96 
93 

92 
86 

97 

88 

90 
82 

95 
89 

96 
89 

h.  Involvement  in  the 
preparation  of  Individualized 
Education  Programs 

Re]|;ular  cbsttoom  teachers .... 

96 
75 

97 
70 

96 
75 

97 
77 

97 
78 

92 
74 

t 

97 
77 

99 
74 

1  Specific  in  for  mat  ion 'provided 
to  all  teachers  on  the  due  process 
rights  of  parents 

Regular  clasUoom  teachers  •  > .  ■ 

94 
77 

90 
75 

96 
82 

95 
76 

96 
81 

92 
75 

95 
77 

96 
81 

|,  Help  made  available  from  special 
<•    teachers  v^henever  it's  needed 

Regular  classroom  teachers  x  > .  > 

83 
78 

86 
81 

85 

76 

81 

77 

80 

77 

81 
74 

83 
79 

84 
81 

k,A  teacher  aide  t^i  parent 
volunteer  assigned  \*.hen  <a  • 
handicapped  student  is 
matnstreamed 
Special  education  teachers  . .  J'. . 
Regular  classroom  teachers  > .  < . 

39 
28 

42 

29 

30 
17 

6 

38 
26 

41 

29 

t 

39 
31 

44 

29 

30 
22 
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iProfcssional  DcvrtopnMnt 


For  oncMhird  (33  percent)  of  the  sehooi  systems,  (he  primary  intent  for  the  prorc%- 
sionai  deve)opment  of  (eaehers  is  to  provide  group  trainmg  that  meets  sehooi 
system  needs.  Another  13  percent  have  the  primary  intent  of  providing  opportuni^ 
tics  that  meet  mdividual  teacher  needs.  Half(50  percent)  give  bolh-of  thcs^^pecial 
attention. 

The  most  commonly  used  provision  for  the  professional  development  of  teachers  in 
1 979*80  were  workshops  or  special  courses  offereH  during  the  regular  sehooi  year  by 
86  pereenl  of  the  school  systems.  Provisions  for  university/ college  extension 
courses  offered  in  the  community  were  made  by  67  percent  of  the  school  systems. 
About  half  provided  for  workshops  or  special  courses  offered  during  the  summer 
(54  percent)  and  a  specified  numbei'  of  days  of  released  time  for  conferences,  cte.  (5 1 
percent).  Only  about  onc«third  provi  tuition  reimbursement  (32  percent)  and 
sabbatical  leaves  (36  percent). 

A  majority  of  school  systems  (63  percent)  REQUIRE,  when  appropriate,  in-servicc 
education  to  prepare  teachers  for  new  curricula.  About  oneMhird  require  it  to 
correct  identified  weaknesses  in  performance  (39 percent).  forstatccertiHcation  (35 
perecntji.  (or  advancennen^  on  the  salary  schedute(35  peTCftnt)..and  for  slate  recertK 
ncation  (32  percent).  Only  about  one-sixth  require  it  to  comply  with  negotiated 
agreements  (18  percent)  and  to  help  fulfill  degree  requirements  ( 17  percent)  Eight 
percent  require  it  to  fulfill  requirements  for  tenure. 
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PROFESSIONAL  DEVELOPMENT 

Region 

Stratum 

300- 

3.000-  25,000- 

QuMiion 

Total  Northeast    Southeast  Middle 

West  2.999 

24.999  or  more 

Which  of  ih<  following  best  describes 
your  sChcol  sy\t<m*i  primary  mieni.for 
ihe  professional  development  of 
leathers'^  (Percent  icipondmg ) 

To  provide  group  training  . 
that  meets  school  system  needs 
(e.g..  preparation  for  new  '  • 
curricula,  training  in  clasi^room 


21 

30 

33 

39 

37 

31  32 

To  provide  opportunities  for 

profnsional  grpwth  (hat  meet 

individual  teacher  needs 

(e.g.,  supporting  anlvanccd 

*  degree  programs,  released  time 

13 

II 

14 

II 

14 

17 

15  5 

Both  of  these  gel  equal 

30 

64 

51 

51 

46 

41 

51  61 

0  ' 

0 

0 

0 

0 

1  0 

3 

4 

4 

4 

5 

2  2 
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fRQFESSlQNAL  DEVELOPMENT~(CONTINUED) 


Rcpon 


Stratum 


Question 


'  '  300-   3.000-  25.000- 

Toul  Norlhcait   Southcajl    MiJdk   Wcsi  2.999  24.999  or  more 


What  specific  provisions  arc  bcin  j  made 
by  your  schooUyMem  in  1979-80  for  ihe 
professional  development  of  teachers? 
(Percent  responding.  Perccnts  may  add 
to  more  than  100.) 

None    2  I 

(University/ college  extension 
courses  offered  m  Ihe  ■ 

community.   67  53 

Some  or  atl  tuition  reioibuiscd 
"  "  •fivV'^iM^'irfo'lIcges  or '  " 

'  universities  »   ^2  57 

Workshops  or  special  courses  * 

offered  during  ihe  regular 

Whool  >ear   "  86  89 

Woikshop\  or  Special  courses 

offered  during  the  summer   54  40 

Staffed  Teacher  Center(s)   17  9 

Unstaffed  Tcjcher  Center^*)   5  3 

A  specified  number  of  sab- 
batical (caves,  cither  for  a  year 

or  a  Vcnicstcr  . .  36  58 

A  specified  number  of  da>s  of 
released  time  for  each  <cachcr 
to  attend  confetcncei.  visit 

other  scho>ls/ programs,  etc.   51  63 

Short  periods  of  released  time 

available  for  individual  study  .....  22  VJ 
A  dollar  allocation  for  each 

teacher  to  unC  for  his/her 

own  professional  dcvcIopmer>t  ....  4  4 
Other.......   9  12 

K  in.vervicc  education  REQUIRED  of 
teachers,  whenever  appropriate,  for  any 
of  the  following  reasons''  (Percent 
responding.  Perccnts  may  add  to  more 
than  100.) 

To  help  fuMll  degree 

requirements.,..   17  I' 

For  Ntatcccilification  ^ . . ,   35  39 

Fof  state  reccrtification 32  19 
Foi  advancement  on  the 

«    siliry  schedule.  35 

fo  fulfill  reMuircmcnts 

for  (enure  ««>   8  15 


83 
40 


72 
22 
8 


44 
32 


I 

12 


28 
49 
53 

28 

6 


3  2  5  2  0 

67  68  54  73  73 

30  18  27  37  29 

80  86  74  89  95 

49  61  28  60  80 


14 

31 

38 

31 

7 


23  7  10  39 
4       5        4  6 


29       35      18       41  51 

48  51  53  54  47 
20       21      18       24  24 


6  3       5        4  2 

7  7       6        9  12 


II 
35 
22 

34 

t 


18 
37 
30 

35 

6 


15 
31 

26 

35 
5 


17 
37 
41 

34 

16 
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fROFESSIO.VALDEVEI.OPMKniT^(CONTlNUEO) 


Rcfion   Stratum  

'  ym-  25.000- 

Question   Total  Northeast   Xomhca>(    Middle  West  2.999  24.999  'or  more 


To  correct  tdentificd  wcak« 
ncs«es  m  pcrrorma6ce.r.. 

To  pieparc  teachers  for 
new  curricula  >  

To  comply  wuh 
mrtoiiated  agreements  « . . 

Other..  


39 

26 

54 

39 

34 

35 

4i 

40 

63 

.62 

64 

59 

66 

'56^ 

67 

67 

It 

25  . 

8 

20 

15 

17 

17 

19 

9 

3 

7 

6 

20 

6 

8 

17 
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42 

TMdMT  EvakfttiMi 


Xlmosl  ninc-tcnihs  of  tf\^t  school  systems  (88  percent)  DO  NOT  requtre  teachers  to 
paw  a  competency  test  before  they  are  cenified  to  leach.  However.  12  percent  have 
such  a  requirement  for  first  cenification  only,  with  almost  one-third (33  perccnt)of 
the  school  systems  in  thc^^outheast  maintaining  thai-  reqifirement. 

Of  those  school  system<  reauirinj  teachers  to  pais  a  competency  test,  most  (94 
percent)  do  so  because  of  a  Mate  requirement. 

Where  the  tests  are  mc&.  about  half  of  the  school  systems  (4S  percent)  said  the 
competency  lest  was  develope<i,by  the  state,  and  a  little  less  than  half  (44  percent) 
said  it  w*s  commercially  developed.  | 

About  half  (53  percent)  evaluate  ALL  professional*  staff  at  least  once  a  year  by 
meahs  other  th*n  a  competency  test.  One-sixth  (17jpercent)  evaluate  only  class- 
room teachers,  with.neatjy  another  onc-fifthXI9  percent)  evaluating  only  some 
classroom  teachers  (e.g..  nontenuredj.  Eleven  perceht  evaluate  all  building-Ievel 
professional  staff,  including  prfncfpals.  | 

Evaluations  other  than  competency  tests  arc  used  by  school  systems  mainly  for 
reappointment/rfismissal  of  teachers  (72  percent),  selecting  teachers  for  tenure  (51 
percent),  and  selecting  teachers  for  administrative/supervisory  positions  (39  per- 
cent). Only  M  percent  use  other  means  of  evaluation  for  advancing  teachers  on  the 
salary  schedule  and  4  percent^for  awarding  merit  payl 


TEACHER  EVALUATION 

Re|to;i 

Stratum 

(^estion 

Total  Northeast   Southeast  Middte 

300- 
West  2.999 

3.000-  25.000- 
24.999  or  more 

Are  clauroom  teachers  m  your  school 
system  requhfJ  to  paw  a.  COMPET- 
ENCY TEST  txfore  they  are  certified 
(Ikcnsed)  to  teach?  (Percent  responding.) 

Yes.  for  first  ccrtificaiion  only  

Yes.  for  recertification  only ^ , ... . 
Yes.  for  both  first  certifi* . 

cation  and  rctcnificaiion  

No  

If  YES.  answer  each  of  the  following; 

•  Is  it  a  state  requirement  or  your  school 
system's  requirement?  (Percent 
responding  who  said  above.) 

A  lUte  requirement  .<....., 

Ou^  school  system's  requfrement  ... 


12 

3 

33 

16 

2 

8 

II 

20 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

8t 

9t 

65 

S4 

9S 

92 

89 

80 

94         100  93         100         0  .  100      95  88 

6  0  7  0      100       0       5  12 
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TEACHER  EVALUATIO.N-(CONTINUED) 

■\- 

Region 

Stratum 

^     •  30O.  3.0OOV-25.0OO- 

Question 

Total  Northeast    SputhcAsi  Middle 

W«t  2.99C  "74.999  or  more  - 

•  Who  wat.rnponiiDk  for  dc>^opinf 
ihe  l«t(or  having  It  developed)?  (Per- 
cent responding  v^fto  $aid  "yts"* 
alxovc )  \ 

The  local  ..\...  

Fhc  itate ,  , 

it  t$  a  cc^mtPercially 
developed  teit 
Other.,.  

W}tich  rnemberf  of  the  profeWonititaff 
are  evaluated  at  least  oncea>yar-  other 
than  by  a  competency  test  -on  the  <)ual> 
ity  of  service  they  providc?^(Perccnt 
rcipondinf.) 


No  one  evaluated 

•peno4ttc«liy  <,<.>...,.  < 
Only  some  classroom  teachei^  \ 

(e     nonienured  ieachers)>,< 
All  classroom  teachers 
All  buildinjflevel  professional 

staff,  includinf  pnncipaK .... 
A'i  professional  staff.......... 

Are  the  results  of  competency  tests  \ 
other  esafuattons  used  for  any  of  the  foJ 
fowinf  .purposes''  (Percent  rcspondini 
Percent s  may  add  to  more  than  100.) 

a.  Not  used  tn  ihis  school  system 
Competency  test  scores  ,«...<. 
Other  evaluations  .<  

b  Reappoint  men  t^dtsniM&al  of 
teachers 
Competency  test  scores 
Other  evaluations  ...  ^ ....... , 

c  Selecting  teachers  for  tenure 
Competency  lest  scores  - « ^ » . . . 
Other  evajuations  ...<«,...... 

d.  Advancement  on  the  salary 
schedule 
Competency  test  scores 
Other  evaluations  «.<>...  x.<> . 

e  Awarding  of  merit  pay 

Competency  test  scores  , , .  , . . 
Other  evaluations 


7 
48 


0  ' 
100 

7 

0 
5.6 

100 
0 

85 

5 
41 

12 

.36 

0  

 59  " 

0 

44 

0 

0 
0 

15 

0 

55 
0 

48 
4 

0 

0 

0 

0 

0 

i 

0 

19 

12 

14 

20 

22 

9 

17 

35 

17 

24 

.  9 

23 

^  14 

29 

15 

5 

I!/ 

10 

*  13 

10 

II 

18 

9 

6 

54 

62  ^ 

4t 

53 

44 

'59 

54 

67 

74 

65 

68 

65 

73 

74 

54 

9 

10 

10 

7 

9 

10 

8 

2 

0 

2 

3 

4 

2 

2 

2 

72 

61 

77 

70 

77 

74 

70 

71 

\\ 

0 

2 

2 

t 

1 

60 

52 

5! 

51 

52 

51 

51 

{ 

I 

0 

0 

2 

2 

1 

2 

0 

24 

16 

9 

14 

15 

12 

15 

2 

0' 

2 

2 

1 

3 

0 

4 

9 

3 

2 

1 

4 

6 

2 

1  * 
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TEACHER  EVALUATION-(CONTINUEO) 

• 

Retion 

Stratum 

Question 

Total  Northeast  Southeast 

Middk 

West 

300-   3.000-  2:000- 
^2,999  24.999  y  more 

f  Selcciinj5'tejchcr$  for 

a<Imjlnivtr4iive'*upef\ivor) 
<  positions 

Competency  lest  scores  , 

Other esjiuations 

......         3           0  7 

39         36      •     53 1 

/ 
3 

30 

5 

43 

1  3 
17  47 

r 

6 

56 

None  of  ibc>c  purposev 
Competency  le^t  »coies  , 

33         32  30 
16         24  12 

32 
13 

37 
17 

30  26 
16  15 

46 
17 
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Dkcrlmlnalion  * 

•  Thrcc-fifihs  (61  percent)  of  ihc  school  systems  have  a  WRHTEN  plan  specifically 
^  designed  to  ehmmaie  titscnmination  against  some  groups  tn  some  arcav. 

•  Of  Ihc  •>€  6i  percent  that  have  a  'Arttten.plan; 

a.  Almost  ail  (94  percent)  si»<ak  to  tntttal  employment  and,lhrcc-fourlhs  (75 
perceht)'io  asstgnmenis  to  av'^imstrattvVx'supervisory  positions.  A  smaller 
majority  speak  ic^scx  role  stereotyping  in  instructional  materials  (70  percent). 

•         and  inirdmuralyinterrpuraUporls  (about  60  percent^,  ' 

b.  More  than  four-fifths  provide  for  female  employees  (87  percent),  female  5tu» 
,            dents  (82  percent)  and^  blacks  (81  percent).  About  jsevcn-tenths  (71  percent) 

provjdc  for  Hijpanicr  and  some  other  minorities.  1 

c.  A  majority  provide  for  national'origin  (82  percent),  religion  (80  percent).' 
physical  handicaps  (80  percent),  age  (78  percent),  marital  status  (6.1  percent).' 
and  political  beliefs  (55pcrccni).  One-third  or  less  provide  for  sexual  preference 

^         ,  (34  percent),  organizational  memberships  (33  percent)  or  life  style  (26 percent )i 


'                                 •     DISCRINtflNATlON  i 

Region 

Siraiur^ 

30O-   3.000-  25.000- 

Quc^iitm 

Total  Northeast  .Southeast  MidAif 

WeM  2.999  24,999  or  more 

Does  your  school  syMem  have  a  WKI F- 
Ft.N  plan  that  uas  specifically  (Jesifned 
to  etiAiinate  dt^crtminjlion  against  some 
jroups  in  some  areai"*  (I'ercenl 
respondinf ) 

Ye<««...i,.«..  

N'o  

* 

If  JfCS.  answer  each  of  ihc  follovunjt: 

•  Are  the' follounjc  qreat  SrCCIFI- 
CAILV  provided  for  in  ihe^pUn? 
(Percent  responding:  uho  $atd  "yes" 
ab<>ve  i'crcents  may  add  to  more  than 
100) 

Initial  employment  ....... ..j^. . .. 

Avsrfnments  lo  adminitifaiiver 

and  supervisory  positions...,  

Jntramurat iports  . 
Intcrmural  iports. . .. , , , 
,.Sex  role  stereoiypmf  in 

inttructioiul  materials  ........... 


61 
39 


68 
32 


58 
42 


53 
4> 


W 
36 


51 
49 


62 
38 


94 

92 

93 

93 

95  ' 

95 

95 

75 

69 

79 

70 

62 

75 

61 

71 

58 

64 

48 

66 

59 

t\ 

71 

67 

65 

51 

61 

(A 

70 

80 

74 

68 

»53 

70 

75 

«6 

k 
4 
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DISCRIMINATJON-(CONTINUED) 


Question 


T^tat  Noflhcast    *^outhc«l  Middle 


30O-  Xm-  25.000. 
Wcsl  2.999  24.999  or  more 


Arc  the  folio* groupx  SPECIFI- 
CALLY provided  for  m  ihe  plan''  ' 
(Percent  respondmy  wh.  <a!d 
abO>c  Percent  may  add  to  moie  twn 
lOO) 

*BU<k4  

'  Httpanict  

Some  other  mmorjUc*  ........ 

Female  employees  

Female  itudentt  

•  Are  the  followtnf  characiffisiicsSPZ' 
CIFICALLY  provided  forintheplan? 
(Percent  Tcipondmf  \vho  said  *>cs" 
abo>e.  Perccnts  may  add  to  more  tlun 
100) 


Age  ...... 

Kclif ion  V . 

Political  beliefs  . , . .  . « •  

Ph>)ical  ^andicsip*  •  ...... 

Marital  statu). «.>.  .  ^ 

Lifestyle.-,......  <,  

Se;tual  preference-  

National  orisin   . 

Organiiational  memberships . 


SO 
55 
80 
63 
26 
34 
82 
33 


—-90 
90 
51 
82 
62 
31 

82 
33 


74 
74 
50 
79 
58 
13 
26 
76 
21 


75 

wr 

59 
75 
65 
33 
44 
77 
35 


75 
80 
45 
82 
59 
I« 
29' 
14 
26 


86 

64 
'  86 
84 
33 
46 
74 
41 


81 

75 

90 

«  79 

84 

66 

^9 

71 

68 

63 

6U 

60 

68 

71 

68 

68 

61 

66 

69 

87 

';i 

95 

85 

86 

88 

,^8 
'  83 

82 

80 

90 

81 

73 

81 

83 
86 
56 
76 
59 
24 
26 
88 
32 


95 
85 

80 

87"" 
82 


67 
70 
46 
80 
50 
22 
34 
82 
28 
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The  following  definitions  are  used:  \  { 

*|jVot  available**:  systekO  does  nol  have  su^h  personnel. 
**,Xvaihbie  only  on  request**:  not  housed  'iVany  schools. 
"Limited  provision housed  in  some  school^  and  available  to  others  on  request. 
^'Fblly  providsd**:  hou^  in  all  retular  schools.  ' 


More  school  systems  provide  for  special  music  and  physical  education  teacher;!^  in 
the  elementary  schools  than  for  special  art  teachers.  One'(burth(26perccnt)donot 
provide  special  art  teachersjwhcrcas  only  5  and  14  percent,  respectively,  do  not 
pr(^vide  Special  music  and  special  physical  education  teachers.  Furthermore,  only 
_  41  percent  fully  provide  special  music  teachers  but  64  and  ^  percent,  respectively. 
fullV  provide  special  music  and  special  ph^'Sical  cducafion  teachers. 


Scvtn'tenths  (69  percent)  fully  provide  special  reading  teachers  in  elementary 
'  $ch(ioIs.  with  only  55  percent  fully  providing  them  in  secondly  ry  schools.  Only  3  an  d 
S  percent,  respcctively./do  not  make  special  reading  teachers  available  at  the 
eleiTKntary  and  secondary  levejs.  \ 

1  \ 
School  nurses,  librarians*  and  guidance  counselors  are  more  hkely  to  be  fully 

provided  at  the  secondary  level  than  at  the  elementary  level.  jj^Imost  all  (96  and  95 

percent.  respccp\cly)  fully  provide  librarians  and  guidance  counselors  in  Jhe 

secondary  schools  whereas  only  65  and  28  percent,  respectively,  fully  provide  them 

in  elementary  schools.  About  one-third  (30  percent)  do  not  ^ven  make  guidance 

counsjelors  available  at  the  elementary  level,  Two-flfths  (42  percent)  fully  provide  a 

schoQl  nurse  in  secondary  school  with  37  percent  making  limited  provisions. 

whereas  pnly  33  percent  fully  provide  a  school  nurse  in  elementary  schools  with  45 

pcrccrit  inaking  limited  provisions.  .  ! 

Most  :^hool  systems  make  some  provision  for  a  psychologist  (94  percent)  in  both 
elementary  and  secondary  schools,  with  only  about  one -third  (32  percent)  making 
full  provisions.  Only  half  (about  50  percent)  make  psychiatrists  available  and  then 
primarily  upon  request,  with  only  10  percent  makingat  least  limited  provision  for  a 
psychiatrist  at  both  levels.  '  ^ 

One-third  do  not  make  a  social  wo^er  available  at  either  the  elementary  or 
secondary  levels  (33  and  35  percent,  respectively).  About  40  percent  make  at  least 
limttcdj  provision  at  both  levels^ 

More  than  half  (57  percent)  fully  provide  a  speech  lherapist'|at  the  elementary  level 
and  almost  half  (47  percent)  at  the  secondary  level.  Only  about  I  percent  make  no 
provisjon.  1 

Teacher  aides  and  unpaid  volunteer  aides  both  are  more  hkcIy  to  be  madeavailable 
at  the  elementary  level  than  at  the  secondary  level  About  palf  (52  percent)  fully 
provide  teacher  aides  at  the  elementary  level  with  another  42  percent  making 
'  limited  provisions.  At  the  secondary  level  40  and  38  percent,  respectively,  make  full 
and  l|mited  provisions.  Almost  seven -tenths  (70  percent)  make  at  least  limited 
provmon  for  unpaid  volunteer  aides  at  the  ^elementary  level,  whereas  only  about 
half  (l>0  percent)  make  such  provisioris  at  the  secondary  level. 
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6PtCIALIST$ 


Region  Stratum 

30O-   3.O0O-  25.000- 

Q^,^,on   Total  Northeast    Southeast    Midd'c  West  2.999  24.999  or  more 

To  what  extent  are  wh  of  the  following 
jpccial  kindJ  of  SCHOOL  PERSON- 
NEL made  available  to  the  schools  in 
your  school  system? 

Not  a\ailiible— 5>$iem  does  not  .     '  \  • 

fuve  juch  personnel  ...........>• 

Available  only  on  request -not  .  \ 

housed  in  any  schools  « ■  - 

Limited  provision-  housed  m 

some  schools  and  available 

i*^  ethers  on  request  .<.*«<.....*>• 
Fully  provided— housed  in  all 

rfgular  schools  .«.■■    '  ~  "  ~ 

a.  School  nurse  _ 

tfrrnfntary  It  14         6      U       10  8 

Noi  avaiUble  ......  lU  ■>  9      16        9  H 

Availableonlyon  request  .....        12  0  15-  ^ 

Limited  provision.......   «         3  w 

Fully  provided  ^3         61  ^5 

^'If*'^'''     ,  ,0  I  20  14        5      13       10  7 

Available  only  on  request  "1  '  '  37      36       34  4^ 

•  42    Jo     30    26  4s  36  50  50 

b  Librarian 

Elemtniary  4  9  3  ^3 

Not  available        «H. .  ^          ^  t5323 

Availatle  only  on  request   3           1  0            ^  ^7  31  28 

Limited  provision   29         JV  ^            68  52      6$  61  66 

Fully  provided   ___  Z„ 

.»^ot  available, ........ 0  0  0            J  q       0  0  0 

Available  only  on  request   0          t>  "            "  4?  i"  3 

S;p,oT;r:.::::;:::::::  4    «     97    9s  95  9.  .9, 

c  Guidance  counselor 

^<wnrfl.r  10  33  28  30  32     22  37  29 

Not  available   3U  ^*  n  11      II  7  7 

Available  only  on  request  .....  9  p  ^  ^5  31  47 

Limited  provision  71  -><  41  25  17 

Fully  provided   28  38  24.  25  28     41  25 

Secondary      '  ,  ri  1  I  I       3        I  0 

Not  available  H  rt  1         I        I        0  0 

Available  only  on  request  .....         ^?  ,  60«22 

■    l^itSd'!.".::::::::::::  95    95     9*    92  9.  ,«  97  99 


276 


271 


49 
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SrECIALISTS-KCONTINUED) 

0 

Question 

eglon 

Stratum 

Total 

Nortl;ed>t 

Southeast  Middle 

West 

30O- 
2.999 

3,000- 
24.999 

25.000- 
or  more 

o 

Elemenlan  , 

6 

J 

9  5 

7 

11 

5 

1 

Available  Jt\\y  on  ffquni  . . 

n 

23 

40  31 

44 

33 

30 

38 

29 

29 

23  31 

23 

29 

25 

36 

46 

28  33 

27 

-i 

40 

26 

Secondary 

6 

>  5 

7 

12 

5 

1 
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Ms.  Robinson.  The  suppliers  of  these  group-administered, 
normal,  reference-standardized  exams  at  this  point  have  a  relative- 
ly free  hand  in  the  way  these  tests  are  constructed  and  used  based 
on  their  appeals  to  decisionmakers  of  tests  purchased. 

We  are  pleased  to  note  that  some  reform  is  currently  undetway 
within  the  testing  enterprise  itself,  and  we  are  somewhat  encour- 
aged..  However,  we  do  not  see  that  this  bill  would  in  any  way 
impose  on  the  legitimate  uses  to  which  tests  currently  have  been 
applied. 

In  fact,  we  find  that  this  bill  would  encourage  greater  reform 
and  greater  scrutiny  from  within-the  industry  itself. 

touring  this  time,  the  political  environment  that  we  might  now 
observe,  when  a  theory  and  an  unproved  theory  of  supply-side  eco- 
nomics beiog  applied  to  every  aspect  of  human  endeavor,  we  would 
urge  this  panel  to  look  closely  and  resist  any  temptation  to  apply 
this  economic  theory  to  the  yet  unsound  and  unproved  definitions 
of  many  of  the  tests  that  I  have  indicated  are  currently  in  use. 

Intelligence  tests,  aptitude  tests,  and  reading  readiness  lack  clear 
technical  definition  within  the  industry  itself  Therefore,  our  rush 
to  apply  objective  measure  has  to  be  cautiont  .  I  find  that  in  this 
debate  we*^  might  be  faced  with  .a  rather  common  conflict  of  values, 
that  being  a  conflict  between  our  need  for  effective*  and  objective,  if 
you  will,  measure  of  our  human  endeavor  and  some  other  less 
easily  measured  yet  cherished  values.  ' 

Can  we  indeed  apply  high  technology  industrial  model  of  produc- 
tion to  every  human  activity?  And,  indeed,  if  we  can,  are  we  will- 
ing to  pay  the  cost  of  that  application. 

.  This  bill  is  opposed  because  it  will  be.  financially  inconvenient  to 
test  developers,  and  indeed  to  some  test  users,  but  given  the  choices 
that  we  have  to  make  and  given  the  values  that  we  might  apply  to 
our  decisionmaking  process,  I  would  urge  greater  consideration  for 
the  individual,  for  the  productivity  and  support  of  our  society 
rather  than  for  financial  considerations  of  industry. 

Thank  you.  I  Ipok  forward  to  questions  and  interaction  with  the 
panel.  i 

[The  prepared  state njcnt  of  Sharon  Robinson  follows:]  * 
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Pkkpakco  Statement  or  Sharon  Roiinson,  Dircctor  or  Instruction  and 

PROrWUIONAI,  Df VKLOfMENT,  NATIONAL  EDUCATION  ASSOCIATION 

Mr.  Chainwn,  I  «n  Sharon  Robinson,  Director  of  Instruction  and  Professional 
Development  for  the  National  Education  Association.    1  am  pleased  to  have  an 
opportunity  to  testify  in  support  of  HR  1662.    We  want  to  compliment  Mr.  Weiss 
and  the  cosponsors  of  HR  1662  for  their  cownitment  to  equal  educational 
opportunity.   Our  members  are  greatly  concerned  about  the  problems  of  testing. 
Your  willingness  to" advocate  a  major  change  to  open  up^coUege  adnisslons 
testing  to  public  scrutiny  will  assist  parents,  students,  educators,  and 
the  public  in  understanding  the  issues  surrounding  testing. 

f 

NEA  believes  that  there  is  an  urgent  need  for  the  Congress  to  enact 
HR  1662.   We^favor  the  bill  because  we  believe  it  will  improve  access  to 
Important  information  needed  by  the  public. and  the  education  profession  to 
scrutinize  college  aptitude  tests.   Too  5»any  of  the  nation's  youth  and  their 
parents  are  deprived  of  infonnation  about  the  testing  process  which  affects 
them  directly,^  Openness  in  testing  or  "truth-in-testing"  would  be  \  major 
step  in  providing  students  who  take  these  tests  with  the  knowledge  of  what  to 
expect  and  allow  teachers  and  parents  to  have  the  best  possible  infonnation 
-available  to  help  students  prepare  properly. 

The  NEA  believes  that  all  standardized  tests  adninistered  by  school 
districts  must  be  open  to  public  scrutiny.   We  believe  that  the  enactment  of   .  < 
HR  1662  would  be  an  important  step  to  open  up  the  entire  testing  process  in 
this  nation. 

The  NEA  supports  HR  1662  because  we  believe  it  will 

•  provide  infonnation  where  there  has  been  secrecy; 

•  serve  as  the  basis  for  discussion  of  the  serious  issues 
surrounding  testing; 

^  result  in  improvements  'in  substance  and  process  in  assessing 
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student  aptitudes; 

•  contribute  to  fairness  by  providing  students  with  an  opportunity 
to  verify  their  test  scores,  to  coftipare  their  responses  with 
those  required  by  the  test  companies,  and  to  make  sure  that  tests 
are  accurately  scored; 

•  bring  about  improvements  in  the  test^t  and 

•  lead  to  the  utilization  of  a  varijety  of  viaole  alternatives. 

The  9,000  delegates  to  the  1981  NEA  Representative  Assembly'adopted  four 
resolutions  on  testing.   :;rhey  are  attached  to  this  statement  in  Appendix  A, 
In- addition  to  the.  resolutions  the  delegates  adopted  a  legislative  program 
which  included  the  followfftg  item.  — . 


"Standardized  tests  shoula  not  be  used  to  deny  students 
full  access  to  equal  educational  opportunity  to  evaluate 
students  on  a  single  national  or  state  basis.  Truth-in-testing 
legislation  should  be  passed  and  the, Congress  should  investigate 
the  standardized  t^^ting  industry." 

Those  who  design,jTOrket,  and  in  nany  cases  administer  and  interpret 
thJ  tests  must  be  accountable.  ,  \ 

1  They  must  be  accountable  because  children,  the  public,  and  the  teachers  need 
protection  from  tests  which  much  too  frequently  contain  awkward  items,  ambiguous 
>ter.,iihology,  and  stark  inaccuracy.    If  the  tests  were  not  used  to  make 
decisions  about  students  so  important  that  theSr  entire  life  chances  may  be 
effected,  it  night  be  different.   But  tests  in  general  are  used  to  rank,  group, 
and  track 'StLden.tl.    They  are  u?.ed  to  promote  and  retain  students.    They  are 
used  to  grant  and  deny  diplomas.   Students  are  admitted  to  programs  for  the 
gifted  on  the  basis  of  test  scores.    They  are  placed  in  remedial  and  retarded 
classes  on  the  ba^is  of  tests.    Individual  schools,  school  systems,  and 
total  state  educational  efforts  are  judged  on  the ''basis  of  tests. 

All  thtse  things  happen  in  the  name  of  aptitude  assessment,  more  recently 
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renamed  developed  abilities  by  some  testing  agencies.   The  tests  being 
considered  here  measure  neither  aptitude  nor  general  abilities.   They  «re 
achievement  tests  pure  and  simple.    One  has  only  to  examine  items  in  the  verbal 
part  of  the  SAT.    Large  proportions  of  these  require  vocabulary  identification, 
learnable  by  almost  all  students  given  the  opportunity  and' the  time. 

In  particular,  the  so-called  aptitude  tests  to  which  the  proposed 
legislation  will  apply  are  used  in  ways  that  deny  students  idmissfon  to  ' 

s  \ 

*  particular  institutions  and  prevent  their  pursuing  specific  career  objectives. 
Such  denials  frequently  reflect  an  exclusionary  posture  that  is  unfair.  It 
is  unfair  because  denials  are  often  based  on  criteria  which  represent  past 
socio-economic  flatus  and  opportunity  rather  than  future  potential.  The 
findings  of  Alan  Nairn  in  the  1980  study  of  the  ^Scholastic  Aptitute  Test  will 
illustrate  how  the  test  results  reflect  socio-economic  disparities.   The  study 
repnrts  that  "A*  Ranking  of  people  by  SAT  scores  remains  by  and  large  a  ranking 
by  family  income."   


And  it  goes  on  to  say  that  "Although  it  is  advertised  as  a  test  of  'scholastic 
aptitude'  and  although  it  is  used  by  colleges  to  accept  anfi  reject  applicants 
ostensibly  on  the  basis  of  merit i  for  ^lany  students  the  SAT  may  be  more  a 
reflection  of  their  social  class  than  of  thefr  potential  for  accomplishment 
inside  or  beyond  the  school.* 


These  discriminatory  effects  of       so-called  aptitude  tests,  particularly 
on  poor  and  minority  students,  threaten  to  rot^  the  society  of  some  of  it^ 
highest  potential  leadershipi  particularly  when  one  considers  that  test  scores 
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do  not  predict  success  In  later  life.    In  the  unique  pluralistic  society  that 
is  America,  we  needto'seek  means  which  will  open  doors  for  a  broader  range 
of  contributions  to  the  body  politic  from  the  broadest  range  of  diverse  back- 
grounds  ¥h1ch  we  as  Americans  cherish.   NEA  bftlieves  this  will  eventually  be 
btst  iccoBpllshed  by  substituting  for  tests  a  variety  of  multiple  criteria 
for  decision-making  about  students.  But  as  that  is  being  worked. at,  wt  believe 
the  proposals  In  HR  1662,  If  adopted,  will  provide  access  to  the  test^  them- 
selves  and  a  scrutiny  heretofore  impossible.   Such  scnjtir\y  will  cause  ^ 
pMblic  policy  makers -and  the  profession  to  make  haste  to  employ  a  broad  range 
of  alternatives  which,  in  the  long  run,  will  be  more  accurate,  more  fair, 
and  more  contributing  to  <ncr^as1n9  the  pools  of  talent  required  in  many  walks 
of  life  in  America.^ 

In-the  broader  sense,  {lEA  Is  concerned  that  the^nation's  schools  are 
inundated  by  by  norm  referenced,  group  administered,  standardized  tests  (of 
•»  which  aptitude  tests  are  a  parf)  and  that  thfse  tests  have  lome  to  control  and  narrow 
the  options  of  local  school  decision-makers  on  both  curriculum  and  instructional 
processes.   Local  contV^  of  education  by  parents,  educators,  and  elected 
lofcal  officials  is  being  usurped  by  the  products  of  testing  firms,  firms  which 
are  not  accountable  to  any  electorate. 

Standardized  testing  has  become  pervasive  in  A.nerican  educWion.  Students 
in  8ft  percent  of  our  schools  are  required  ,to  Uke  standardizedv5<^ievement 
tests  according  to  a  1980  study  by  NEA*s  Research  Division.   Only  onr  percent 
of  the  school  districts  reported  that  they  did  not  idmiftistej:  sUndardized 
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^chievefncnt  tests.   Stindardized  intelligent.?  tests  are  used  by  81  percent 
of  the  n^;tfon's  school  districts  while  95  percent  use  standardized  reading 
readiness  tests.    It  is  clear  from  NBA's  research  that  there  are  few 
schools  indeed  in  this  nation  which  do  not  administer  or  require  students 
to  t*ke  some  form  of  standardized  tests.  ^   

Congress  has  passed  few  education  laws  which  do  not  require  sotjie 
fonii  of  "objective"  measures.    In- almost  every  instance  these-  "objective" 
measures  are  interpreted  as  standardized  tests.    In  its  effort  to  reconcile 

the  federal  budget  last  month*  the  House  adopted  language  for  "objective 

...  ^ 

measures  of  educational  achievement"  which  if  adopted  in  the  final  version  , 
would  probably  lead  to  an  annual  nationwide,  ^tate  administ|ired»  locally  based 
Standardized  test  of  student  prdJgress  in  basic  skills.    Ir|  ESEA  Title  I» 
this  approach  has  not  proven  to  be  satisfactory.    Local  results  show  a  clear 
improvement  on  standardized  tests,  but  no  satisfactory  way* has  been  found  to, 
aggregate  these  scores  nationally.   Those  who  have  promised  to  take  the 
government  off  the  backs  of  the  people  have  adopted  an  intrusive,  narrow,  and 


onerous  method  of  assessing  public  education. 

I 

We  are  concerned  that  .the  direction  of  education  in^er^ca  is  being 
controlled  by  standardized  tests.   Many  teacheVs  express  the  opinion  that 
school  districts  place  too  mud^  t>mphabts  upon  standardized  tests.    In  a 
survey  of  a  major  school  system  in  Texas',  60  percent  of  th^  teachers  stated 
that  there  was  prcs&ure  to  raise  test  scores  at  arr^  cost.  ' 

Hany  of  these  teachers  wrote  unsolicited  comments  upon  the  survey  form, 
^    such  as,  "The  pressure  of  test  scores  has  caused  great  stress  and  anxiety." 
Another  said,  "We  have  spent  this  entire  school  year  teaching  ^or  tests.  We 
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have  relthe.d  the  point  that  we  are  no  longer  teaching  test  taking  skills  but 

•  9 

for  all  practical  purposes,  we  are  teaching  the  test.".  A  third  educator 
said,  "I  have  no  time  to  cover  content  areas  because  I  am  always  teaching 
for  the  test."  -  ^      '  , 

Parents  have  almost  come  to  accept  a  computer  printout  of  their  child's 
test  scores  {ranking  him  or  her-agUnst^a  national  sample)  as  a  full  measure 
7 of  the  child^s  education  progress" and  potential.   NEA  objects  to  the  use  of 
or  other  standardized  test  scores  as  an  indicator  of  scholastic  aptitude 
or  as  a  measure  of  the  quality  of  American  education.   We  believe  that  the 
results  of  these  tejits  do  qot  accurately  reflect,  jei^ther  .the  quality  of  the 
schools  qenerally  or  the  learning  progress  of  students  specifically. 
'  Ue  remain  steadfast  in'our  support  of^HR  1662  and  our  opposition  to  the 
secrecy  and  apjxjication  of  norm  referenced,  grj)up  administrered,  standardized 
tests— regardless  of  whether  scores  are  going  ^u^  or,  down.    Our  considered 
judgment  .is  that  the"  SAT's  do  more  ham  than  ^ood,  ^  ^  ^ 

NEA  support^.ftR- 1662^  because  it  will  requi^'e  testing  companies  to  provide 

linfonnation  to  substantiate  claims  made  fo,r  their  products.    One  important 

/ 

exaniple  pf  the  need  for  information  is  the  coaching  study  done  by  the  Federal 
Trade  Connission  (FTP).   NEA  along  with'sevepal  other  education  organizations 
exerted  pressure  upon  the  FTC  to  release  data  pertaining  to  the  effe'^t  of  ^ 
coaching 'upon, SAT  and  PSAT  scores  which  we  wire  unable  to  secure  froiA  the 
testing  companies  themselves.   After  repeated  reqi/tests  and  a  Freedom  of 
Irtfor-jiation  complaint,  the  FTC  released  raw  data  to  the  NEA.   However,  it  wasn't 


until  this  spring  that  the  FTC  published  its 
effect  upon  test  scores. 


own  report  on  coaching  ind  its 
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The  coachabUity  of  standardized  tests  was  the  subject  of  an' NEA  study 
reported  in*1980.   A  copy  of  that  study  has  been  provided  for  the  record. 
The /Study  was  an  Independent  analysis  of  .an  FJC  data  base  created  initially 
to,' investigate  the  claim  that  coaching  does  improve  individual  test  score 
^er'form^nce  on'The  SAT  and  PSAT, 

V  Based  on  these  analyses,  NEA  reported  a  significant  difference  between 
the  test  score^perforMnce  of  coached  and  noncoached  student  groups.!  In  ^ 


all  anal^6f\,  SAT  averages  were  higher  for  coached  than  for  noncoachted  groups. 
Iti  near.l><a^  analyses,  the  differences  were  statistically  significant.  This 
being  so, one  must  ask  "What  of  the  s^tudents  whose  parents  can't  afford  expensive 
private  coaching  schools?    What.kii^d  of  fairnessl  doctrine  does  th^is  provide 


ng  schools?  What,kiijd  of  fairnessl  d 
al  income  was  the^onl  characteristic 


then?"   Parental  income  was  thejon^  character ist\c .external  to  S^T  and  PSAT 
scores  which  appeared  a^  a  slgnk^antly  discriminating  variable.    For  example^ 
the  greatest  average  ^ain  report^  for  total  scores  was  foun^  for  students 
fn  1976  who  were  coached  between  the  PSAf  and  the  first  time 'they  took  the' 
S/T  and  whose  average  family  income  was  $29,000.    For  this  group  an  average 
gain  of  143  points  was  fou.id.    This  confirms  the  Nairn  findings  I  cited  earlier. 

Mr.*  Chairman,  the  NEA  endorses  openness  in  all  standardized  testing.  We 
belli^ve; 'tlTat  standardized  te-ting  h^s  become  accepted  as  k(\  aliriOj»t  infallible 
measure  of  education  progress  by  the  media,  by  parents^  and  by  students  who 
are  caught  in'the  testing  "secrecy  trap."   The  example  alone  of  their  coach- 
ability  discredits  such  infallibility. 

NEi^.^  supports  HR  1^62J»ccause  we  believe  that  its  enactment  will  provide 
a  first  step  to  opening  up  all  standardized  t^ts  to  public  scrutiny.    It  will 
provide  information  where  there  has  bee'n  Itcrecy.    It  wi)l  provide  accountability 
where  there  has  been  arrogance.    It  will  provide  a  basis  for  productive  dialogue 
on  colUge  aptitude  tests  based  upon  relevant  Informatjdn  and  data.    Above  all> 


/ 

■       -  '    ■  28/ 


JC   ^/ 


282 


-  8  - 

it  will  contribute  to  the  fairness  of  these  tests  becausejt  will  provide 
all  studtnts  with  mofc  equal  opportuni ty  in  preparing  for  and  submitting  to 
the  tests.    It  will  provide  elected  officials,  professional  educators,  parents, 
and  students  with  the  information  necessary  to  judge  whether  or  not  standard! zed^" 

*  testing  as  presently  practiced  should  determine  the  future  educational  and 
career  opportunities  for  riillions.   And  we  are  prepared  to  abide  by  these 
judgrents,  because      have  ^aith  th^U  rf^asonablA  npnnlft.viill  co''c1u'*e»  as 

«    the  research  cited  earlierhas  concluded,  that  the  tests  are  more  a  measure 

'^^of  social  class  than  student  potential. 


0 


o 
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E-20.  ^Accountabili ty  and  Assessment 

The  National  Eaucation  Association  recognizes 
that  the  term  accounted  itity  ^  as  applied  to  public 
education,  is  subject  to  varied  interpretations.  The 
Association  riaintains  that  educational  excellence  for 
each  child  is  the  objective  of  the  education  system. 
The  Association  believes  that  classrV^n  teachers  can 
b3  accountable  only  to  the  degree  thaVother  parties 
who  share  this  responsibil ity--legislator.s,  other 
government  officials,  school  boards,  ao'ministrators , 
parents,  students,  and  taxpayers— are  also  held 
accountable. 

The  Association  believes  that  there  should  be 
no  single  or  statewide  accountability  system.  It 
will  resist  any  atterrpt  to  transform  assessment 
results  into  a  national  or  state  testing  program 
that  would  seek  to  measure  afl  students ^  teachers^ 
or  school  systems  by  a  single  standard  and  thereby 
impose  upon  them  a  single  prog^an1,^  rather  tjijn 
providing  opportunities  for  multiple  programs  and 
objectives .   The  Association  believes  that  specific 
behavioral  objectives  should  not  be  used  as  course 
objectives,  nor  as  a  basis  for  detennining 
accountability.  ' 

The  Association  opposes  the  unquestioned 
pursuit  of  behavioral  objectives  and  insists  upon 

a.  A  critical  examination  of  the  effects  of 
use  of  behavioral  objectives 

b.  The  identification  of  areas  where  behavioral 
objectives  are  useful  but  not  harmful 

c.  The  acceptance  of  alternative  statements 
of  objectives 

d.  Recognition  that  evidence  of  learning  is 
not  always  available  upon  request  or  demand 

e.  Recognition  that  performance  criteria  are 

not  always  uniformly  or  universally  applicable 
to  a  given  population.  (7U76) 
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H'-IO.  Testing 

The  National  Education  Association  recognizes 
that  testing  of  students,  preschool  through  job  entry, 
may  be  appropriate  for  such  purposes  as  — 

a.    Identifying  learning  needs 

.  b.   RecofTwendin^  instructional  activities 

Describing  student  progress. 

The  Association  opposes  the  use  of  tests  that 
deny  students  full  access  to  equ.^l  educational 
opportunities  or, that  are  used  'to  evaluate  teachers. 

The  Association  believes  that  standardized  tests 
should  not  be  administered  when  they  are 

a.  Potentially  damaging  to  a  student's  self- 
concept 

b.  Biased 

c.  Used  as  the  only  criterion  for  student 
placement 

d.  Invalid,  unreliable,  or  out-of-date 

e^    Used  as  a  basis  for  the  allocation  of  federal, 
state,  or  local  funds 

f.  Used  by  testing  companifc'  '^r  publ ishers"  to 
promote  their  ov/n  financia}  ■'nterests  at  the 
expense  of  sound  educational  uses 

g.  l^sed  to  compare  individual  schools 

h.  Used  In  an  exploitive  manner  by  the  media 

i.  Used  as  the  sole  criterion  for  graduation 
or  promotion 

,  J,    Inappropriate  for  the  use  intended 

k.    Used  as  a  criterion  for  the  development 
of  a  state  system  of  classif-ication  of 
schools  and/or  school  systems.  (78,80)' 


H-n.    Criterio^i-Referenced  Tests 

The  National  Education  Association  believes  that 
criterion-referenced  tests  are  a  viable  alternative 
to  standardized  norm-referenced  tests.    Such  tests 
should  be  designed  to  describe  student  performance 
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based  on  carefully  developed  cujjriculum,    It  is 
inappropriete  to  administer  criterion-referenced  tests 
that  do  not  specifically  measure  instructional  content. 

Staff,  ti/re,  instructional  materials,  and  other 

resources  should  be  provided  to  assist  students  who 

experience  difficulty  achieving  the  desired  criteria 
reflected  by  tests.  (80) 


H-12.    Truth  in  Testing 

The  Nati'onal  Education  Association  believes  that 
intelligence,  aptitude,  and  achievement  tests  have 
historically  been  used  to  differentiate  rather  than  to 
measure  performance  and  have,  therefore,  prevented 
equal  educational  opportu.iities  for  all  students, 

particularly  minorities ,  lov;er  socioeconomic  groups,  ^ 

and  v.'OfTTen.    Contemporary  research  on  the  structure  of  ^ 

the  intellect  identifies  multiple  and  varied  mental 

operations  and  advances  the  significant  premise 

that  these  operations  can  be  taught,  that  Intelligence 

is  dynamic  rat^j^r  than  fixed. 

The  Association  further  believes  that  the  truth- 
in-testi.ig  movement  is. an  important  step  for  bringing  ^  " 

about  long-needed  test  reform.   Therefore,  it  urges  all 
state  affiliates  to  strive  for  passage  of  truth-in- 
testing  legislation  that  includes  a  provision  for  each 
individual  test  taker  to  receive  a  copy  of  all  test 

questions,  scores,  and  rationale  for  correct  ansv/ers.  (80)  , 
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Mr.  Weiss  Thank  you  very  much,  Dr.  Robinson. 

First  of  all,  Dr.  Cabteen,  let  me  express  my  enthusiastic  support 
of  the  effort  that  you  have  described. 

The  only  question  I  have  is  that  I  thought  that  you  had  men-' 
.  tioned  in  your  statement  that  you  had  a  list  of  the  proposed  au- 
thors or  researcners,  but  I  don't  find  that.  *  . 

Mr,  Casteen.  I  may  have  spoken  imprecisely.  We  have  described 
the  kinds  of  people  with  whom  we  are  negotiating.  Our  concern  of 
releasing  a  listing  of  persons  with  whom  we  are  talking  before  we 
have  a  commitment  may  drive  away  competent  persons  whom  we 
would  like  to  recruit. 

Mr.  Weiss.  The  only  potential  problem  is  who  is  selected  to  do 

those  studies.  ,  .    ,  ,  r 

Mr.  Casteen.  In  the  prepared  statement  I  explained  the  areas  ot 
possible  mismanagement  that  we  see  in  the  project.  We  see  this  as 
a  volatile  area  and  we  think  parties  on  both  sides  of  this  discussion 
v/ill  have  ample  notice  to  try  to  win  a  debate,  if  this  becomes  a 
debate. 

We  don't  want  to  go  that  way.  We.  want  to  try  to  engage  aca- 
demically and  professionally  competent  persons  who  can  work  with 
the  guidance  of  a  steering  committee,  the  kind  of  committee  in 
which  we  would  hope  at  some  point  to  involve  persons  like  you,  to 
see  to  it  that  what  is  produced  is  a  thoughtful,  dispassionate  docu- 
ment that  might  indeed  serve  as  a  basic  public  document.  The  pit- 
falls are  tliere. 

Mr.  Weiss.  Ithink  it.is  a  very  welcome  approach..        ,    .|  . 

One  of  the  aspects  of  this  whole  discussion  about  this  legislation 
and  its  predecessor  that  I  commented  on  previously  is  the  discon- 
certing sight  of  otherwise  independent,  intelligent  professional 
people  taking  marching  orders  as  to  what  their  position  ought  to  be 
on  a  specific  issue.  '  .  n 

Now,  my  own  prejudices  lead  me  to  believe  that  they  were  all 
primarily  op  the  part  of  those  opposed  to  this  legislation,  and  I 
know  that  whenever  the  College  Entrance  Examination  Bokrd 
senses  that  there  was  a  hearing  coming  on  or  legislation  being  in- 
troduced, letters  and  telegrams  would  be  sent  to  college  and  uni- 
versity presidents  telling  them  what  their  positions  ought  to  be 
and,  almost  uniformly,  those  college  presidents— without  any  inde- 
pendent valuation  of  what  the  legislation  was— would  feed  back  to 
us,  Members  of  Congress,  precisely  the  arguments  that  ETS  or  the 
bureaucracy  of  CEEB  had  decided  upon. 

That  is  a  problem  and  1  hope.your  study  can  lend  some  light  and 
objectivity  to  this  whole  question.  ,      ,    i  n 

Mr.  Casteen.  I  think  the  object  of  it  is  crucial.  I  don  t  really 
know  enough  to  argue  either  way,  but  it  may  be  useful  to  observe 
that  the  other  side  has  also  tried  to  recruit  probably  the  same  pop- 
ulation to  argue  on  the  opposite  side  of  the  question. 

It  is  a  fact  that  we  in  education  who  have  some  kind  of  ongoing 
stake  in  the  quality  of  what  happen^  to  children  in  schools  are 
fearful  of  changes  that  may  have  the  effect,  and  I  have  to  empha- 
size *'may,"  that  may  have  the  effect  of  taking  away  the  indicators 
that  we  have  been  able  to  use  to  try  to  judge  where  we  are  and 
where  we  need  to  go,  and  it  is  the  uncertainty  about  the  effects  of 
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the  legislation  and  the  .uncertainties  of  separation  of  what  I  see  as^ 
an  important  mandate. 

My  association,  NACAC,  honestly  needs  guidance  *bf  the  kind  we* 
can  provide  in  the  sort  of  report  I  am  describing. 

The  same  report  may  be  useful  to  you,  and  it  is  worthless  to  us  if 
it  is  biased  at  the  outset.  It  hat>  to  make  some  reasoned  judgments 
db  to  how  we  as  practitioner^  who  must  make  decisions  can  best 
deal  wttli  the  interests  of  our  institutions,  society,  the  student,  and 
so  on. 

Mr.  Weiss.  I  think  that^r.  Sjogren  had  indicated  that  he  h^d 
read  the  prior  record  of  hearings,  and  I  think  that  again,  if  your 
people  do  that,  >ou  will  find,  not  answers  necessarily,  but  you  will 
find  the  questions  po^ed  by  both  sides  to  this  debate  and  discussion, 
certainly  as  a  guide  to  what  some  of  those  questions  ought  to  be 
that  need  to  be  answered  at  this  point. 

Let  me  just  ask  as  a  start-off  one  question  which  has  been  very, 
ver>  critical  to  this  whole  discussion,  there  is  a  factual  dispute  on 
this,  and  it  seems  to  me  that  there  ought  not  to  be. 

Sometimes  ^  don't  know  whether  it  is  factual  or  semantic.  We 
have  heard  on  at  least  two  occasions  in  the  course  of  this  panel,  I 
think  Dr.  Sjogren,  you  know  of  no  one,  or  no  admissions  officer 
who  ui>es  the  test  scores  solely  as  the  determinant  for  admission. 
That  statement  is  made  repeatedly. 

At  the  same  time,  and  I  am  going  to  put  it  by  way  of  a  statement 
but  I  would  like  it  to  be  interpreted  as  a  question  for  a  response,  at 
the  same  time  I  know  as  a  matter  of  fact  on  the  basis  of  statements 
in  the  college  catalogs,  those  that  summarize  the  various  colleges 
and  universities  and  indicate  what  their  areas  of  specialization  are 
and  what  is  needed  to  be  for  likely  favorable  consideration,  that 
there  are  cutoff  scores  indicated,  and  it  seems  to  me  it  is  only  half 
an  accurate  statement  to  say  that  the  test  scores  are  not  used 
solel>  to  determine  admission,  when  in  point  of  fdCt  the  test  scores 
are  used  5c4ely  for  denial  of  admission. 

I  would  like  all  of  you  to  respond  to  that,  is  there  or  is  there  not 
the  utilization  of  test  scores  for  denial  of  admission  to  colleges  and 
universities? 

Mr.  SjpGKEN.  I  too  have  read  of  your  and  others'  concerns  on 
that  issue  and  looked  at  catalogs,  and  there  ma>  be  a  misunder- 
standing. I  am  again  speaking  from  the  undergraduate  point  of 
view. 

At  the  undergraduate  level  I,  too,  have  observed  in  some  catalogs 
that  there  is  a  minimum  test  score  that  will  allow  entr>  into  a  uni- 
versity, but  usually  that  statement  is  a  secondary  consideration  if 
the  student  does  not  meet  the  established  standards  on  the  basis  of 
a  high  school  record.  x 

Mr.  Weiss.  It  does  not  say  that  this  will  give  you  unfavorable 
consideration  for  admission.  What  it  tells  the  perspective  applicant 
is  that  if  you  score  below  this  level,  do  not  bother  applying  to  that 
school  because  you  will  not  be  considered  for  admission. 

Mr.  Sjogren.  I  would  be  very  disappointed  if  that  did  happen.  It 
would  certainly  rjjn  counter  to  the  practices  constantly  discussed 
in  annual  meetings  and  through  professional  literature. 

There  will  be  scores  below  which  students  will  not  be  admitted  if 
those  students  have  not  mef  the  other  standards.  , 
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A  very  proininunt  western  university  requires  students  be  in  the 
top  12 V2  percent  of  their  high  school  class.  If  they  do  not  qualify, 
there  are  other  ways  that  they  might  qualify,  and  one  of  those 
other  vays  is  through  cumulative  scores  ^on  a  series  of  tests,  and 
virtually  all  of  those  institutions  beyond  that  will  have  special  con- 
siderations given  to  students  from  minority  groups,  older  students, 
low  income  populations,  rural  populations,  so  these  statements, 
while  they  are  in  the  catalog,  sometimes  are  not  the  ones  that  are 
actually  practiced.  .    ^    1  11 

I  would  be  disappointed  if  an  institution  at  the  freshman  level 
did  require  a  single  test  score  for  admission.. 
,  Mr.  Weiss.  Pr.  Casteen?  • 

Mr.  Casteen.  Just  a  series  of  not  well-ordered  thoughts  on  the 
question  you  asked.       -  ,  .      .  . 

As  Mr.  Sjogren  indicates,  the  test  user  advice  that  we  receive 
from  the  test  makers  and  sponsors  with  wh<7ra  we  deal  always  tell 
us  that  that  use  of  a  test  is  inappropriate,  so  begin  with  that. 

Having  filled  out  the  questionnaires  on  which  many  of  those 
standards  are  based;  Jl  should  observe  that  often  the  way  they  ask 
the  question  predicts  the  answer. 

For'example,  if  the  answer  says,  what  is  your  cutoff  score,  and  it 
I  mark  through  cutoff  score  and  put  average  or  mean  or  ranking  of 
students  commonly  admitted,  that,  in  fact,  indicates  the  extent  to 
which  we  do  not  do  that,  the  publication  indefinitely  goes  back  to 
the  phrase  "cutoff*  score,  and  my  effort  to  give  a  valid  picture  of 
what  really  happens  has  been  abbreviated.  ^ 

To  the  extent  that  colleges  may  misuse  test  information,  and  1 
agree  with  my  colleague,  anyone  v/ho  looks  at  the  situation,  that 
there  ar^  some  instances  of  that,  H.R.  1662  does  not  correct  the 
problems!  It  has  to  do  with  the  test  sponsors.   .      _   .  ,  , 

If  for  example,  the  cutoff  scores  are  used  in  admissions,  and  1 
can  make  that  from  *'if  *  to  "since"  cutoff  scores  are  used  in  award- 
ing financial  aid,  a  condition  about  which  I  am  as  alarmed  as  my 
-colleague  to  my  left,  that  use  clearly  violates  the.directions  given 
by  the  sponsoring  organ itzations  and  professional  agencies 

The  legislation  does  not  address  that,  and  so  the  jeopardy  in 
which  students  may  find  themselves  when  bad  practice,  prevails 
would  survive  this  kind  of  legislation.         j  .    1    ■  1  i.- 

Mr  Weiss.  The  legislation  does  not  cure  it  because  the  legislation 
is  not  intended  to  mandate  any  course  of  action  as  far  as  admis- 
sions practices  are  concerned  or  utilization  of  the  test. 

All  that  the  legislation  seeks  to  do  is  to  mandate  disclosure,  so 
that  the  student,  the  academic  community,  the  world  at  large 
knows  what  those  tests  are  about.  Implicit  in  that  is  the  concept 
wLt  if  in  fiict,  all  the  information  is  out  there,  the  cures  will 
follow,  because  of  the,  normal  dialog  and  intercourse  that  will  take 
place  within  the  community  affected.  ,   .  „        .  . 

In  my  judgment  it  is  not  the  role  of  Congress  to  tell  you  how  to 
use  tests  or  any  other  criteria  as  far  as  admission  practices  arecon> 
cerned  or  awarding  of  financial  grants  or  so  on.  , ,  . 

Mr  Casteen.  I  think  you  are  right,  and  correcting  the  problem  is 
the  business  of  education.  I  would  simply  observe  that  in  this  area, 
the  use  of  cutoff  scores  and  so  on,  evidence  to  the  contrary  or 
advice  to  the  contrary  has  been  available  for  years,  and  to  the 
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extertt  that  it  gueb  on,  we  probabI>  have  evidence  of  the  people  who 
make  decisioHb  don't  always  follow  the  best  advice  given  to  them. 

Mr.  Weiss.  Perhaps  one  of  the  areas  where  the. study  that  you 
spoke  about  can  be  helpful  is  in  fact  focusing  some  new  attention 
dn  this  problem  and  determining  factually  whether  in  fact  the 
charge  is  valid  and  to  what  extent,  if  it  is  valid. 
Anybody  else  want  to  comment  on  that  aspect  of  it?  t> 
Let  nruj  touch,  if  I  may,  ^r.  Shields,  on  your  discussion  of  the  uti- 
lization of  the  test  pursuant  to  the  New  York  law  in  the  prepara- 
tion courses. 

What  kind  of  responbc  have  >ou  received,  within  the  communit>, 
in  terms  of  participation  in  those  preparation  courses  compared  to 
what  existed  previously?  How  are  they  set  up?  What  kind  of  fee 
structure  if  any  e^fists? 

Mr.  Shields.  Sir,  there  are  no  questions  for  our  program,  nor  are 
there  any  fees  nur  an>  classes  that  we  might  have  connected  with 
the  program. 

Students  come  to  us  basically,  the  majority,  wanting  to  go  on  to 
college.  They  are  sophomores,  juniors,  seniors  in  high  school,  and 
they  come  in  and  say,  want  to  go  to  college.  What  do  I  need  to 
do  to  get  there?" 

In  order  to  Help  prepare  them  to  do  so  we  have  established  semi- 
nars that  take  place  before  each  one  of  the  testing  dates,  3  weeks 
before  each  one  of  the  testing  dates  and  any  student  is  eligible  to 
those  free  ofcharge.  ^ 

The  purpose  of  them  again  is  not  to  teach  those  students  how  to 
read  better  or  write  better,  et  cetera,  but  rather  simply  to  get  them 
familiar  enough  with  the --tests  so  they  are  walking  in,  and  they 
know  what  they  are  getting  themselves  into,  because  with  the  type 
of  student  I  work  with,  the  problem  we  face  most  often,  kids  sooie 
200  flat  on  the  verbal,  which  means  a  zero  basically  when  their 
competency  is  much  higher  than  that,  and" so  it  is  a  problem  with 
taking  the  test. 

Since  we  have  been  able  to  use  actual  copies  of  the  SAT's,  at- 
tendance at  these  seminal s  has  doubled  and  for  the  October  test 
date,  which  is  the  largest  test  date  for  most  students  of  my  group, 
it  has  tripled,  in  other  words,  the  response  has  been  much  greater, 
and  I  also  have  in  my  hand  letters  from  another  talent  search 
agency,  Bronx  Community  College  in  New  York  City,  likewise  indi- 
cating that  since  they  have  been  able  to  use^these  seminars,  there 
has  been  an  increase  in  attendance  and  a  more  positive  reaction  on 
the  part  of  the  students. 

Mr.  Weiss.  We  have  received  testimony  in  the  course  of  these 
hearings,  testimony  on  the  so-called  preparation,  coachjng  schools. 

We  had  some  testimony  yesterday  to  the  effect  that  in  fact  if 
those  tests  are  utilized  by  way  of  preparation  and  coaching,  (he 
people  who  are  going  to  benefit  from  it  are  going  to  be  the  wealth- 
ier students,  because  they  say  now  the  coaching  schools  which 
charge  anywhere  up  to  $300  or  more  for  those  courses  will  have 
more  material  available  and  it  will  make  it  easier  for  those  who 
can  afford  those  courses,  and  I  would  like  your  comment  on  .that. 

Yours  js  the  first  testimony  we  have  had  in  the  course  of  these  2 
years  of  hearings  as  to  community-based  preparation , or  coaching 
schools  and  I  wonder  if  you  have  any  comments  about  that  argu- 
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ment,  that  reall>  the  benefit  accrues  to"  the  wealthy  rather  than  to 
the  disadvantaged.  ^  .  , 

Mr.  Shields.  There  'is  a  question  of  magnitude,  on-ihe-margm 

benefit,  .  ^  „        ,  .  ,  -.i 

Mr.  Kaplan,  whom  Lknow,  does  an  awfully  good  job  with  his  pro- 
gram; he  has  some  very,  very,  good  materials,  and  he  l*s  been 
working  for  a  number  of  3  ears  to  develop  them.  His  getting  a  hand 
on  a  real/ copy  of  the  SAT  is  going  to  help  him,  but  it  is  not  going 
to  help  him  nearly  as  much  as  it  will  help  a  program  like  mine, 
whereas  before  we  got  our  hands  on  the  SAT  all  we  jould  do  was 
go  by  the  prep  guide.  ^.  . 

We  ^laye  taken  a  jump  here  in  our  ability  to  work  with  those  stu- 
dents whereas  Mr.  Kaplan  will  take  a  small  step. 
v^Mr.  Weiss.  A  number  of  you.  Dr.  Schafer,  among  you,  have  indi- 
-  cated  an  attitude  toward  disclosure,  which  seems  to  be  more 
conservative  than  that  which  is  the  current  practice  of  the  Educa- 
tional Testing  Service. 

Now,  would  you  care  to  coniment  on  that?  ^      1   u  i^rro 

Do  you  oppose  the  College  Entrance  Examination  Board,  the  ETb 
policy  of  disclosing  five  out  of  seven  major  .administrations? 

Mr.  ScHAKEii.  I  think  in  general  the  Educational  Testing  Service 
has  for  whatever  reason  chosen  to  disclose,  and  T  think  Perhaps 
some  of  this  may  be  in  response  to  criticism  as  well  as  the  LaValle 
laW'in  New  York  State.  - 

With  respect  to  disclosure,  my  comment  has  to  do  more  with  the 
balances  of  the  advantages  and  disadvantages.  There  is  a  little 
doubt  that  better  testing  enhances  accuracy,  evidences  that  disclo- 
sure does  enhance  accuracy.  1  ^    •    ^  x 

The  gain  is  minor  and  the  cost  is  major.  Balanced  against  great- 
er costs,  the  argument  for  disclosure  becomes  far  weaker  than  the 
argument  against  it  ^   '  xi       i-  j 

Mr.  Weiss.  You  would  think  ETS  ought  to  reverse  the  policy  and 
go  back  to  where  it  was  previously?  , ,  |.  j 

Mr  Schafer  As  I  understand  it,  that  would  disadvantage  stu- 
dents in  New  York  State  who  would  then  not  be  allowed  to  take 
the  test.  Whether  or  not  that  is  an  advantage,  I  care  not  to  com- 

^Mr  ^Weiss.  Dr.  Hanford,  who  is  the  president  of  the  College  En- 
trance Examination  Board,  testified  yesterday  that  the  disclosure 
policies  in  effect  now  have  been  an  actual  outgrowth  of  the  direc- 
tion in  which  they  have  been  heading  in  the  last  25  years  or  so 

You  don't  consider  the  current  policy  to  be  a  national  outgrowth 
of  which  the  College  Board  has  undertaken  over  the  last  quarter  ot 
a  century?  ,  ,    /  r 

Mr.  Schafer.  I  do  think  it  iS  a  step  a  bit  too  far. 

Mr  Casteen.  I  should  make  clear  that  the  decision  to  disclose  on 
the  limited  basis  currently  in  effect  was  a  College  Bo$rd  decision 
undertaken  under  the  terms  of  the  contract  between  the  Ooilege 
'Board  and  the  ETS,  and  I  should  also  say  as  a  trustee  of  the  Col- 
lege Board,  that  I  voted  for  that  proposal  with  a  good  bit  of  uncer- 
tainty as  to  its  ultimate  effect.  „  ,  ^  .     •  ^• 

We  believe  that  the  public  interest  called  for  the  step  in  the  di- 
rection of  the  disclosure.  We  went  as  far  as  w<>  could  within  our 
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present  financial  rubourct^^tl  other  educational  resources  iri'the 
direction  of  disclosure,  but  fr:ankly  it  is  a  risk. 

Our  experience  tells  us  that  there  may  be,  prubably*  over  a  fairly 
short  run,  some  deterioration  in  the  quality  of  the  tests  that  we 
were  able  to  provide  to  our  client  colleges,  arid  so  on,  and  we 'enter 
into  this  also  with  some  sense  that  this  risk  is  a  fairly  large  one 
because  the  extent  to  which  the  SAT  score  can  be  used  as  an  on- 
going gage  of  educational  progress. 

We  need  to  be  more  certain  than  we  are  presently  able  to  be  that 
complete  disclosure  would  protect  the  year  to  >ear  comparability  of 
test  scores  across  time  as  a  way  of  seeing  to  it  that  we  can  make 
the  kind  of  diachronic  analysis  that  was  made  in  1975  and  1976. 

Mr.  Weiss. ^Ms;  Robinson? 

Ms.  Robinson.  The  comment  that  I  would  offer  at  this  time  has 
nothrng  to  do  with  the  degree  of  ambiguity  and  the  degree  of  un- 
certainty around  the  use  of  thesevtest  scores  and  the  various  proce- 
dures in  which  the  test  might  become  involved. 

I  must  note  that  in  the  admissions  process  a  number  of  caveats 
seem  to  prevail  in  terms  of  how  the  score  might  be  used,  in  terms 
of  how  the  score  is  to  be  regarded,  and  as  it  relates  to  disclosure 
around  an  instrument  that  lias  some  uncertainty  and  insecurity  in 
terms  of  accepting  the  instrument,  that  score,  for  what  it  might 
tell  you,  causes  me  to  seriously  question  the  test  agenda  overall. 

H  was  stated  during  the  course  of  the  panel  presentations  that 
perhaps  there  are  some  more  significant  underlying  questions  that 
must  be  considered,  and  I  guess  I  would  have  to  echo  that  concern 
in  that  have  we  indeed  decided  the  amount  of  standardization  that 
we  want  to  apply  td*the  overall  education  throu^  tbi^  country? 

Hava  we  agreed  on  the  content  or  the  curriculum  that  these  in- 
struments will  seek  to  measure  in  terms  of  student  prog»-ess,  stu- 
dent learning? 

Have  we  indeed  decided  that  we  can  make  a  distinction  between 
student  aptitude  and  student  achievemerit? 

These  are  very  significant  questions,  underlying  questions,  and  I 
think  in  this  age  of  high  technology,  the  ethical  question  of  where 
we  apply  what  is  technologically  possible  to  these  decisions  that  we 
mu&t  make  as  members  of  a  society  is  going  to  be  of  critical  impor 
tance  to  tl^e  pahel,  to  the  Congress  and  certainly  to  educators. 

Thank  you:^ 

Mr.  Weiss.  Mr.  Erlenborn? 

Mr.  Erlenborn.  Thank  you,  Mr.  Chairman. 

While  listening  to  this  te^imony  I  was  reminded  of  an  old  story, 
and  I  would  like  to  p»*eface  my  questions  or  comment  by  retelling 
it. 

Mr.  Weiss.'  Is  it  clean? 

Mr.  Erlenborn.  Very  clean.  It  is  somewhat  dated  in  its  refer- 
ence  to  (he  cost  of  election  campaigns,  but  the  story  goes.  The 
young  man  went  to  the  head  of  a  great  university  and  said.  ""Sir,  I 
desire  t6  be  a  captain  of  industry,  and  I  would  like  to  run  one  of 
the  great  railroads  in  this  country.  What  course  of  study  should  J 
follow*and  how  much  will  it  cost  me?" 

The  university,  president  said.  "Well,  such  a  course  of  study 
would  take  many,  many  years  end  cost  thousands  and  thousands  of 
dollacs.  I  would  suggest,  young  man,  if  you  would  just  devote  6 
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months  of  your  time  andjmuch  less-^noney,  you  could  run  ^orpon" 
gress  and,  when  elected,  you  would  feel  .competent  to  run  all  the- 
railroads  in  the  United  States."      '  ,  ^  i  i     n  i  j 

I  think  that  has  some  bearing  on  ^yhy  we  are  here  today.  It  leads 
me  to  ask  a  question  of  all  the  pahelists:.  ,    ,  u 

Is  there  a  problem' that  can  only  be  solved  or  best  be  solved  by 
legislation  and,  if  so,  is  the  Congress  of  the  United  States  best 
equipped  to  provide  that  legislation?  ^  . ,      .1  '  ^ 

Ms.  Robinson.  I  will  begin.  Yes,  I  think  there  is  a  problem  that 
•can  be  addressed  by  this  legislation.  .  ,    ,  '  »  •  • 

The  problem  has  to  do  with  consumers,  with  the  consumers  in-^ 
terest  ir*  'the  whole  endeavor  of  testing,  measurement;  evaluation. 

I  guess  the  interest  of  the  Federal  role  here  in  terms  pf  deciding 
on  proprietary  and  the  appropriate  degree  of  Federal,  intrusion 
causes  me  to  suggest  that  we  have  a  set  of  principles  and  values 
which  represent  part  of  the  foundation  of  our  society,  a  part  of  our 
foundation  of  this  democracy.  ^       r  .        .  ,0 

I  think  it  is  entirely  within  the  purview  of  the  Federal  Govern- 
ment to  articulate  legislation  and  regulation  which  encourages, 
which  helps  to  interpret  ari  undeueCanding  of  those  vmues,  and 
indeed  which  helps  us  to  apply  those  values  in  every  aspect  of  our 
huma^i  endeavors.  '  •  ... 

I  see  this  bill  as  being  in  concert  with  that  overall  responsibility 
of  the  Federal  Government  and,  therefore,  the  NEA  has  supported 
trutli  in  testing  -legislation^,  if  you  will,  certainly  this  bill,  H.K. 

^^Mr.  Erlenborn.  Throughout  the  hearings  there  has  not  been  A 
very  clear  line  drawn  between  the  complaints  about  the  openness 
of  the  various  tests,  and  the  utilization  ^of  the  tests. 

Much  of  the  testimony  has  b^en  directed  to  the  utilization  ol  the 
tests  and  whether  they  are  the  sole  criterion  for  admissioir  based 
upon  your  answer,  can  I  assume,  if  there  are  problems  in  the  utili- 
zation of  these  tests,  that  you  would  again  see  the  Federal  Govern- 
ment legislating  the  best  solution?  U    IJ  ^  f 

In  other  words,  do  you  think  the  Federal  Government  should  get 
involved  in  the  practices  of  our  educational  institutions  as  to  ad- 
missions? .    ^  tt  o 
•     Ms  Robinson.  Are  you  speaking  in  terms  of  the  colleges.^ 

Mr.  Erlenborn.  When  and  how  do  you  use  the  tests,  how  muct> 
value  you  place  on  them?  .       ,      ,    .  w 

Ms.  Robinson.  Certainly  not,  but  indeed  in  Federal  legislation,  in 
the  numbers  of  areas  that  relate  to  education,  there  is  an  indica- 
tion that  you  will  depend  on  some  standardized  imeasure  of  student 
performance,  then  indeed  you  also  have  a  corollary  responsibility 
to  see  that  that  measure  has  integrity  and  since  that  same  meas- 
ure which  is  often  required  in  several  Federal  programs  is  like 
•  measures  required  in  other  aspects  of  education,  we  are  talking 
about  similar  kinds  of  instruments.  r  1  j  ^ 

-  Therefore,  achievement  t<jsts,  which  are  some  measure  of  student 
performance,  is  often  required  in  Federal  programs,  that  is  imme- 
diately interpreted  in  most  instances  as  the  need  for  some  stand- 
ardized tests,  nationally  normed  referenced  standardized  test 
groups  administered  and  this  subjects  the  entire  industry  to  rul^s 


and  proceduruft  wliich  buggt^bt  the  Federal  standard  of  integrity 
and  quality.  '  / 

Mr.  Erlenborn.  I  would  like  to  have  your  comment,  but  first  let 
me  say  .thaf  I  am  a  bit  surprised  to  hear  a  representative  of  the 
NEA  suggesting  a  national  testing  standard. 

I  thought  you  would  have  a  little  different  approach.  I  might  sug- 
gest, if  we  h^in  to  do  this  with  students  on  national  testing  stand- 
ards, ma>be!|)erformance  stimdards  for  teachers  will  follow,  a  na- 
tional performance  standard  which  might  supplant  the  tenure  that 
is  so  highly  criticized. 

Mr.  Sjogren.  1  much  prefer  to  look  at  this  as  a  critical  issue, 
which  has  within  this  issue  several  problems  but  also  a  good  man> 
of  strengths  that  we  must  preserve. 

I  feel  that  the  great  media  attention  that  has  been  brought  to 
this  issue  in  the  past  2  or  li  years,  the  work  of  this  committee  and 
State  committees  and  intrerest  groups,  has  caused  those  of  us  in  the 


hard  look  at  ourbelves^^and  start  evaluating  those  proljtlems  and  de- 
veloping strategies  to  respond  to  those  and  remove  those  problems. 

I  have  great  faith  in  our^s>stem  to  be  able  to  respond  to  that  and 
do  it  effectivel>  without  influences  from  the  Federal  Government, 
and  I  would  plead  with  the  committee  to  allow  us  to  try  this,  be- 
cause greaJLsteps  have  been  taken  and  acconiplished  in  the  past  2 
or  i»  >ears  due  fo  a  gre^i  extent  to  the  efforts  and  attention  that 
you  have  already  brought  forward  to  this,  and  I  would  like  more 
time  to  allow  us  to  see  if  we  can't  correct  this  ourselvgs.  ^ 
I  think  we  can. 

Mr.  Erlenborn.  May  Lask  your  opinion  as  to  the  value  of  diver- 
sity in  these  tests.  Should  we  move  toward  some  national,  congres- 
sionall>  endorsed  testing  standards**  and  have  then,  jn  effect,  one 
J:esl  rather  than  a  diversity  of  tests,  would  that  be  a  good  move  or 


^  Mr«  Sjogren.  I  think  it  would  be  a  bad  move.  At  my  ov/n  institu- 
tion we  do  not  rel>  on  one  test  but  several  different  ones. 

Mr.  EriLENBORN.  What  about  the  progress  of  the  testing  stai.d- 
arJs  and  so  forth?  I^y- there  a  level  that  has  been  achieved  today? 
We  don't  want  to  get  frozen  in  place  either,  do  we? 
Mr.  Sjogren.  That  is  correct. 

Mr.  Priddy.  First  you  ask,  is  there  a  problem.  I  spoke  earlier 
before  you  were  able  to  join  us  and  in  my  opinion  I  indicated  clear^ 
ly  there  is  not. 

You  asked  what  contributions  does  this  bill,  H.R.  1662,  make.  I 
have  difficulty  seeing  those  contributions.  If  you  take  section  3,  a 
number  of  things  are  laid  out  that  would  be  made  available.  I 
think  those  things  are  already  available.  • 

Take,  for  example,  income,  there  is  a  subsection  on  reporting  and 
income  as  it  relates  to  achievement  on  these,  tests  or  performance.  I 
think  we  already  know  the  correlation  there.  It  is  very  clear. 

^An  educator  is  an  educator  is  an  educator;  my  response  ic,  so 
what?  What  are  we  going  to  do  about  it  now  that  we  know  he  is 
having  some  difficulty? 

Section  3  is  a  clear  infringement  on  the  private  sector  and  totally 
unnecessary  for  the  Secretary  of  Education  to  have  another  stack 
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of  reports  to  read  each  week,  and  those  are.already  available  in  the 

general  press.  ,       rr,.    i.  • 

Secticn  5,  disclosure  essentially  is  what  it  is  about.  The  business 
of  developing  good  tests  is  very  complex  and  to  throw  all  of  that 
away  every  year  is  a  waste.  The  costs  that  would  be  associated  in 
terms  of  time  is  unreasonable,  but  the  cost  in  terms  of  money  to 
test  takers  will  be  exaggerated  beyond  reasonable  proportions. 

I  am  at  a  public  school  system,  and  we  feel  it  is  our  business  to 
be  responsible  to  our  communities  and  to  our  boards  for  instruction 
and  .so  on.  Testing  is. only  one  of  the  means  that  we  use  to  be  re- 
sponsible to  them.  We  use  the  results  of  group  and  individual  tests 
to  make  decisions  about  curriculum,  instruction,  and  so  on. 

We  do  not  use  them  as  a  sole  indicator,  indications  where  cur- 
riculum needs  to  be  revised.  It  is  only  one  of  the  means  that  are 
used,  and  we  are  not  having  any  trouble  at  this  point  using  what  is 
available  to  us  to  make  those  decisions. 

Mr.  ScHAFER.  In  the  testimony  that  I  gave  I  mentioned  a  docu- 
ment thaf^the  association  has  produced.  In  this,  our  association 
takes  the  position  that  we  do  not  have  an  urgent  problem,  and  I 
should  also  note  that  with  respect  to  measurement-oriented  profes- 
sional associations,  I  know  of  several  who  have  taken  a  position 
which  is  opposed  to  legislation  with  respect  to  testing,  specifically 
disclosure,  and  I  know  of  none  which  has  taken  a  position  in  favor 

There  are  several  things  in  our  statement  which  speak  to,  at 
least  a  beginning,  with  respect  to  look  at  the  problem  of  test  use 

Mr.  Shields.  You  asked  the  question  whether  or  not  there  was  a 
problem.  There  are  a  number  of  problems  in  education,  and  just  as 
obviously  most  of  them  should  not  be  legislated  by  the  Federal 
Government.  Education  is  a  State  function. 

Mr.  Erlenborn.  I  like  to  be  reminded  of  that  from  time  to  time. 

Mr.  Shields.  Tenth  amendment.  However,  this  bill  does  not  try 
to  legislate  how  admissions  officers  should  use  tests,  nor  should  it, 
but  if  tests  are  gomg  to  be  used  and  if  there  are  going  to  be  such 
things  as  cutoff  scores  and  if  tests  are  going  to  be  such  an  integral 
process  of  the  admission  and  financial  aid  process,  more  importan 
then  we  have  to  ask  ourselves,  is  there  anything  that  any  of  us  can 
do  which  might  help  those  students  who  have  to  go  through  t]iis 

process?  ,  ,         i_    i  u  4. 

You  cannot  tell  an  elementary  and  secondary  school  now  to 
teach  their  children.  You  can't  tell  admissions  officers  how  to  use 
those  tests,  but  J  do  think  it  is  possible  for  you  to  be  able  to  provide 
more  information  to  the  students  who  have  to  take  those  tests,  es- 
pecially those  students  who  would  not  receive  it  otherwise. 
'  Yes,  there  are  things  out  on  the  market  concerning  tests.  I  hey 
cost  money.  My  students  come  about  70  percent  from  welfare  fami- 
lies, and  they  buy  no  books,  certainly  not  commercial  testing 
guides.  One  of  the  nice  things  that  ETS  has  done  is  tha*-  for  those 
students  who  receive  fee  waivers  to  take  the  examination  they  can 
receive  their  test  scores  back  for  free. 

Basically,  what  I  am  saying  is  that  the  children  that  perform 
most  poorly  on  those  examinations  could  benefit  most  from  having 
more  information  about  them  in  their  hands  and  requiring  them  to 
buy  things,  requiring  them  to  send^in  special  forms  to  get  that,  it  is 
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not  going  to  get  thobc  kids  that  information  most  quickly,  and  I 
think  this  legislation  will. 

Mr.  Erlenborn.  Thank  you,  Mr,  Chairman.  ' 

I  have  no  further  questions. 

Mr.  Weiss.  I  think  that  perhaps  in  the  course  of  the  last  couple 
of  responses  we  have  gotten  some  clarification  of  the  thrust  which 
the  legislation  has. 

My  distinguished  friend  and  colleague  is  a  marvelous  devil's  ad- 
vocate, and  sometimes  includes  in  his  questions  premises  which 
you  never  intended,  and  he  knows  that  in  fact  they  are  not  actual- 
ly premises  but  he  does  it  to  provoke  responses,  and  I  think  that  ib 
good. 

Dr.  Robinson,  perhaps  you  ought  to  amplify  the  comment  that 
you  made  because,  as  it  was  left  as  a  response  to  Mr.  Erlenborn's 
question,  it  put  you  and  NEA  in  exactly  the  opposition  position  of 
where  you  are. 

Ms.  Robinson.  Certainly  in  the  interest  of  consumerism,  and  if 
we  would  view  the  bill  in  that  manner,  I  would  just  recall  that  as 
cuni>umers  have  become  better  informed  about  the  various  products 
that  we  require,  the  quality  of  those  products  coming  under  closer 
scrutiny  has  helped  to  encourage  better  quality  indeed. 

I  suspect  that  would  also  be  the  case  with  standardized  tests,  and 
this  bill  would  encourage jbetter  quality  of  tests. 

I  do  not  fear  it  and  I  have  great  faith  in  the  technological  skills 
of  those  who  help  to  develop  tests,  and  I  feel  that  ^lisclosure  will 
simply  encourage  all  of  us  to  become  much  better  experts  in  all  the 
endeavors  that  we  undertake  in  this  regard,  so  while  the  bill  does 
not  indeed,  it  does  not  even  attempt  to  establish  a  Federal  standard 
for  the^  tests  themselves,  it  does  establish  a  value  in  lerms  of  pro- 
tecting the  conijumer,  the  interest  of  those  take  and  use  test 
^  information. 

Mr.  Wkiss.  In  the  course  of  your  prepared  testimony,  on  page  5, 
you  have  a  statement  in  which  you  say; 

Cungrei>i>  has  pa&aed  few  edutatiun  laws  which  do  not  require  some  form  of  "objec 
tive"  measures.  In  almost  every  instance  these  "objective"  measures  are  interpreted 
as  standardised  tests  In  its  effort  to  reconcile  the  Federal  budget  last  month,  the 
Flouse  adopted  language  for  objective  measures  of  educational  achievement" 
which,  if  adopted  in  the  final  version,  would  probabl>  lead  to  an  annual  nationwide, 
State-admini&tered,  local l>  based  standardized  test  of  student  progress  in  basic 
skills 

Are  you  saying  in  the  course  of  that  statement  that  in  fact  it  is 
not  those  who  are  asking  for  disclosure  legislation  Lut  those  who 
seem  to  be  opposed  to  it  who  have  now  gone  the  full  route  and  are 
in  fact  attempting  by  the  legislative  provisions  already  adopted  to 
put  us  on  a  national  standardized  test  basis? 

Ms.  RoBLNSON.  We  wonder  if  perhaps  that  is  not  indeed  begin- 
ning to  occur,  and  we  have  to  ask  ourselves  then,  when  did  we  de- 
termine the  level  of  standardization  that  w^e  are  read>  to  accept 
through  mandates  such  as  this? 

I  think  that  we  have  a  need  for  objective  measure  of  all  of  our 
work,  and  we  have  procedures.  We  k  now  vve  have  the  technology 
necessary  for  educators  to  determine  objectively  a  measure  of  stu- 
dent progress  without  such  heavy  reliance  on  nationally  normed 
reference  group  administered  tests. 
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They  are,  however,  cpnvenient  and  the  economy  of  scale  becomes 
very  appealing,  so  we  often  give  in  to  that  value  rather  than  take 
the  time  to  question  other  underlying,  considerations,  such  as 
making  a  careful  examination  of  the  match  between  the  test  con- 
tent and  the  local  curriculum  or  how  are  we  going  to  accommodate 
differences  determined  by  the  local  community  or  by  the  State  as  it 
relates  to  what  you  will  teach  and  what  those  various  tests  will 

measure.  ,   .  .  x    x  j    j  * 

Certainly,  I  know  that  school  administrators  and  educators, 
teachers  themselves  all  across  this  country  spend  a  lot  of  time  in 
trying  to  make  careful  selections  of  those  instruments  so  that  they 
are  indeed  applying  the  most  appropriate  one  for  their  needs  and 
for  their  students,  but  the  degree,  that  same  amount  of  time,  that 
same  amount  of  money  might  be  better  invested  in  a  kind  of  as- 
sessment procedure  which  is  developed  locally,  which  teachers 
have  greater  control  over  in  terms  of  applying  when  they  have  the 
need  to  apply,  which  can  be  applied  whenever  they  choose,  and  can- 
provide  the  kind  of  information,  they  need  on  an  ongoing  basis  to 
truly  assist  student  need  and  help  to  measure  student  progress 

This  does  indeed  suggest  that  we  are  going  to  recognize  perhaps 
the  validity  and  a  national  measurement  scheme  that  we  have  not 
thoroughly  examined.  The  national  assessment  project  notwith- 
standing, we  know  that  a  number  of  accommodations  are  made  so 
we  are  not  reporting  inaccurately  to  the  public. 
This  I  am  not  sure  how  we  will  implement  '  i  .1 

Mr  Erlenborn.  Mr.  Chairman,  might  I  say  I  accept  the  gentle 
chiding  of  the  chairman  as  to  the  premises  of  my  questions,  and  1 
think  I  owe  you  an  explanation. 
I  guess  I  just  failed  to  articulate  part  of  my  thought  process. 
After  25  years  as  a  legislator,  I  have  learned  something  about 
what  happens  to  legislation.  I  have  observed  it  over  the  course  ot 

the  vears  .  . 

It  is  my  opinion,  once  a  legislative  body  establis'hes  the  principle 
that  it  has  the  right  to  regulate  an  industry  it  seldom  is  reversed 
nor  does  it  stand  in  place.  It  grows  and  grows  and  grows,  and  1 
guess  I  just  didn't  articulate  that  too  well. 

Mr.  Weiss.  Well,  I  am  glad  that  you  clarified  your  position,  Mr. 
Erlenborn. 

I  have  one  final  question. 

Dr  Sjogren,  in  the  course  of  your  statement,  I  am  not  sure  il-l 
caught  the  full  impact  of  what  you  meant  when  you  said  that  com- 
panies, I  assume  testing  companies,  should  be  punished  it  they 
misuse  the  test  in  some  way. 
Clarify  what  you  meant  by  that.  •  ,    j  j 

Mr.  Sjogren.  I  am  sorry  for  that  ambiguity.  What  was  intended 
there  was  to  state  that  testing  companies  who  do  not  act  responsi- 
bly such  as,  I  believe,  ETS  is  now  acting,  the  American  College 
Test  the  College  Board,  those  are  three  of  .the  groups  with  which  1 
am  most  acquainted,  I  feel  they  are  acting  very  responsibly  and 
should  be  licensed  to  continue  on  in  doing  the  good  things  that  we 

^'^However,  there  are  testing  companies  that  fail  to  act  responsibly 
and  fail  to  meet  most  of  the  conditions  specified  in  your~proposal. 
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and  those  companies  should  be  made  to,  should  be  punished.  That 
was  my  intent 

Mr.  Weiss.  Well,  you  know  and  I  have  been  sometimes  taken  to 
task  for  appearing  to  be  too  critical  about  ETS.  ^ 

The  American  College  Testing  group  has  in  fact  to  this  moment 
to  the  best  of  my  knowledge  refused  disclosure  of  any  kind  I  am 
not  sure  you  would-vnot  include  them  as  one  of  those  who  should  be 
subject  to  some  punishment 

Mr.  Sjogren.  The  item  of  cjisclosure  was  exempted  from  my 
point.  ^  11  • 

I  still  have  very  mixed  feelings  about  disclosure  but  I  am  talkmg 
about  the  other  kinds  of  information  that  is  provided  to  the  con- 
sumer prior  to  the  testing. 

Mr.  Weiss.  Before  we  conclude  our  session  this  morning,  if  there 
are  any  of  you  who  have  some  additional  comment  or  comments 
that  you  care  to  make  just  to  total  out  your  presentation,  so  that 
we  don't  have  you  hanging,  feel  free  at  this  point  to  do  so. 

Mr.  Casxeen.  This. question  of  the  Federal  interest  in  testing  and 
especially  college  admissions  testing  is  one  that  has  interested  me 
for  a  couple  of  years. 

I  didn't  answer  Congressman  Erlenborn's  question  earlier  be- 
cause I  am  really  not  sure  where  I  would  come  down  on  that  one 
on  the  end  concerning  some  of  the  things  Ms.  Robinson  said  on 
behalf  of  NEA. 

On  page  2  of  the  resolutions  appended  to  the  NEA  presentation, 
it  is  said  that  the  NEA  opposes  the  use  of  tests  that  deny  students 
full  access  to  equal  educational  opportunities.  The  extent  to  which 
that  happens  needs  to  be  examined.  That  is  the  kind  of  matter  we 
intend. to  look  into  seriously,  but  that  is  one  point 

Second,  as  to  evaluation  of  teachers,  that  is  a  State  function  You 
asked  about  State  interest  in  this  type  of  topic,  and  then  the  exam- 
ples of  tests  that  should  not  be  admhiistered,  and  also  Ms. 
Robinson  s  expansion  on  this  matter  of  locally  based  assessment  to- 
ge'ther  I  think  concern  me  more  than  I  realized. 

The  first  example  given  is  tests  that  are  potentially  damaging  to 
a  student's  self-concept.  Because  we  must  administer  9,000  or 
10,000  rejection  letters  to  college,  we  deal  with  those  people  regu- 
larly because  they  have  been  told  no,  and  it  is  worth  exploring  the 
possibility  of  the  student  who  does  not  read  well  enough,  who  reads 
poorly,  he' ought  to  know  that  at  a  rather  early  age  than  local  as- 
sessment guarantees  deliver  that  information. 

The  trend  toward  grade  inflation  is  essentially  a  locally  based 
form  of  self-perpetuation  of, reward.  That  national  measure  that 
might  provide  a  notion  as  to  whether  students  do  read  well  enough, 
that  that  may  have  some  societal  value  that  needs  to  be  weighed. 

Students  who  have  not  benefited  adequately  from  schools,  those 
who  come  from  ethnic  groups,  those  students  deserve  early  notifica- 
tion, early  information  of  a  kind  that  I  fear  is  not  available 
through  most  of  the  local  assessment  programs  that  I  know  about; 
&o  I  am  concerned  that  the  Federal  interest  in  this  question  may 
well  have  to  do  with  protecting  the  quality  of  experience  of  the 
children  who  go  through  schools  or  in  some  other  way  protecting 
— thVteachers~ornhe~other  interest^groups;  " 

.9^'  3  Go 
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I  am  not  sure  that  the  Federal  interest  is  defined  in  this  particu- 
lar set  of  objectiunb  to  certain  kinds  of  testing  that  Ms  Robinson 
has  presented.  In  the  end,  the  attention  focused  by  your  interest  in 
this  topic  on  the  whole  question  of  testing  has  been  healthy  for 
education,  but  I  am  apprehensive  that  our  best  as  a  nation  is 
served  by  legislation  that  may  serve  to  diminish  the  amount  of  na- 
tionally referenced  measurement  information  that  is  available  to 
us  as  we  try  to  assess  our  progress  in  schools. 

Mr.  Weiss.  Your  statement  leads  me  to  ask  this  question. 

Are  you  at  all  bothered  by  the  confusion  that  may  well  be  cre- 
ated in  the  ,Tiinds  of  students  as  well  as  their  parents  by  the  use  of 
the  term  "aptitude"  when  in  fact  it  is  achievement  that  is  meant 
by  that  word  in  Scholastic  Aptitude  Tests,  does  that  bother  you  at 

all?  '  ^ 

Mr.  Casteen.  That  may  be  a  loaded  question.  I  recall  that  in 
1979  I  suggested  to  your  committee  that  what  we  are  looking  at  is 
a  certain  set  of  skills  that  can  be  used  to  learn,  reading,  and  so  on, 
and  a  certain  set  of  bodies  of  knowledge  that  can  be  demonstrated 
^  on-certain^kinds.ofiests  .  _ — _ —  ^r-r-i— 

Personally,  I  do  not  find  the  word  "aptitude '  especially  useful.  It 
IS  as  ephemeral  for  me  as  is  the  word  "intelligence."  I  know  what 
skills  are,  certain  bodies  of  knowledge  are,  and  I  am  concerned 
about  the  t:onvertibility  of  those  phenomena  to  educational  prog- 
ress or  achievement. 

I  suspect  that  the  word  itself  means  what  one  wants  it  to  mean, 
aptitude,  and  that  we  may  in  the  future  want  to  take  a  good  look 
at  that,  but  I  doubt  that  there  is  a  Federal  interest  in  that  word. 

Mr.  Weiss.  Well,  the  only  reason  I  asked  the  question  is  because 
you  confronted  the  issue  raised  about  people  s  self-worth,  and  we 
have  had  testimony  in  the  course  of  these  hearings  over  the  last 
couple  of  years  about  how  people  having  taken  those  tests  which 
they  are  led  to  believe  because  they  are  told  that  no  amount  of 
coaching  or  preparation  will  help  them,  that,  in  fact,  it  is  some 
vague,  inherent  aptitude  for  academic  pursuits  that  is  at  stake  and 
when  they  don't  do  well,  it  is  not  that  they  have  not  been  taught 
well,  that  they  haye  not  studied  hard  enough,  it  is  that  they  them- 
selves are  not  good  enough  inherently,  ^ 

That  is  the  problem  and,  again,  you  are  right  I  don  t  think  that 
I  want  to  mandate  by  law  that  you  can't  use  the  word  aptitude 
but  I  would  think  that  the  educational  establishment,  both  test 
makers  as  well  as  test  givers,  would  want  to  think  real  hard  as  to 
whether  they  are  not  doing  themselves  as  well  as  the  test  takers  a 
grave  injustice  by  allowing  others  to  misinterpret  what  is  meant  by 
that  word. 

Mr.  Casteen.  Good  point,  I  think. 

Mr.  Weiss.  If  there  is  anyone  else  that  wants  to  comment  oa  any- 
thing at  all,  now  is  the  time. 
'    If  not,  I  very  much  appreciate  your  participation  this  morning 

These  hearings  will  undoubtedly  continue  and  hopefully  some- 
time in  the  near  future,  not  the  day  after  tomorrow,  we  will  have 
some  further  legislative  progress  t(r  report  and  I  look  forward  to 
the  reports  about  the  study  which  you  spoke  about. 

Thank  you  all  very,  very  much. 
"  The  subcommittee  slanas  adjourned.       '  ' 
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[Whereupon,  at  12:35  p.m.,  the  joint  hearing  of  the  Subcommittee 
on  Elementary,  Secondary,  and  Vocational  Education  and  the  Sub- 
committee on  Postsecondary  Education  of  the  Committee  on  Educa- 
tion and  Labor  adjourned.] 

[Additional  materials  submitted  fof  the  record  follow:] 


-Tht*  Honorable 

P.iui  Slnon,  Chairmn 

SubcotEalttte  on  Postsecondary  Education 
320  Cannon  Hou<>c  Office  Suildlng 
Vashington,  D.  C.    20515  ^ 

Dc.ir  Chalrinan  Sinon: 

I       writing  to  yov  today  to  request  the  inclusion  of  additional  material 
into  the  official  record  of  the  hearings  held  on  July  21  and  22  on  H.R. 
1662,  the  Educational  Testing  Act  of  1981,    As  you  know,  I  was  present 
as  a  technical  adviser  at  the  hearing  on  Wednesday,  July  22,  accompanying 
Dr.  Micha*^l  Prlddy  of  the  Guilford  County,  North  Carolina  school  ^system, 
a  witness  on  the  "Experiences  of  Test -Takers"  panel.    Inasmuch  as  the 
heirlng  rvcord  is  being  held  open  for  ten  days  following  the  hearings, 
I  would  like  to  take  thiA  opportunity  to  supplement  the  record  with  the 
following:  ' 

(1)    A  correction  to  the  testimony  of  Michael  Galligan,  -n  witness 
on  the  "Experiences  of  Test-Takers"  panel  on  Wednesday,  July  22. 
Mr.  Galligan,  a  student  who  found  a  flaw  in  a  question  on  the  SAT, 
indicated  in  his  testimony  that  because  of  his  finding  the  error,  the 
grades  of  almost  20,000  students  who  had  chosen  the  alternative  answer 
were  raised  ten  to  twenty  point-cJ.    He  further  stated: 


"Unfortunately,  students  outside  of  New  York,  where 
the  "truth  in  tc<5t/ng"  law  is  not  in  effect,  have 
not  had  their  scores  <.^ci3usted.    Are  not  the  students 
in  those  other  states  Just  as  correct  as  the  Students 
in  New  York?" 


Tni*?  statenent  is  grossly  misleading  because  the  particular  question  chai» 
Leniit'd  by  Mr.  Calligan  was  not  included  on  tes t__forrns  used  in  any  other 
^Vrt^fqre  no  other  students' scores  should _or  could  have  been 

changed. 

(2)    A  response  to  statements  riade  by  Michael  Galligan  during  the 
Que^tlon-and-Answcr  period  following  his  tostitnoay.    Rep.  Weiss  aske^ 
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The  Honorabie  ^  lofti 

Paul  Simon,  Chairman  -2-  August  6,  1981 

both  Che  i,tudcnc  witnesses  to  comiont  upon  their  experience  a<?  to 
^.tudcnt-i*  .itcltude-;  about  Ce5;ts.  their  Impressions  of  whether  suffi- 
cient mfornation  is  provided  about  then,  whether  students  have  an 
opportunlcv  to  :?tudv  for  them,  etc.    Mr.  GalliRan  indicated  that  prior 
to  t.ifclnjp.  the  SAT,  he  "had  very  little  idea  as  to  what  specifically  the 
fonnat  could  be..."    He  explained  that  he  had  not  taken  the  PSAT  «o 
'  chat,  "I  had  no  idea  in  that  respect,  nor  did  I  receive  Inforrnntion  from 
school  as'  to  what  the^fornat  vas."    ^  * 

Mr    GaUigan  then  reported  that  students  who  attended  the  Jackie 
Robinson  Foundation  Youth  Convention  at  Columbia  University  a  few  nonths 
ago  al<>o  "did  not  have  the  information,  the  appropriate  inlonaation,  as 
CO  what  the  te<^t  vould  actually  test,  as  to  what  the  format  vould  be  and 
what  the  necf.Kary  loveU  of  math  and  verbal  "Skills  had  to  be  itta  ne<^  <^o 
that  one  could  actually  do  the  exercises  of  the  test  and  display  his 
knowledge  in  that  manner  to  make  the  test  valid  (sic).  - 

_   _  ViCi^C  JJ$  were  astonished  at  hearing  the  above  statements  bv  Mr.  Galligan 
hi^cause  of  ■oiir'ext.-n<;ive  distrlbut  loti  to  high  schools  and  to  individual 
student  requestors  of  tnaterial  describing  in  detail  the  nature  of  the  SAT, 
the  skilK  and  abilities  measured,  the  fornuit  of  the  various  question  type^?, 
suggestion^*  as  ta  how  to  approach  answering  the  questions,  as  veil  as 
hint",  for  using  tit-e  efficiently  and  for  guessing.    This  inforination  is 
included  in  the  booklet  entitled,  Taking  the  SAT  (Attachment  A)  a linos t 
three  niUion  of  which  are  sent  each  yea-  to  high  school  counselors  across 
the  country  for  free  distribution  to  students  along  with  test  registration 
materials.    Included  in  the  booklet  is  a  complete  sample  ^*;f '  . 
sample  answer  sneet  and  the  list  of  correct  answers,  as  well  as  ^^PJ'^" 
ation  of  how  to  score  the  test.    The  metnorandun  to  Directors  of  Guidance 
or  Counseling  (included  with  Attachment  A)  recently  sent  these  materials 

includo^j  the  instruction:    "Another  change  in  the  ATP  for  1981-82  is  that 
Taking  the,  SAT  contains  a  new  sample  test.    Please  be Jure  that  all 
^S^^T^o^Mti^r  for  the  SAT  receive  a  copy  of  this  f^^^^^f^^  ^" 
far  m  advaace  of  the  test  date  as  possible  so  that  they  have  ample  time 
to  become  faiailljr  with  the  test. 

Unlike  Mr.  CalUfan.  the  iMi'jorlty  of  students  who  take  the  SAT  'lave 
elected    o  tX-  the  Prellminarv  Schol.sdc  Aptitude  Test    PSAT)  In  October 
of  their  lunlor  vcar.  test  Is  a  slightly  nbbrevlaced  version  of  the 

SAT  -iml  acau,ilncs  the  ftudent  with  the  ccsc  questions  and  format  and 
prIvMes  a'»ue-to-life  practice  testing  situation.    High  school  counselors 
prov  do  to  interested  students  the  PSAXMaSI  Student  Eul  etln,  "•<l£'> 
eludes      fuU-lenRth  test  with  answers  nnd  scoring  directions.  J^^AT  'c*"^ 
takers  rrow  auton.«lcally  receive  through    their  high  schools  a  copy  of  the 
test  q«esM..n.,  the  correet  answer.s.  .md  their  own  answers  at  the  Cine 
their  scores  ..re  reported.    They  cm  then  uSe  this  Information  In  pre- 
paration for  taking  the  SAT. 
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(3)    A  reprint  of  an  article  which  appeared  in  Idst  oonth's  American 
Syhuol  Boa r d  Jou r na 1 ,  entitled  "Standardized  Testing  Has  Become  Education's 
Ldte&t  Scapegoat,"    (Attachoent  B)    Tliis  is  a  short  article  which  provides 
some  basic  Information  about  tests,  including  types  of  tests»  how  to  take 
them,  how  to  prepare  for  them  and  who  develops  them.     I  think  the  "crash 
course  on  test  design'*  Included  at  the  end  may  be  particularly  helpful  as 
an  introduction  to  tests  foe  new  members  of  the  cotccnlttee  and  their  staffs. 

(A)    A  short  brochure  entitled,  "Developing  a  Test."    (Attachment  C) 
This  document  describes  very  briefly  the  lengthy  and  elaborate  19-month 
cycle  followed  in  the  development  of  an  ETS  test.    This  brochure  should 
also  be  helpful  to  newcomers  to  the  field  and  will  point  out  the  meticulous 
care  taken  to  identify  defective  questions  throughout  the  developmental 
process.  J 

,  (5)    A,  document  entitled,  "Questioning  the  Questions"  (Attachment  D) , 
which  describes  the  process  for  challenging  a  question  on  an  ETS  test, 
from  Inttlal  inquiry  through  appeal.    Attached  to  this  document  are  two 
charts  which  indicate  the  frequency  of  the  different  types  of  inquiries 
of  challenges  to  ETS  concerning  questions  on  the  six  admissions  and 
guidance  testing  programs  adminlctered  by  ETS,  that  are  covered  by  the 
New  York  State  law.    Tlie  first  chart  shows  the  numbers  of  inquiries  about 
test  questions  on  all  forms  of  the  test  (not  just  disclosed  tests)  from 
January  I,  1980  through  June  1981.    This  table  points  out  that  the  large 
cuijorlty  of  Inquiries  is  made  by  test-takers  immediately  or  shortly  after 
the  test  administration,  but  prior  to  receipt  of  test  questions  and  answers 
on  disclosed  tests.    Only  a  very  small  portloxi  of  the  1980-81  inquiries 
were  received  as  a  result  of  test  disclosure.    In  all,  ten  questions  that 
were  faulty  or  cimtalned  misprints  were  discovered;  seven  of  them  early 
enough  so  that  they  were  not  counted  In  scoring.    The  second  chart  deals 
only  with  disclosed  tqsts  and  shows,  for  each  of  the  six  testing  programs, 
how  many  tests  have  been  disclosed,  the  number  of  questions  disclosed,  the 
number  of  qut-utlons  chaUenged  (after  test-takers'  receipt  of  questions 
and  answers),  the  number  of  flawed  questions,  and  the  disposition  made. 
The  percentage  of  flawed  items  identified  after  disclosure  is  only  five 
one-hundredths  6(  one  percent. 

(6)    A  chart  which  indicates  the  numbers  and  names  of  states  whose 
legislatures  have  introduced  bills  to  regulate  and  disclose  admissions  or 
occupational  tests.     (Attachme'nt  E)    This  chart  shows  that  there  has  been 
a  decreased  level  of  legislative  activity  in  this  area  in  1981  compared 
to  previous  years,  and  that  only  one  state  has  enacted  a  test  disclosure 
law. 


302 


The  Honorable 


August  6,  1981 


Finally,  I  also  respectfully  request  that  this  letter  be  included  as  a 
part  of  the  hearing  record. 

I  thank  you  very  much  for  your  attention. 


MGE:tgm 
Attachments 

cc:    The  Honorable  Carl  D.  Perkins 
The  Honorable  Thonas  E.  Coleman 
The  Honorable  William  F.  Goodling 


Sincerely, 


Marion  G.  Epstein 

Senior  Adviser 

Educational  Testing  Service 
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Domestic  Shipments  (Won -MY) 

ADMIS^IQNS  TESTING  PROGRAM  OF  THE  COLLEGE  BOARD 

80X592  •  oftiNCETON  NJ085«^  •  (609i^rmw" 


To:    Directors  of  Guidance  or  Couos^ing 

Subject:    Information  aibout  the  Admissions  Testing 
Program  (ATP)  for  1981-82 

This  bhipfrent  of  ATP  materials  includes  copies  of  a  Special  Announcement 
to  students  about  the  College  Board's  SAT  Quest ion-<jnd-Answer  Service 
which  will  be  introduced  m  1981-82.    This  new  service  offers  students 
the  opportunity  to  order  copies  of  their  SAT  test  questions  and  answers 
if  they  take  the  SAT  on  the  dates  specified  in  the  Spec-i a  1  Announcement . 

Notices  on  the  front  covers  of  the  ATP  Student  Bulletin  and  Taking  the  SAT 
refer  students  to  the  Special  Announ cemc n t  for  more  information  about  the 
SAT  Quest lon-and-Answer  Service.    Please  display  this  gp^cial^Amiouncetrent 
m  a  proninAnt,  place  m  your  guidance  office  along  with  the  ATP  Student 
Bulletins  so  that  each  student  who  receives  a  copy  of  the  g^l^otin  and 
Taking  the  SAT  also  obtains  the  Announcement. 

Another  change  m  the  ATP  for  1981*82  i&  that  Taking  the  SAT  contain^-  a 
new  sanpY^'  test.    Please  be  sure  that  all  students  who  register  for  tho 
SAT  receive  a  copy  of  this  publication  as  far  in^ advance  of  the  test  date 
as  possible  so  that  they  have  ample  time  to  become  familiar  with  the  test. 

The  College  Board  will  publish  this  September  a  compendium  cunt  aim ng  the 
five  SATS  made  public  during  1980-81.    This  booklet/  5  SATs .  may  be  ordered 
(or  S5.00  each  ($2.00  each  for  orders  of  50  or  more)  by  u&mg  the  spcci  il 
order  forms  included  m  this  shipment.    Please  note  that  5  SATS  is  not 
intended  to  replace  Taking  the  SAT,  but  rather  is  being  made  available  tc^ 
students  and  others  who  may  be  interested  m  seeing  additional  somplc 
test  questions. 

• 

The  ATP  Student  Bulletin  and  Taking  the  SAT  are  being  sent  to  you  m 
separate  shipments  during  the  next  few  weeks.    The  quantity  is  based 
on  the  total  number  of  copies  you  received  last  year  and  is  noted  on  the 
Puijlications  Shipment  Notice  enclosed  with  this  shipment.     If  you  need 
to  reorder  these  or  the  Special  Announcement  about  the  SAT  Question-and 
Answer  Service  during  the  year,  please  use  the  second  copy  of  this  form 
(Publications  Reorder  Form).    Additional  order  forms  for  5  SATs  can  be 
obtained  upon  request. 


Thank  you  for  your  cooperation. 
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Tht  purpost  «l  »hl5  bookltt  is  to  proV/<J#  infecmation 
lhat  will  http  you  takt  tht  SchoiastKi  ^;*pUiiido  Tost 
(SAT)  and  tht  Tt st  of  Standard  Written  ^hghsh  tTSWE) 
wUhofeatorconhdtnCf  '       U  \ 

r«fc//i  J  SA  7  includf  s  df  scnptions  ^^^tht  S^T  and 
TSWE.  an  explanation  of  tht  difloront  r/p05  of^quts 
lions^  and  suggdstlons  about  how  to  apptoach  arjSwt r 
•no  iht  questions  In  addition,  th*  booklet  coi\Ulns 
hints  for  using  your  timt  efllcitntty  and  w  ou«^""0 
Finally,  a  complete  sample  test  and  ansi«r  shtti  art 
jociuded  as  wen  as  an  explanation  of  ho*  j^ht  answer 
9he«ts  are  scored  \  \ 

II  you  have  not  already  received  a  copy  of  Ihis  year's 
Admissions  Tostlnp  Program  StodenI  Bulletin  ask*  lor 
one  at  your  school  Tne  BulWm  tens  how  16  f*o'5<»'/o' 
the  test<  where  and  wher>  to  take  it.  anjl  bow  y^ur 
scores  witl  be  reported  1  i 


THE  SCHCU.ASTiC  APTITUDE  TEST 


The  SAT  1$  a  muU^pfe  choice  lost  made  up  of  sepi* 
rately  t*me<J  verbal  and  mathematical  sections  Verbil 
que5t>ons  measute  your  aomly  to  understand  what  yoU 
read  arwJ  the  extent  ol  youi  vocabulary  KOithomatica' 
.quostioos  measure  your  abihly  to  solve  problems^ in 
voivinij  arithmetic  rtasonmg.  algot?ra  and  geometry 
The50  abilities  have  boon  shown  to  bo  rotafod  to  suc- 
cessful academic  performance  in  college  The  SAT 
does-ftot  measure  other  Kinds  of  abiiiltes  whkh  may  be 
associated  with  success  m  toltege*  such  as  special 
talents  Of  motivation 

Your  high  school  repptd  *5  probably  the  best  ev) 
dence  of  your  preparation  lor'vOilege  Because  app'i 
cants  have  taken  dttrereni  courses  and  como  'rorrs  high 
schools  with  dilfereni  grading  practices.  coim3«  •(! 
missions  otftcers  need  a  common  measure  yf  ability 
such  at  the  SAT  However,  scores  un  the  SAT  are  lust 
part  ol  the  mt^mai^on  yscKj  .n  maK»ng  an  admissions 
decision 


THE TEST  OF 

STANDARD  WRIHEN  ENGLISH 


The  TSV/E  is  a  multiple-choice  tost  administered  wilh 
the  SAT  The  questions  measure  you'  ability  to  recog 
^  ni«e  star^d*rd  written  English,  the  language  of  most 
conege  textbooks  and  the  English  you  will  probably  be 


expected  to  use  In  the  papers  you  write  In  college  The 
TSWE  is  not  intended  to  be  used  as  an  admissions  test 
instead,  after  you  have  been  admitted  to  college,  TSWE 
scores  may  be  used  by  the  college  to  choose  an  Eh- 
gitshc'Ourse  that  15  best  lor  you 


PREPARING  FOR  THE  TEST 


The  abilities  measured  by  the  SAT  develop  over  years 
of  sludy  and  use.  both  In  and  out  of  school  For  a  state- 
ment about  special  preparation  for  the  SAT,  see  the 
back  cover  of  this  booklet 

Studying  the  sample  questions,  directions,  and  ex- 
planations In  this  booklet  will  help  you  prepare  for  the 
test  The  directions  lor  the  questions  and  the  examples 
«re  printed  here  as  they  appear  In  the  test  book  If  you 
study  them  now.  you  will  »jnderstan(l  them  when  you 
take  the  test 

The  total  testing  lime  is  three  hours.  Each  test  book 
is  divided  fnto  six  30-mlnutrf^ectlons 

2  SAT-verbal  sectlons(a  total  of  Mquestlons) 

2 SAT-malhemalical  secttons(a  total  of  60 questions) 

1  Test  ol  Standard  Written  English  (50  questions) 

1  section  of  experimental  verbal,  mathematical,  dt' 

TSWE  questions,  which  do  not  count  toward  your 

score 

The  questions  in  the  experimenlil  section  are  used 
to  maintatn  the  quality  ol  the  lest?  and  to  provide  t s 
sentlat  information  for  future  editions  The  arrange- 
mom  of  sections  is  not  ihe  samo  i»i  overy  edition  of  the 

tost 

Within  each  group  of  questions  of  i  e  lame  type,  the 
questions  are  arranged  more  or  less  according  to  dlfH 
cuity  The  easier  questions  are  usual  /  at  the  beginning 
ot  *ne  Cfoup  and  the  more  difficult  at  the  end  There- 
lore,  it^you  are  working  through  a  set  of  question^  of  a 
particular  type  and  you  find  that  the  questions  are  be- 
coming difficult  for  you.  simply  read  quickly  through 
the  remaining  questions  In  the  group,  answering  only 
those  that  you  feel  you  know  You  should  then  begin 
working  on  the  next  group  o!  questions.  You  can  return 
to  the  questions  you  omitted  if  you  have  time.  Rcmem 
ber.  you  get  |ust  as  much  credit  for  correctly  answering 
easy  questions  as  forcorrectly  answe'ring  hard  ones 

You  get  one  P9lnt  for  each  question  you  answer  cor- 
rectly, andyou  lose  a  fraction  of  a  point  lor  each  ques- 
tion you  answer  Incorrectly  You  neither  gain  nor  lose 
points  for  questions  you  omit  (See  page  44  for  scoring 
information ) 
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You»q)a>  do»  scratciTwork  in  th«  t«st  book  ht  mark 
qu«sllo7Sxp«t$iTiltt*d  and  may  want  to  go  back  to.  You 
shouid  txtra  marks  o(>  tha  answer  st>^et, 

cause  they  could  b«misrsad/sanswei;s  by  th«  scoring 
machlna,         •  "X,,    /    ^  , 

Becausa  of  the/wiyjli^ast.U  tcorad,  haphazarllor' 
random  guassing  lor  ciuostions  you  know  nothing 
about  is  unltkely  to  changa  your  score  Whea  you  know^ 
that  ono  or  mora  choiCQ5  can  ba  allminattd.  guasslr^ 
from  amono  the  ramaining  choices  should  ba  to  your 
advantaoe 

Many  studan;s  who  do  wall  on  the  SAT  omit  $oma 
questions  Many  students  who  racoiva  average  or 
slightly  above  average  scores  answer  Uan  40  to  60  per 
cent  of  the  questions  correctly.  Questions  vary  in  diffi 
cuity  Some  are  answered  correctly  by  a$  many  as  90 
percent  of  the  students,  but  some  are  answered  cor* 
rectly  by  as  tew  as  10  percent 

Suggestions  for  answering  specific  types  of  ques- 
tions follow,  '  * 


SAT'VERBAL  SECTIONS 


There  are  four  types  of  questions  in  the  verbal  sections 
oi  the  SAT  25  antonyms,  20  analogies,  15  sentence 
vompioiions.  and  25  questions  based  on  reading  pas- 
sages The  antonyms  usually  take  the  ieast  time,  fol 
rowed  by  analogies.  senUnce  completion  questions, 
and.  finkiiy.  the  reaching  comprehension  questions 
HjQh  scoring  students  can  do  between  2  and  3  ant 
onyms  a  minute,  but  the  same  studenU  may  take  more 
than  7  minutes  to  read  a  400-word  passage  and  answer 
5questioi)s  onit  i 
A  Your  answers  to  the  85  questions  in  the  verbal  sec- 
tions make  up  your  total  verbal  score  (See  page  44) 
Tne  score  report  you'll  receive  will  also  show  two 
subscotes.(l)  a  vocabulary  subscore,  based  on  the  ant 
onym  and  analogy  questions.  (2)  a  reading  subsc^^e. 
based  on  the  sentence  completions  and  the  questions 
on  reading  passages 

•  A  coretul  balance  of  reading  materials  and  words 
drawn  from  a  variety  o(  subject*mat(er  fteids  helps  as* 
sure  that  the  test  is  fair  to  students  with  different  Inter- 
ests However,  no  specialised  knowledge  in  science, 
social  sciences,  hterature.  or  other  fields  is  required. 


word  Of  pIvaM  that  ta  mott  n«arty  %ppo*H9  In  mteninf  to  the 
«rerd  In  eapital  Mtera.  Stnca  some  of  the  quaations  raquira 
yau  to  diatinfuiah  Una  iha^a^jif  maapirtf.  eantldaf  all  the 
ehokaa  iMlora  ^acWiof  wtikh  la  keat.  * 


Antonyms  (opposite a) 


Antonym  questions  test  the  extent  of  your  vocabulary 
The  vocabulary  used  in  the  antonym  questions  (n> 
eludes  words  that  high  school  students  come  across  fn 
(heir  general  reading,  although  some  words  may  not  be 
thekindthatyouuseinoverydayspeech  ^  » 

Qiry^^lcrt^.  Each  quMiiofl  balow  eantlitt  of  a  ward  (n  capital 
iaUara,  loiiow«4  ky  riva  iattarae  warda  or  phraaaa.  Choose  tha 


GOOD:  (A)  lour  (!)  t^ad  (C)  rad 
(0)  hal  (E)  ugly 

<s>m<s>'Z><t> 


J 


You  can  probably  answer  thli  example  without  care- 
fully considering  en  of  (he  choices.  However.  moSt  of 
Ihe  antonyms  in  the  verbal  sect'on  require  more  careful 
analysis.  When  you  work  on  antonym  questiori*.  re> 
member  that: 

1.  Among  the  five  choices  offered.  y|u  are 'looking  for 
the  word  that  means  the  opposif  l^he  given  word 
No  words  that  have  the  same  tneamng  as  the  given 
Word  are  Included  among  the  five  choices  * 

2.  You  are  looking  for  the  X>*st  imwt  Read  all  of  the 
choices  *>efore  deciding  which  one  is  best,  even  if 
you  feel  iu;e^ou  know  Ihe  answer.  For  Example 

SUUeOUENT:  (A)  primary  (D-racaat 
(O  cantam»»fary  (0)  piktr  (O  limutlanaous 

Someone  working  quickly  might  choose  (B)  recenf 
because  it  refers  to  a  past  action  and  sut>s%qutnt 
refers  to  a  future  action  However.cholce(0)p/-/or  is 
thet>estaniwerx 

3.  Few  words  have  exact  opposites.  that  is.  words  thiT 
are  opposite  in  all  of  their  meanings.  You  stouid  find 
the  word  that  is  mo^r  neer/yopposlte  For  example: 

FEKMCKTINQ:  W  InVrevlslof  (■)  ttaonatinf 
(O  Mivarinf  (0)  plunfinf  rfaajMy  (E)  ditaolvinf 

£ven  though  t%rm*nung  is  normally  associated  with 
chemical  taactions.^hereas  sttgntttng  Is  normally 
associated  with  water,  t*m*nung  means  being  agi* 
taled  and  attgntttng  means  being  motionless. 
Therefore,<hoice  (B)  sfgntting  is  the  best  antonym 
o\  fttmtnVng. 

4  You  need  to  be  flexibIeK  A  word  can  have  se«erel 

meanings.  For  example. 

OEPftCU:  (A)  (area  (■)  aRaw  (C)  clarify 
(0)  aUte  (E)lao»an  * 

The  word  dtprtsi  ^an  mean  'to  push  down." 
However,  no* word  meaning  "to  lift  up"  is  Included 
among  the  choices.  Therefore,  you  must  consider 
another  meaning  of  dtpross.  "to  sadden  or 
discourage."  Option  (0)  e/«fe  means  to  fill  with  toy 
or  pride.  The  best  answer  is(0)  •Itt: 

5  You  could  try  to  put  the  word  In  a  sentence.  If  you 
don't  know  the  dictionary  meaning  of  a  word  but 
have  a  feeling  for  how  the  word  should  be  used,  try 
to  make  up  a  short  phrase  or  sentence  osiog  the 
word.  This  may  give  you  a  clue  as  to  which  choice  is 
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an  oppositt,  •v«n  though  you  may  not  t>*  abto  to 
d«fm«  tht  word  pr«ci5«iy 

tNCUMtENT.  (A)  coo$c»ou»   (•)  •HoftI«»» 

On9  o>  the  mtanings  of  incumt9Qt.  and  th«  on«  you 
may  Know  btst,  "th«  holder  ot  *n  ofhco"  as  <n  th# 
seMerJco!  The  incumbent  president  usually  has  a 
better  c^anC«  of  winning  an  •lection  than  th# 
chaU«ng#r'\How«vtr,  an  opposite  of  that  mMning 
IS  not  inc!u(J«d  In  th«  cholcos<Tfy  to  thJnk  of  another 

*  ust  of  incumOtnl,  such  as  in  the  sentence.  is  in* 
cumb*nt  opon  m»  to  finish  this  '*  If  you  can  Ihlp)^  of 
such  a  phra*t.  you  reahzo  that  fiicumb^nt  m«ans 

/"imposod  as  a  duty"  of  "obligatory  ** 

'Of  tht  hv»  choices.  (A).  (B),  and  (0)  af«  in  no  way 

*  opposites  61  incumOfot  and  you  can  easily 
enminatt  thtm  Choice.  (E)  means  "not  ptrtlnent" 
and  Chojce  (C)  mtans  *'not  compulsory "  Although 
Choice  {£)  may  look  attractiJ^/.  choic*  (C)  optional  (s 
morA  nearly  an  txact  opposite  to  wcumbenl  Choice 
(O.thtrefortJs  tht  answer 

6,  0»caus»  answering  antonyms  depends  on  knowing 
th*  fTieinings  and  uses  of  words,  memorizing  wofd 
j'sts  JS  probably  of  littto  uso^  Anything  thOl  htlps  you 
to  think  aoout  words  and  how  they  art  used  *m 
proves  your  vtrbat  ability  and  Is  likely  to  improve 
your  porlormance  on  antonyms  and  other  kinds  of 
vf  rbai  questions  Read  t»rofu)ly  some  moderately 
complex  books  or  some  good  magazines  on  topics 
with  which  you  are  not  familiar  If  you  come  across 
unfamiliar  words  that  you  can't  understand  from  the 
context,  use  a  dicljonary  Oo  crossword  purzios  or 
play  word  games  with  your  (nends  ot  family  Tr.eso 
exercises  should  be  at  i^ast  as  helpful  as  studying 
word  nsts  and  certainly  more  interesting 


Analogies   

Analogy  questions  test  your  ability  to  see  a  relation 
ship-  In  a  pair  of  words,  to  understand  the  Ideas  ox- 
pressed  in  the  relationship,  and  to  rccogmze  a  siri)itaf 
or  parallel  relationship 

Djrjcti22i:  e»ch  Qu#«tlon  t)«Hw  comUti  oi  •  r»l«t»<J  ptir  of 
wofdt  ot  9>>fft.  lo\Uiw4  fcy  •♦tttrtd  ptl"  ol  wordi  w 
phf  at**.  S«l«ct  th«  Utt»T»d  ptIr  thai  k#it  •  fttWon- 

ahip  tlmlUr  lo  IhtHipf  mi    In  th«  wlgtntt  ptIr 

 — —  -«4 — 




;  EXAMPLE: 
1  TAWNriOREDOM    (A)  drtim :  ••♦♦p 

I  (B)  ing«frmtdr>«t»  (C)  imll«*tmuiem«ni 

I  (0)  lic«.'»«pf»»»lon  * 

'  •      (E)  »mpttl«oct;f»b*Hk>n 


Wnenyou  answer  analogy  questions. 
i  Try  to  establish  a  precise  relationship  between  the 
first  two  word?  before  examlnlr^g  the  answer 


Choices  State  this  relationship  as  cfeirty  as  you  can 
In  a  sentence  or  phrase.  Next,  find  the  choice  with  a 
pair  ol  words  that  have  VOe  same  relationship,  and 
that  express  the  same  Idea  as  the  original  pair  of 
words  In  the  example  above,  a  yawn  is  a  sign  of 
boredom  m  the  same  way  that  a  smile  {*  a  sign  of 
amusement.  Another  example  is  the  following. 

SUBMISSIVE  lEO    (A)  w»«Uhy ;  •mpJoytd 
(B)  lntol»r«nl :  Indutfl^d  (O  humt>l» .  homHlat»d 
(D)  IfKOfrt^lbU:  taught 
(E)  incoo»plcueui,o*»r»ook»<J 

The  relationship  between  submtssfve  and  fetf  could 
be  expressed  as  "to  be  submissive  »s  to^bo  easily 

Jed  '  Only  Choice  (E)  has  the  same  relationship  as 
submissive  an<J  ltd.  "to  be  Inconspicuous  Is  to  be 
easily  overlooked"  parallels  "to  be  submissive  is  to 
be  easily  fed  ' 

Although  the  wealthy  may  find  It  easier  to  get  em 
ployment  than  do  the  poor,  the  statement  "to  be 
wealthy  is  to  be  easily  employed*  is  an  expression 
of  opinion  and  not  an  expression  ot  tho  relationship 
between  the  words  according  to  their  dictionary 
meanings  Remember  that  the  relationship  that  is  to 

.  be  estabiishedjbetween  the  two  words  should  take 
mto  account  eithor  the  dictionary  or  implied  mean 
fngs  of  the  words. 

2  Practice  recognizing  relationships  Below  are  Ihree 
examples  of  the  relationships  that  could  be  used 

SONO  .  REPERTOIRE    (A)  scof»  m«lo<Jy 
(•>  lnilrym«mi:irtlit  (C)  solo: chorus 
(0)  b*n»dietloniphurch  (E)  »ult:wirdrob« 

Tho  best  answer  is  choice  (E)  The  relationship  be 
Iween  the  wojds  can  be  expressed  as  "several  (first 
word)  make  up  a  (second  word)  "  Several  (songs) 
make  up  a  (repertoire)  as  several  (suits)  make  up  a 
(wardrobe),  * , 

REQUEST  .  ENTREAT    W  control :  •xplod* 
(•)  «dmtr»:Woll2»  (C)  borrow :  itttl  .y\ 
(D^  r*p«tt.pl«td  (E)  cenc«l  lnvatldat«  ^ 

The  best  answer  Is  cbolcei,(B)  Although  both  words 
have  simitar  meaning*,  they  express  different  de- 
grees of  feeling,  To  (entreal)  is  to  (request)  with 
strong  feeling  as  to  (Idolize)  is  to  (admire)  with 
strong  feeling. 

To  answer  analogy  questions,  you  must  think 
carefully  about  thf  precise  meanings  of  words  For 
instance*  If  you  thought  the  word  "entreat"  meant 
only  "to  JSk"  instead  of  "to  ask  urgently."  you 
would  have  trouble  establishing  the  correct  rela- 
tionship betweert  ^eqyeif  and  tnffit 

FAilNEl STARVATION:: (A)  Mo99i(U>od 
(•)droofhtiv»9otil!oft  (Cr  wirMrwty 
(0)  iuccMi:«ehl«v«m«nl  (E)  ••♦d:mutitk>fl 

the  best  answer  is  choice  (A)  (Famine)  results  In 
(starvation)  a*  •  (deluge)  results  i^a  (flood) 
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3.  Don't  !>•  mttl*d  by  rt)atlon»hip9  that  art  clos«  to 
•but  not  piratUt  to  th«  rvtatlonship  In  tht  orlgln»t 
P>!t  Altjof  th«,pair9^of  words  list*:)  in.th«  cholcM 
havo  r«t«l)onsh[p9  that  can  b«  stal*d;  how«v«r,  th« 
corract  answer  has  most  nearly  th«  sam«  rotation* 
Ship  as  th«  original  pair.  Look  at  th<i  foliowing  •xam- 
prt. 

KN(fE:iNCI9iON::<A)  tMlMM*r :  •ic4v«ll*n 
(I)  tMl :  Of«r«tlon  (C)  p»ncn :  enlculatlon 
(D)  h«M ;  KTlfail*n  (E)  ^tvw :  jfiteuHura 

On  th«  most  g«n«rat  l«v«),  th«  relationship  b«twMn 
k/Ht§  ind  fncfsfon  is  that  th«  obj«ct  indicated  by  th* 
first  word  Is  us«d  to  perform  lt)«  action  indicattd  by 
th«  s«cond  word.  Since  "a  knif*  is  us*d  to  mak«  an 
((p'cislon)."  "a  bulMozar  Is  us#d  to  makt  an  (•xcava- 
tion);  and  "a  hos«  is  us«d  for  (lirigalion).  th«r«  ap- 
peal to  two  corrtct  answars.  You  nead  to  go  back 
and  stala  th«  relationship  mora  pracisaty.  Som«  as- 
pect of  tha  relationship  between  the  original  pair  ex^ 
ists  in  only  one  of  the  choices.  A  more  precise  rela- 
tionship b9tw««n  knif  and  incision  could  be  ex- 
pressed as.  "a  knife  cuts  into  something  to  make  an 
incision  and  "a  bulldozer  cuts  Into  something  to 
make  an  excavation.  This  relationship  eliminates 
/lose  irngatlon  as  a  possible  answer,  and  no  other 
relationship  between  hos* .  frrfgauon  parallels  the 
relationship  to  knif.fnclsfon  as  walK  The  best 
answer  is  choice  (A) 

4.  Remember  that  words  can  have  more  than  one 
relationship.  For  example: 

PRIOE  i  LION ;  '*  (A)  inaha :  python  (I)  p«ck :  wolf 
(O  rat :  nmtf  (D)  bird :  itinlnf  (E)  4^ :  eanln* 

A  possible  relationship  between  prl<it  and  Hon 
might  be  that  "the  first  term  describes  a  character- 
istic of  the  second  (tspectally  in  mythology) "  Using 
thiS  reasoning,  you  might  look  for  an  answer  such  as 
wisdom  owf,  but  none  of  the  given  choices  has  that 
Kind  of  relationship.  Another  relaUonship  between 
pr/(^e  and  Hon  I3  "*  group  of  lions  Is  called  a  pride"; 
therefore,  the  answer  Is  (B)  pac^  wolf,  "a  group  of 
wolves  Is  called  a  pack" 


S«nterKe  Completion  OtMttlone 


Sentence  completion  questions  test  your  ability  to 
recognize  the  reletionships  among  parts  ot  a  sentence. 
You  are  given  a  sentence  from  which  one  or  two  words 
have  been  removod  a<>d  asked  to  complete  the  sen* 
tence  by  choosing  the  word  or  words  that  are  conils- 
teat  with  other  parts  Sentence  completion  questions 
ask  you  to  know  the  words  listed  as  choices  and  their 
proper  use  in  the  context  of  a  sentence.  The  sentences, 
taken  from  pubilsha<f  material,  cover  a  variety  of 
topic*  Each  sentence  provides  enough  Information  so 
that  you  can  find  the  correct  answer  without  any  Intor 
mation  beyond  whatis  contained  in  the  sentence  itselL 


pifOCtMe:  EMh  tentence  Mew  h«4  ene  er  hvo  Wenkti  each 
Mank  k»«c*(lnff  that  MnwttMnf  h«a  been  emitted,  teneath 
lh«  eentenoe  are  Ihrt  lettered  wertfe  ec  tete  of  wertfa.  ChMM 
th«  wt4  er  ei  werrfe  that  iH«  the  rneeninf  »!  the 
Mntenee  at  a  wttote<  " 


EXAMPLE: 

Aitheufh  Ita  puMkHy  he*  been  — ,  Iho  nim  Itsetl  U  lntelU< 
f«nt«  well-ectetf,  hanrfeemefy  pretfueerf,  and  aitefettter ». 

(A)  teateleM . .  reepectaWe  {n)  wtonahrt . .  moderate 
(O  aapMitlCiM . .  amateur  (D)  rla^  >  >  cnide 
(L)  perfect . .  epecttculer 

•<C<D(I><D 


The  word  Mfthough  suggests  that  the  publicity  gave  the 
wrong  Impression  of  the  movie,  so  took  for  two  words 
thkt  are  more  or  less  opposite  in  meaning.  Also,  the 
second  word  has  to  fit  In  with  "intelligent,  well  acted, 
handsomely  produced."  Choices (8),  (0).  and  (E)  are  not 
opposltes.  Choice  (C)  can't  be  the  correct  answer  even 
though  sophfstlcMfd  and  tmtttur  are  nearly  oppo- 
sltes. because  an  "Intelligent.  well>jicted.  handsomely 
produced"iilm  isn't  amateurish.  Only  choice  (A),  when 
inserted  jn  the  sentence,  gives  a  logical  statement. 

Here  are  some  suggestions  to  keep  in  mind  when 
you  answer  sentence  completion  questions 

1  Bead  the  entire  sentence  carefully;  make  sure  you 
understand  theideas being  expressed. 

2.  Don't  select  an  answer  simply  t>ecause  It  Is  a  pop* 
ular  cllch^  or  "sounds  good.** 

3  Look  for  grammatical  clues  within  the  sentence.  For 
example: 

The  axcllMnent  doe*  not    but  —  hU  senM«.  gltlng  him  a 
XMner  perception  ei  a  thouaand  delalla. 
(A)  •lMr..eiv«ni  (■}  blur..charp«ni 
(O  ewnila,.con«lffcta  (0)  heighten  «tflr«v«tM 
(E)  fer*w*m..qulck*n« 

The  word  but  implies  that  the  answer  wlli  Involve  two 
word*  that  are  more  or  less  opposite  tn  meaning,  if 
you  keep  this  In  mind,  you  can  eliminate  all  of  the' 
Choices  except  for  {Q)  biar .^sharpens  Only  the 
words  in  choice  (8)  Imply  opposition  Also,  "sharp* 
ens  his  senaes"  Isconslstent  with  tha  notion  that  he 
had  a  "keener  perception  of  e  thousand  details." 

4  If  the  sentence  has  two  blanks  to  be  filled,  make 
sure  that  both  words  make  sense  In  the  sentence 
For  example: 

They  arfue  that  the  author  wae  determined  te  —  hia  ewn 
cencluilen,  »o  he  —  any  tnformatton  thai  eid  not  lupport  It. 

(A)  upheM . .  Ifneree  (I)  reviM.  .  eeetroyed 
(C)  Wvance 4eYl«ed  (D)  dliprova . .  aletoiled 
(E)  reverte . .  eianf  lM*lod 

The  first  words  ir)  Choices  (A)  uphold  .  ignor§a  and 
{0}  tdvanc* . .  a§vis§a  seem  all  rIghL  However,  the 
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Mcond  word  In  cholc*  (C)  •dyne^  <J«fls«d  do«i 
not  mak»  s«ns»,ln  th«  s«ntinc«j  why  would  an 
author  who  wlsh»<J  to  ldv«nc«  his  theory  d»vls»  tfv 
formttlon  that  did  not  support  It?  Or)ly  choice  (A) 
m«k«s  a  logically  conslstant  stntanca. 
Mr.        i*  •  tktftJc. -  to  \>tttrf  th»t  !h«  $ccnt-i  •(>ln- 

(A)  ^•o* . .  Inf (■)  •trtW  - .  m\»S—4ity9 
(O  lnciln«4..Mlfl«W«  (0»»»ck..»»t«l"c«nt 
(E)  ««f*«W..*rr««M«ut 

Th#  words  to  b«  Inwrttd  In  th«  blank  spacaa  In  tha 
quastion  abova  must  ratult  In  a  statamant  that  Is 
conslstant  wl;h  tha  daflnltlon  of  a  skaptic  Sinca  a 
skaptic  would  hardly  consldar  th©  accapted  opinion 
o1  tha  malorJty  as  fnf%mbl%  luttm*t)f,  or  stgnlfh 
cam.  you'can  allmlnata  choicas  (A),  (C).  and  (0),  A 
skiptic  would  not  ba  a/^a/dthat  tha  acciptad  opin. 
ion  of  thf  majority  Is  misMlng.  ha  would  ballava 
that  It  waa  Tharafor©,  choica  (B)  is  not  corr©ct  Only 
Choice  (E)  dfSf>os»<f  •rrotfous  yields  a  logical 
santincr 

5  Afiar  chooaino  an  answar.  raad  tha  antlfa  sant©nca 
toyoursiif  Maka  sura  that  thi  saotinca  is  logical 


RaadlrYg  PaataO«t 


Tha  raading  comprahinslon  saction  ot  tha  SAT  pra* 
sants  a  fairly  familiar  task,  aspaclally  (f  you  hava  read 
widaly.  Tha  raadlnjj  comprihanslon  saction  t©sts  a 
variaty  ol  skUls.  Soma  quastions  last  your  und©fstand 
ing  of  What  Is  statad  diractly.  Somatlmas  you  havi  to 
ntarprat  and  analyza  what  you  r©ad.  Soma  quasllons 
tast  your  ability  to  racogniz©  applications  of  tha 
author's  ^rlnclplas  or  opinions  Oth€rs  raquiro  you  to 
judgawnat  you  havar©ad-toldantlfy  strong  and  waak 
points  In  tha  prasantatlon,  to  ditarmlna  how  wall  the 
author  supports  any  claims  with  avldinca',  and  to 
racogmza'  tha  m<»ans  by  which  tha  author  communl- 
catas  DOlnts  Each  tist  contains  passagas  drawn  from 
tha  following  cat  ©gorlas' 

Narrativ©-  (nov©ls.  short  storl©s.  blographlas, 

assays) 

Biological  Sclonca.  (madlctna.  botany,  zoology) 
pnystcat  Sciinca-    (chamtstry.  physics,  aatronomy) 
Humanltias  (art.  Ilteratura.  music,  philosophy, 

folklor©) 

SpclalStudi©»       (history,  aconomlcs.  sociology, 
Oovarhm©nt) 

Argumantativa:  prisintationol  a  dadnlta 

point  ol  viaw  on  som©  subjact) 

Each  passaga  contalna  all  tha  Information  you  naad  to 
answar  a  qua$tlon  Howavir.  passagis  about  sub|ects 


you  ara  familiar  with  or  Intartitad  In  may  ba  aaslar  for 

you.  If  you  find  •  pMiaga  th»t  saams  difficult  to  you, 
akip  It  and  go  on.  You  will  ba  omitting  only  a  faw  quas- 
tlona  and  you  wHI  ba  tavlng  youfsaH  tima  that  can  ba 
battaru$ad»omawharaalta. 

Is  It  battir  to  raad  tha  questions  balora  raading  tha 
pissaga?  Probably  not.  but  th|.contant  ol  a  pasaaga 
may  hilp  you  daclda.  For  Inttanca.  If  you'ra  good  In 
sclanca.  you  may  follow  tha  reasoning  In  a  tclanca 
passaga  and  ramambar  most  ot  tha  datalla.  Looking  at 
tha  quaatlons  bafora  you  raad  tha  sclanca  patsaga 
would  probably  ba  a  watte  of  tIma  for  you.  Howavar.  If 
you  find  sclanca  passagas  confusing,  raading  tha 
quaatlons  first  may  ba  worth  your  tIma.  Whll©  you  ara 
doing  tha  s«mpla  last,  try  both  mathods  and  »«•  which 
works  battar  for  you  In  tfrms  of  salacttng  thatorrac^ 
answ©r  quickly 

Raad  closaly  and  attantlv©ly.  Follow  tha  raasoning, 
notica  how  aach  placa  of  Information  ralatos  to  tha 
tdaat  l>«lng  prasantad  Notica  attltudis,  tona,  and  g«n- 
aral  styla.  You  may  want  to  chack  an  Important  fact  or 
Idaa,  but  don't  watta  tIma  undarllnlng  or  making  notts 
In  tha  margin.  Try  to  g©t  a  sansa  of  th©  principal  Idaas. 
(acts,  and  organization  of  thapassagt. 

Aara  ara  aoma  suggastions  that  may  ba  halplul 

1.  Raad  all  ol  thacholcas  bffora  you  salact  an  answer, 

2.  Answar  quastions  on  tha  basis  ol  what  Is  In  tha  pas- 
sagi.  Do  not  answar  quastions  on  tha  basis  ol  your 
parsonal  opinion  or  knowledga 

3  Answar  th©  question  that  Is  askad  Do  not  pick  ona 
ol  tha  cholcas  simply  bacaus©  it  is  a  trua  statamant 

4.  Mak©  sura  that  tha  answer  you  choos©  i«complitaly 
corf©ct.  Do  not  ba  mlslad  by  cholcas  that  ar©  par 
llally  trua. 

Savaral  typas  ol  qflastloni  ara  ask©d  about  th©  pas- 
sagas.  6oma  qu©stlons  tast  your  ability  to  dilfirintlata 
b^twaan  tha  main  td©a  of  a  passag©  and  secondary  and 
supporting  Information  In  ^nswaMng  quastions  that 
ask  for  tha  rnain  Idaa.  don  t  ba  dlstractad  by  stata- 
mants  that  %f  trua  according  to  tha  passaga  but  that 
ara  s#condary  or  supportlva  to  th©  cantral  point  Balow 
is  a  Short  axc©rpt  from  a  passag©  that  prasants  a  par- 
ticular point  of  vlaw  of  Plato's  flapu6//c,  Tha  author  of 
this  passaga  a3<prass©s  idtas  strongly  so  th©  passaga 
would  ba  classlllad  aS  argumantativa, 

Mfctlafii;  Tha  katow  I*  laltawad  by  qw^ttoo*  bavad 

•n  H*  e«it»nt,  Aniwar  til  fl|u#«tlan»  lalk>wlftfl  tha  p««*af«  oo 
tha       al  whtt  U  ttotW  or  !mpti94  In  thtt  ptMf' 

That  ««to'i  ftfpuklfc  •hooM  hava  baan  •rfmlrad.  on  Ita 
fcmckl  •\49  by  ^inl  f>»»p\;  «•  9»ttfp»  tha  maal 
••tonlahlof  •%»m^i» al  Mfr/  »iv>bbafy  In  Hi  Wttwy. 

Lat  M  cortaJiaf  •  law  ^lnt«  In  this  t«tillt»ri»n  tr.cl.  Tha 
maM  pur^aaa  of  aducaiten  I*  to  a^odoca  cajiraga  In  b«tlto.  Ta 
thJ*  and,  thaca  !•  to  ba  •  rifW  can»o#»Wp  ol  tha  ttoft**  told  by 
mothart  ttKl  nurtat  to  yo«of  chlWrafi:  thar«  I.  to  ba  no 
raaaing  ol  Hamaf  bacnuta  th»t  <a|r»dad  w»IHar  m»kM 
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b«c«u««  H  c«Al«tnt  rJIUIn*  in^  wfWrn  frMi«k:  !•  to  k«  only  •# 
certain  lint*,  which,  in  mo««m  t«rm«.  w«utd  t>*  mllHtry  k«ndt 
p(«Y<nt  "My  Country  TI»  •(  Th**"  »ttt  "Sltr*  and  StrtpM 
Forme" 

A/n$tnid$$i  question  that  might  b«  asK«d  Is. 

(A)  Mil  c«ntMnfi  on  th«  kind  ci  music  advocator  tn 
Waio"t«#^Wfc 
.  jl)  riMCflM  I  ha  eantani  of  PI«<o'»  Ao^Mfe 
(0-4tac4j|«  tha  »o«HI««  and  nof^tlvt  aa^t*  of  Plato's 

(D)  ahMr  how  riato'a  ^a^Mfe  inftuaA^j)^  Ihro*  of 
>af  >a  at  tha  tima      """"---^  ^^""^ 

(E)  cfltlcM  tha  political  phUoa«pfif-c*niainad  in  Plato's 
Aa^Mc  '^^^^ 

Another  m*ln id—  quasdon  that  might  ba  asKad  is 
2<  Which  al  tha  foltowlAg  wouM  bo  tha  most  appropdaia  titia 
forlhapa*«*ff*7 

(A)  Tho  PaHactloft  of  Plato's  AapwMc 

(■)  Why  Plato's  ^•0vt>ifc  Ha  a  S^n  Consoftd 

(O  Plato's  AapwMfc; A  Tataliiadan  Trad 

(D)  Tho  HaroM  af  Plata'a  R»pvbtic 

(E)  Plato:  TAoiMo/afrtf 

Both  quastlons  raquira  only  that  you  urfd«rstand  tria 
main  point,  which  tha  author  makas  in  the  first  two 
9onttncts.  the  rosi  of  tha  passage  givas  supporting 
datail  Nota  that  the  main  point  of  a  passaga  is  qot 
always  stataO  at  tht  beginning.  In  quastlon  1,  tha 
statement  in  choice  (A)  mentions  ona  of  tha  sup- 
porting points,  not  tha  main  tdaa  Choica  (8)  give& 
soma  of  tha  contant  of  the  passage*  but  tha  main 
thrust  of  tha  passage  (S  much  mora  nagativa  than 
tha  slatamant  ir)  choica  (8)  Choice  (C)  Is  inaccurata 
""bacausa  tha  author  doasn't  admit  that  tha  book  hAs 
any  positiva  aspects  Choica  (D)  Is  not  supportad. 
Only  Choica  {E)  ad»quataly  dascrlbas  the  main  idaa 
For  trta  second  question,  follow  the  Klad  of  analysts 
made  of  question  1  You  M  see  Uiat  only  option  (C) 
accurately  reflects  the  main  Idea  of|he  passage 

Another  typa  of  question  asks  for  details  stated  In 
the  passage.  Once  agalP.  be  sure  to  answer  the 
question  that  <s  asked.  For  example; 

3.  Acco<atn«  to  tha  passaffa.  «mkh  of  tha  i^UMn%  sr* 
statamants  of  Prate's  baliaf »7 

I.  Drama  should  aipoMlhawaakr>t«M«  of  Tillalns. 

II.  Only  ihoM  P«fts  of  Hamof  doalbtf  with  tha  h«f  o««  irtd 
9oda  may  bo  uaad. 

I  IK  StartM  toM  to  chMdran  thould  be  strong  lycansof  ad. 
(A)  lanly   (!)  1 1  only  (O  III  only 
(D)  llandlllaniy  (E)  I.  II.  and  III 

Statement  I  <t  inaccurate  bacause  r)o  drama  is  per 
milled,  anc)  statement  i)  is  inaccurate  as  no  parts  o\ 
Homer  may  be  read  Onty  statement  ill  <s  accurate 
and  the  correct  answer  IS  cholco(C) 

You  can  use  partial  information  to  hoi0  you.^aven 
if  you  ro  not  Sure  of  tho  answer  in  the  question 
above,  it  you  Know  that  statement  i  is  incorrect^  you 


cart  eltmlnate  choices  (A)  atv)  (E).  leaving  onty  three 
other  answers  to  choose  from.  II  you  are  doubtful 
about  iV  but  sure  of  III,  you  can  eliminate  (A),  (E).  and 
(8).  leaving  you  one  chance  in  two  of  Choosing  cor 
rectly  between  (C)  and  (0).  ' 

4.  The  paaanfa  imfaata  that  all  ef  tha  lollewlAf  are  lof* 
blddMi  In  Plato's  ffapwaffc  EXCEPT 

(A)  dartco  music 
(■)  patrlMic  mttalc 
(Q  p<*y*  "bout  villalna 

(D)  podrayalaofthaamutomaniaofthatoda 

(E)  ttofloaabouipeorpoo^ttaallnoioleedlhalrlamnioa 

Question  4  asks  you  to  identify  which  of  the  choices 
is  not  forbidden  Since  the  author  mentions  only  that 
songs  played  by  military  bands  are  permitted,  you 
must  recognize  that  the  suggestion  Is  that  patriotic 
music  Is  allowed.  This  Is  reinforced  by  the  connote*, 
.  ttons  of  the  titles  ol  the  songs  given  as  examples. 
Thecorrect  answer  Is  option  (B) 

Some  of  the  questions  ask  you  to  evaluate  or  inter- 
pret the  passage.  FollbwingJs  an  eiremple  of  such  a 
question: 

5.  The  author**  attitude  toward  Plato's  AajivMe  l«  on«  of 
(A}  quiet  cencam  (!)  cautious  accaptanco 

(O  reverent  admiration  (D)  outrafad  disapproval 
(E)  total  indlllarence 

Question  5  requires  you  to  Identify  the  author's  atti 
tude  toward  Plato's  philosophy.  A  strong  attitude  of 
disapproval  is  evident  in  almost  every  sentence,  but 
most  obviously  In  line  4  In  which  the  author  refers  to 
Plato's  Republic  as  a  "totalitarian  tract,"  The  cor- 
rect answeris(O) 

You  can  Improve  your  reading  comprehenslofkby 
reading  extensively  and<  what  is  most  important, 
thinking  while  you  are  reading  II  you  ha)(«  limited 
your  reading  to  only  one  cr  two  particular  topics, 
practice  reading  about  unfamiliar  subjects  Many 
bocks  and  good  science,  news,  literature,  and  art 
magazines  provide  interesting  material  While  you 
are  reading,  follow  the  author's  argument,  line  ol 
reasoning,  methods  used  to  make  a  point,  and  the 
implications  of  what  Is  said. 


SAT-MATHEMATICAL.  SECTIONS 


Some  questions  in  the  mathematical  sections/of  the 
SAT  require  you  to  apply  numerical,  graphic. 'spatial, 
symbolic,  and  iogical  techniques  to  situations  famlHar 
to  you,  these  may  be  similar  to  exercises  In  your  text 
books.  Other  questions  may  require  you  to  do  ^ome 
crlginal  thlnkinP  The  mathematical  preparation  ox 
pected  Is  a  year  ol  algebra  and  some  geometry.  At 
though  moat  of  the  geometric  ideas  involved  are  us 
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u»Uy  taught  m  the  ©lomenlary  and  luntor  Wgt)  yoars,  a 
few  of  the  questions  Invojve  topics  that  are  first  taught 
in  high  school  geonrietry.  Many  of  these  geonrietric  con- 
cepts are  reviewed  In  the  material  that  follows. 

Two  types  of  multlpte  cholc«  questions  are  used  In 
the  SAT-mathentatlcal^eectlons: 

1  Standard  n)ulilplo-chojce  questions  (approxlnriately 
two-thirds  of  the  questions) 

2  Quantitative  con»parjson  questions  (approximately 
ooe^third  of  the  questions) 

These  types  wjtl  be  explained  later  Most  of  the  quos 
tlons  are  classified  as  arithmetic,  algebra,  6r  geometry, 
and  there  is  approximately  the  sam^  number  of  each 
type 


Some  Mathematical  Concepts 

with  Which  You  Should  B»  Familiar  

>^m/)m#f/c— basic  addition,  subtraction,  rnultlplica- 
Hon.  and  division,  percent;  average,  odd  and  even  num* 
bers,  prime  numbers,  divisibility  (for  example,  24  is 
divisible  by  8) 

>tf5#6ra— negative  numbers,  simplifying  algebraic  ex* 
presslons:  linear  equations.  Inequalities,  simple  quad- 
ratic equations:  positive  intogor  exponents;  roots 

Gtfomtffry-area  (square,  rectangle,  triangle,  and  cir- 
cle), perimeter  of  a  polygon;  cifcumftronce  of  a  circle, 
volume  of  a  box  and  cube,  special  properties  of 
isosceles,  equilateral,  and  right  triangles,  30* 
-W-90'  and  45*— 45*-90*  triangles,  properties  of 
parallel  and  perpendicular  lines.  locating  points  on  a 
coordinate  t;rid 

This  section  will  help  you  review  or  refresh  your  Knowl- 
edge about  mathematical  vocabulary  and  concepts  fre- 
quently needed  to  solve  problems. 


Words  and  Phrases  You  Should  Know 


Wh4nYoaS»*; 

PotiINt  lnt*o«rs 
N<»gaUvtlnlt«trs 
lnt*g«rt 
Odd  Numt>«fs 
Ev«n  Numbers 
Cons*cu1lvtlnl*o«rs 
Primt  Numt>«r$ 
Aytrag« 


Think;  ^ 

l.J,3, 4,„* 
'1,*2,  -3,  -4,. 

-4,  -3,-2.-1.0,1.2,  3.4,... 
1.3,5.7.1,... 
0.2.4, 

n.n  f  l.n  ¥  2....(n  h  anlnttfltr) 

2.3;«.7.11.13.l7.1f.,.. 

Th«  turn  of  tsrini  divided  by  th*  nunv 

b«r  ol  ttrint,  lor  txampt*:  A»trag*  of 


d.tl.andie  i 


11 


Concepts  You  Should  Know 


Odd  and  Evtn  Numb»r« 


Multlptlcallon: 
tvtn  X  tv«n  M  tvtn 
«vtn  X  odd  =  tvtn 

odd  X  odd  a  odd 


Addition: 
«v*n  -f  •^•n  B  tvtn 
odd  >  odd  a  tvtn 
tvtn  -f  odd  a  odd 

PtfCtnt 

Ptrctnt  mt*n»  hundrtdtht  or  numbtr  out  of  100,  lo  that 
c  40  ptrctnt  tnd  3  li  75  ptrctnt  ol  4  (btctuit  -  « 
100  * 

II  E  75  ptrctnt). 

100 

Somt  Ptrctnt  EquWtttnts     Gtntrai Mtthod  ol  Convtilinq • 


i  a  0.1  3  10V» 
10 


-  3  02  =.  20% 


J.  «  0.5  ^  50% 
2 


1.0  £  100% 

1 


±si20  s  2C0% 
1 


Fraction  -  to  a  Ptrctnt: 

b 


b  100 
X  3  lOOff ) 

Ex.mplrl.-ij 

Thtrtlort.«|  =  I00(j)  ^  75 

i  s  15.  a  75% 
4  100 


Nott:  To  convtfl  a  Irsct^ 
or  dtclmat  10  ptrctnt, 

multiply  by  100. 

PtrctnltOrtittrThan  100 
Probttm:  5  U  what  ptrctnt  of  2? 

solution:!  =i 

2 

Thtrtlort,— ,  250% 
2  100 

So,  5  Is  250  ptrctnt  of  2.  Nott  that  this  Is  tquWaltnt  lb  stytno 

thal5ls2— tlmtt  2. 
2 

Probttm:  SuttamtdSlOon  Monday  and  Sl2  on  Tutiday.Tht 
amount  tarntd  on  Tuttday  vnat  what  ptrctnt  of  tht 
amount  tamtd  on  Monday? 

An  tqulwaitnt  quttllon  it  "112  It  what  ptrctnt  ol  HO?" 


' 10  100 

1,200 
X  m  -i—  M  120 

10 

so,ii-  12^-  120% 


3io' 


ERIC 
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^■>l<m;  J  l»  wtf  t     ont  •t  1 .0007 


1.000 


10 


PrvUMtC  S«clit  AT*  t1  00  ■  M  2  p»Ut  It  t^M.  TYw  tiv< 
Inf*  In  kuyyn§  2  p^Wt  H  «(i«t  frtmnX  •!  th«  W\ 
.OMt  It  tlw  sMfl*  ^tr  rtt«? 

Mwiitn:  At  Hm  •lofta  p*k  rtt*.  2  ^trt  ««wW  e—t  $2  00.  lo 
th«  Mfinf*  it  •nty  tO,01.  nm*f*rt.  yv  mutt 

•fWWW  tt>«  fUMtM)  *^01  U  WtMt  HTCMt  Of 

izorr 

lMayM|g  m  ^i^th«Mvlnftlt0.5%«r^*f  iHfOMt. 


Ml  Ml  11  I  IMl  in  I  144 


S%ft«4  Nuwfcf  Pripirll— 

-  W  -  fc  -  » 

llx<0.x'>0 


-U-L 


Onth«nuinMrlln«  ftbov«:x<y 

y*>0 


rMixtmpI*.  -  2<  «  — 


X  ♦  Z<0 
y  «  x>0 


x<  ♦  2x  ■  xCx  ♦  2) 

x»  -  I  -  Cx  ♦  1)Cx  -  1) 

X*  ♦  2x  ♦  1  «  (x  4  DCx  4^  1)  <•  Cx  ♦  1)* 


1.  If  I  wo  Mr*lM  HoM  ir«  cwt  by  I  \tiU4  tin:  Ih*  ■lt«nia(«  kf 
FortxAfrifMr. 


2.  If  tw«  ^iH«(  Hrm  art  cut  by  ■  \Mt4  ltn«.  th«  c«frf«f«n4ifit 
■oflti  iraMiutl. 
r«r«xifnfl«: 


Motr  Wor4c  rikt  "iHvmiti  littvrtor"  or  "corrMpondlnf  ** 
t«<>«cilhf  f  ^  (••^      you  4*  n*«d  !•  know  wt 

■rtflotsroo^Ml. 


X  -f  y  -f  z  M  100 
(toe«u*«  tho  turn 
•tttMlntortor 

•  of« 
triantkitlOO*) 

X  ■  w 

(Wh*«  two  itnlfhl  ifpoo 
fntofMCt.  vort>C4(  inf 


3ij 
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y  «  30 
(•*c»ut«« 

llO'.y  ^  1M-150) 
4^  X  £  ItO) 


X  e  to 

(B»cauM4x  ^ 
»  90*)AUo,th« 
ttngthof  ald«  AC 
Ugrttttr  Ihtnlht 
Itnglhof  Sid*  BC 
(B*c»utt^BU 
g(taltrih»n^A) 


Th«  »um  ol  •«  angUt  of  Ih* 
polygon  abovt  - 
S40*b«cau<alicanb« 

dlvldMllnloStrltnglM. 
••chconUlntngllO* 

Sld«H»1>tlonihlp< 


tiAiUptralltlloCD.  Ihtn 
X  ^  y  s  llO(B*c»u»t  t  *  I  ^ 
110  and y  a  z) 


y^l 

(i*c«uaa  tha 

l«r)thofthaaid« 
opf>oaU*tha30% 
angia  In  a  right 
trtangia  ft  half 
th«  lanfthotlh* 
hypotanuaa) 

x-v^ 

(iyth*  Pythagoraan 
Thtoram. 

x»  ♦  1'  *  2» 
x»»  3 

X  c  yfi} 


X  a  y  -  10 
(liacauta  tha  un- 
marttadangtals 
•0*,  allanglatol 
ttta  triangia  tc 
•qual,and,thar*< 
tora,  alltlda*  ol 
lhalrlangia  ara 
•qual) 


X  «  y  «  45* 
(iacauta  two 
«ldatara«qual. 
tha  right  Irlangta 
l»  UotMlaaand 
ar>glatxandyara 
•qual.Alao.x  >  y  « 
90  which  makaa 
boihanglst  45*) 

Z  o  \^ 

(B*cau«a  1»  >  1»  « 


Araa  and  Partmatar  Pormutat 
Araaolaractangia  »  langth  x  width  k  L  x  W 
Parlmalarolar»ctangla  =  2(L  ♦  W) 
Examplas: 


Araa  ^  12 
Parlmatar  »  14 


Araa  ^(x-!})<x  ♦  3)  = 
x»-  9 

Parlmalar     2|(x  +  3)  +  (x  -3)1 
2(2x)  a  4x 


Araaotactrcia  *  ?rr>(whararUtharadtua) 
CIrcumlarancaof  aclrcia  «  2Tr  a  Td(wharadl»lha 
diamatar) 
£xamptas: 


Araa  «  ir(30  -  9r 
CIrcumfaranca  a  2<'(3) 


Araa  »  ir(l0  3 

CIrcumfaranca  «  T(ll)  •  llT 


er|c 
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I  1.10  .  JO  ATM  m  m  24 


X  «  2 


>  12  ♦  9  ♦  13  .  M     2x'  -  4*2 
x*«  4 

X.2) 


ArM«-l*2*2-2 

2 

P*dm«t*r  a  2  4  2  -f  2y/T 
-  4  ♦  2v^ 

J"  t 

V«Kmim«4*  tax  ■  iMtftti  X  wMth  X  h«4fM  -L-W*H 


V^hMW  >  S«3-4  .  to         V*<unM  -  Ok)(2k)(2k)  -  12k* 


Tht  formulas  and  symtxxs  givtn  Jn  lh«  directions 
that  follow  iPPMr  m  Iht  ttst  book,  Ltarning  th«m  now 
will  h«tp  you  wh«n>ou  Uk«  thttcluti  lost. 


Ok— tint:  In  ttilt  9^\m  M«h  pn^Nw.  iwlnf  tny 
««M«h  to  ttM  bMt    ttw  ihtltM  fivtn  m«  M*«ii«n  th*  Mrr*- 


Ti1«nfk:Tht 

MMMIWln 

I'fiMflX'iM. 


H^COAUtrlfMMfl*. 
'  tlMn(1)trM«(  AAtC - 

*        X  CP 
2 

tVAC*  -  AD*  4  DC* 

■  toaqiMllft'  ^maMllMnw*^!!* 

<totoMltMn  {[top 
>to| 


^^^^y  FI(Wi#  wMMi  sMMNpMiy  pfsktodw  In  Hito  to#1  v%  !!► 
tMitfc^  t#  ywWt  InftfHMlton  uMfvl  bi  MMnf  itM  pfcWvrs* 
T)wy  M  *nm  m  i>iMf«tol|  m  pmtoli  EXCtPT  whM  H  to 
tttM  In  •  tpatMc  |WiM<ni  th«t  Itt  fIfMrt  to  n«t  *«wn  to 
•eato.  All  Hfurat  Ito  In  •  ptoiw  untoM  cthMwlM  MtoaM,  AH 


When  you  l«K«  the  SAT,  r«m«mb«r  to  um  lh«  •v«l^ 
•bit  apac*  In  Iht  ttit  booK  for  scralchworK.  You  $c 
not  Mpvcitd  to  do  •W  lh«  r««sonIng  tnd  figuring  In 
your  h««d. 

The  problems  that  follow  will  glv«  you  tn  ld««  of  th« 
typ*  of'mslhtmsllofi  thlnKlrtg  required.  First,  try  to 
answer  each  question  yourself.  Thsn  rssd  Ihs  sxplsns* 
tlon,  which  msy  givs  you  nsw  Insights  Into  solving  Ihs 
problem  snd  pertisps  point  out  techniques  thst  you  wllf 
be  able  to  »*•  *0«ln.  Note  thst  the  directions  Indlcste 
to  select  the  ^esf  of  ihe  choices  given. 

1.  If2a  4^  h  -  l.ttMn4e  >^  ak  » 

(A)4   W~  (C)10   WaO  (E)2f 
4  2 

This  Is  sn  exempts  of  •  problem  which  requires  resllz- 
Ing  that  4«  4-  2b  «  2(2e'  4-  b).  Therefore.  4a  <»-  2b  « 
42s  4-  b)  M  2(5)  m  10.  The  correct  snswer  Is  (C). 

2.  If  It*  II*  It  -  •*t.MtMllP  . 
(A)4   mt  (OH   (0)4t  (Ot4 

This  question  can  be  solved  by  several  methods.  A 
time-consuming  method  would  be  to  multiply  the  three 
l6e  and  then  divide  the  result  by  the  product  of  I  and  I. 
A  quicker  approach  would  be  to  find^het  additional 
(actora  are  rweded  in  Ihe  right  aide  of  the  equation  to 
match  those  In  the  left  side^These  sr9  two  2s  and  a  lA, 
the  product  of  which  la<M.  Yft  arK>ther  method  involves 


12 
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sowing  for  Pas  follows: 

p  s  2*2*16x64 
f*  f 

Th«  correct  answer  is 
X  Th«  tpwh  of  Maton  It  loc«t*d  on  Et^lo  Uko.  Th«  town  of 
Carfton  It  wott  of  M««on..^(fKl«lr  It  oatt  of  Canton,  but 
w«tt  of  Matofi.  D«xt«r  It  tttt  of  nichmond,  but  w«tt  ot 
Sinclair  ao^  Canton.  Attuminf  all  that*  townt  art  In  tha 
Unltad  StatM.  which  tvwn  It  farlhatt  wott? 

(A)Maa«n  (t)Oaxt«r  (C)Cant«n> 
(D)»4Klaif  (E)  Richmond 

For  this  kind  of  problem,  drawing  a  diagram  may  help 
In  Ihls  case,  a  line  can  be  •ffectlvtly  used  to  locate  the 
relative  position  oi  ©ech  town.  Start  with  the  statement 
"The  town  of  Canton  Is  west  o(  Mason"  and,  using  at)- 
br^vlatlons,  draw  the  following. 


Ptqm  the  remaining  information,  placa  the  other  towns 
In  their  correct  ordert 


-4- 


The  final  sketch  shows  that  the  town  farthest  west  Is 
Richmond  (R)  and  the  correct  answer  Is  (E). 
4.  II  tha  avMaga  9t*ffn  n't  It  7,  what  It  tha~avtfafa  of  four- 
t««n  x't?  * 


(A)  -  (i)  - 

7  2 


(Ql   (D)7  (E)14 


Don't  get  caught  up  In  the  wording  of  this,  problem 
which  might  lead  you  to  choose  (E)  1^  The  average  of 
any  number  of  equal  numbers  such  as  x  Is  always  x. 
Since  you  are  given  that  the  average  of  seven  x*s  is  7,  it 
follows  that  X  =  7  and  that  the  average  of  fourteen  x's 
Is  also  7.  The  correct  answer  Is  (0).  . 
$.  If  an  att«dtJ(  (•)  ^•tm^  tw«  axptMaloftt  Indlcal^^tfwt. 

tha  ax^tl^n  on  tha  rtfW  ax&Mdt  tha  txpfwtlwi  on  tha 

Mi  by  1,  which  •!  tho  foHowTnf  It  (af»)  tru*  f«r  •HiCWl 

numbort  x7 
|.x<x  +  2)*  (X  4^  ly 

ll.x«*  (X  ♦  ^Y 
•  Hl.x^xj__l 

i  i  *^ 

(A)N«n«  (i)lanly  (Otfonly 
(0)lllenly  (E)  I  and  III 
This  kind  of  problem  Involves  working  with  a  newly  de* 
lined  symbol.  One  approach  Is  to  check  the  statements 
one  at  a  tlmt.  Statement  I  rtducesto  x«  +  2x  •  x»  +  2x 
+  1,  so  the  expression  on  the  right  does  exceed  the  ex- 
pression on  the  left  by  1.  Therefore,  statement  I  Is  true 
Statement  II  reduces  to  x»  •  x«  +  2x  +  1  so  the  right  ex- 
pression exceeds  the  left  expression  by  2x  +  1.  which 
is  not  equal  to  1  except  when  x  =  0.  This  makes  state* 
mant  II  f»fs:  Statement  HI  is  more  difficult  to  check, 


but  you  can  verify  by  subtraction  of  by  substituting 
numbers  (for  example,  x  =  3.  y  »  5),  that  the  expres- 
sion on  the  right  does  not  exceed  the  expression  on  the 
left  by  1.  Therefore,  statement  III  Is  /a/se.  The  only  true 
statement  Is  I,  so  the  correct  answer  Is  (B). 

In  a  problem  of  this  kind,  if  you  are  able  to  decide 
about  only  one  or  two  statements,  you  can  still  elimi- 
nate some  choices  and  guess  among  those  remaining 
For  example.  If  you  can  conclude  that  I  Is  true  and  11  is 
false,  then  the  correct  answer  is  either  (8)  or  (E)  be- 
cause these  choices  contain  statement  I. 
f.  If  a  car  travelt  X  kllometart  of  a  trip  In  H  hourt,  In  how 
many  hourt  can  It  traval  tha  n»xt  Y  kilomatart  at  Ihit  rata? 


You  can  solve  this  problem  by  using  ratios  or  by  using 
the  distance  formula. 

Using  the  ratio  method,  X  kilometers  is  to  H  hours  as  Y 
kilometers  is  to  O  hours,  where  O  represents  JLhe 
amount  of  time  required  to  travel  Y  kilometers 


X 
H 

XO 

□ 


Y 

■  O 

:  HY 

HY 

■  X 


The  correct  answer  Is  (B). 

7.  If  W  ptevM  of  P  U  30  pttMnl  of  0.  than  0  It  what  parctnt 
ofP? 

(A) 3%   {9)27%   (C)30%   (0)270%  ^(E)300% 
Writing  an  algebraic  equation  for  this  percent  problem 
not  only  sImpHlles  the  work,  but  also  helps  you  to 
organize  your  thoughts  "90  percent  of  P  is  30  percent 
of  Q"  can  be  written  as  90P  =  30"  (or  ^^P  =  ^Q)  "0 

is  what  percent  of  P"  tells  you  to  lind  ^  and  express  It 

as  a  percent.  ^  =  3  and,  therefore,  0  Is  300  percent  of 

P  and  the  correct  answer  Is  (E).  (See  pages  9-10  iot  re- 
view  of  percent.) 


e.  Tha  fif  ura  above  ah^rt  •  of  ptpt  In  tha  ahapa  of  a 
paralMofram  wHh  maaauramanta  at  Indlcatad.  tf  tha 
pa^  la  lackad  at  Ht  cantor  lo  t  flat  aurfaca  and  than 
rotatad  abeut  Ma^cantor,  tha  polntt  cevarod  by  tha  p%pt 
wHI  ba  a  circular rof^  of  dlamator 
(A)Vr  (1)2  (0$  (0)        (E)  v» 
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Th«  f'ftt  st«p  (n  solving  m«  problem  it  to  r«allz«  that 
th«  c«nt«f  of  th«  p«rall«loQf*m  Is  th«  point  of  Inttf  »«C' 
tion  ot  th«  two  dl«gon«ls;  ihus,  tht  dlam«t«f  you  ar« 
looKing  for  fs  tha  tangth  of  tha  longaf  diagonal  AC  Ona 
way  to  Uni3  AC  Js  to  think  o(  tha  additional  Unas  drawn 
as  Shown  balow. 


Tha  trianglas  at  aach  and  ara  congruant  (aqual  In  siza 
and  shapa).  so  tha  langth  of  OE  and  CE  ara  l  and  y/S, 
raspactlvaly.  AEC  Is  a  right  triongla.  thaiafora.  tha 
PVthagoraan  Thacram  can  ba  usad  In  solving  tha  prob< 
iam'. 

AC*  -  CE*  +  AE* 

AC*  -         +  (6)'  ■  3  +  M  -  3« 

Tha  dlamater  AC  Is      and  tha  corract  answar  Is  (E). 

a.  An  Mcufato  cJack  altaw*  3  a'clMk  it  i  oarliln 

th*  clack  ihaw? 

(A)Sa'cl«di  <a)7a'clack  (Qio'ciack 
(0)ta'clack  (QiOa'ciMk 

Evary  \2  hours  (ha  clock  will  again  show  3  o'clock.  You 
want  to  Know  tha  ramalndir  whan  n,9W,9W,W5Js 
divldad  by  t2  to  saa  how  many  hours  to  add  to  3 
o'clock.  Bacauaa  this  division  problam  will  ba  cumbar- 
soma*  ihink  about  a  shortcut.  Twalva  divldas 
12.000.000,000  with  no  ramalndar  and  11.999.999.995  ii 
5  lass  than  12.000.000.000  Aflar  12.000,000.000.  tho 
Clock  will  Show  3  o'clock,  so  5  hours  bafora 
12.000.000,000.  tha  Clock  will  show  10  o'clock.  The  cor 
ractanswarls(E). 


10.  Inttw IrlMtflM aWv*. II At. CD. •n4 EF ara Ikia Mfmanit. 
iirttai  fa  Vtf  turn  af  ih«  maaawta  al  Hw  »b  marital  anflM? 

(AjIM*   WMO'   (OS40'  (0)730* 

(C)  h  cwv^at  ka  4alann4na4  frant  Ifw  lflla<  mat  Ian  ^hf*H. 

This  problam  raqulras  a  craatlva  problam*aolvlng  ap* 
proach.  Ona  solution  Invotvas  racogntzlng  that  tht  sum 
of  tha  thraa  unmarkad  anglas  In  tht  trl^gtas  ts  160, 
*. 

u 


This  can  ba  saan  from  tha  following  figure 


Bacausi  CO  Is  a  Una  sagmant.  tha  sum  of  anglas  x,  y. 
and  z  Is  iM*.  Also,  yaw  bacauaa  ihay  ara  vartlcal 
anglas.  Tharalora.  x  -f  w  -f  z  ■  tlO.  SInca  tha  sum  of 
tha  maasuras  of  all  anglaa  In  tha  thraa  trianglas  is  540* 
(3. 180 *»  and  tha  sum  of  tha  unmarkad  anglas' of  tha  tri- 
anglas in  tha  original  figura  aquals  iM*.  it  follows  that 
tha  sum  of  the  markad  tnglas  la  540'  *  160*  ■  360* 
Tha  corract  answar  is  (8).  With  this  type  of  problam.  if 
yoti'do  not  raach  t  solution  in  t  minuta  or  so.  go  on  to 
tha  next  problam  and  return  If  time  perTnlts.  ^ 

Quantitttlvt  Compariton  QiMatione 


Ouentltatlva  comperlson  questions  emphasize  the  con* 
cepts  ol  equalities,  inequalities,  and  estimetlon.  They 
generally  jnvolve  less  reading,  take  less  time  to  an* 
swer.  tnd  require  less  computaltOftthan  reguler  multl* 
pla-cholce  questions  , 

plry^lfot:  Each  af  ttte  tallawinf  ^uMllarta  caftilala  of  twe 
iKientniM.  MM  In  Ceiumn  A  in4  ona  In  Column  t.  You  ara  to 
comfar*  ttto  two  ^MnlHIoa  $n4  on  Iho  aniwor  ahoot  Mackon 

A  If  ttto  quantity  in  Column  A  It  froatar; 
t  if  ttw  ^ntHy  lA  CoKwnn  t  It  ro*lac 
C  if  Iho  two  ^uantHloa  are  o^uaJ: 

0  If  |ho  rolatlonaMp  cannot  bo  dolormlnod  from  Iho  Informa* 
tion  tlvon. 

Malta:  1,ln  oortaln  4«*a«iiona.  Irtfarmatloneoncomlnf  ona  or 
both  of  tfw  ^antniat  te  bo  eomaaraa  l«  eontoroa 
above  ttw  two  oolumnt. 
2.  In  •  fivon  auoailon,  a  aymbol  that  apfoara  In  both 
columnt  rofratanla  tho  lama  Ihinf  In  Column  A  ai 
^'     It  aoat  In  Columnt. 

i-  Lotlora  *och  ai  x.  n.  and  k  aland  for  real  numbora. 


EXAMPLES 
Column  A  Columnt 

Anatvora 

El.  axe     2  «■  t 

E2.  IM-x  y 

a><t>m<i> 

«.   P-  Q  n-P 

(Tf»0*9wmUA 
bocMMX  *■  y 

iMkiAf  lao  - 1 
•0Ml»oy4 


ERLC 
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QuantUatlvt  comparison  questions  may  nol  be  as 
familiar  to  you  as  other  types  of  questions.  Therefore, 
give  special  attention  to  the  directions  ahead  of  time. 
To  solve  a  quantitative  comparison  problem,  you  corrj. 
pare  the  quanliUes  in  the  two  columns  and  decide 
whether  one  quantity  iS  greater  than  the  other,  whether 
the  two  quantities  are  equal,  or  whether  the  relation 
Ship  cannot  b#  determined  from  the  information  given 
Remember  that  your  answer  should  be. 

A  it  the  quantity  In  Column  A  is  greater; 

8  If  the  quantity  in  Column  B  is  greater. 

C  if  the  two  quantities  are  equal; 

0  If  the  relationship  cannot  be  determined  from  the 
Information  given. 
Problems  are  clearly  separated  and  the  quanntfs  to  b* 
compvdaf  a/wayj  on  fhe  same  /me  aj  th»  number 
ot  the  problem  fsee  examp/e  2  belo^)  Figures  and  ad 
ditional  Information  provided  i^t  some  problems  ap- 
pear aftove  the  quantities  to  be  compared.  The  follow- 
ing are  some  practice  problems  with  explanations  to 
help  you  understand  this  typ«  of  question. 


137)  (^XW 


Cotumn  i 
(5t)(^(3r) 


Because  the  numbers  in  this  problem  are  fairly  large,  it 
may  save  time  to  study  the  multipliers  first  before  at- 
tempting the  calculations.  Note  that  (37)  and  (-) 

appear.ln  both  quantities,  thus,  the  only  numbers  left 
(or  you  to  compare  are  5fi  and  59  Since  59  >  5fi,  the 
quantity  on  the  right  Is  greater  and  the  correct  answer 
Is(B). 


p#lumnA 


Column  > 


To  solve  this  problem,  you  need  to  recall  that  when  two 
lines  intersect,  the  vertical  angles  are  equal  Therefore, 
3x  «  2y  or  X  «  -  y.  which  implies  that  y  l»  greater  than 

X.  The  correct  answer  is  (8)-  Note  that  ihe  question 
ask5  for  a  comparison  of  x  and  y,  nol  3x  and  2y 


Column  A 


Column  J_ 


SmceJkB  =  BC,  the  angles  opposite  AB  and  BC  are 
equai«d.therefore,x  s  y  Thecorrect answer is(C) 


Column  A 


Column  i 


4.  X  +  1  ,  2x  +  1 

Because  both  expressions  pontain  a  "1."  the  problem 
becomes  one  of  comparing  x  with  2x  When  you  com 
pare  algebraic  expressions,  a  useful  technique  is  to 
consi(Jer  zero  and  negative  nun^bers  for  possible 
values  of  the  uijjtnown 

2x  >  X  for  positive  numbers 

2x  s  X  for  zero  • 

2x  <  X  for  negative  numbers 

The  correct  answer  Is  (D),  as  the  relationship  cannot  be 
determined  from  the  information  given  If  you  had  been 
given  that  x  was  positive  (that  ls»  i  >  0),  the  correct 
answer  would  have  been  B  because  2x  would  be 
greaterthan  x. 


N«t«  Flfur«Unot 


to 


Because  the  sum  of  the  angles  of  a  triangle  is  180,  x 
y  +  45  e  I80or  X  +  y  =  135  Since  x  <  45.  It  follows 
that  y  >  90  The  answer  Is  (A)  In  this  problem  you 
Should  not  try  to  determine  the  answer  from  the  ap- 
pearance of  the  figure  because  the  noto  Indicates  It  is 
not  drawn  to  scale,  (—7 


gotumn  A 


Column  i 


The  condition  x  1  (read  x  is  not  e<?ual  to  1)  Is  given 
because  the  algebraic  fraction  in  column  A  Is  not  de 
fined  for  x  =  1  (the  denominator  becomes  zero)  The 
solution  of  this  problem  Involves  simplifying  the  frac- 
tion In  Column  A  as  follows; 


x»-1    (x+  1)(x  -1) 


*x-1 


X-  1 


X  +  1 


Therefore,  the  quentlty  In  column  A  Is  equal  to  x  +  1. 
Since  X  +  1 1s  always  greater  than  x,  the  answer  Is  (A). 


7. 


CoKimn  A 

Ar««  ef  •  tri«n«l« 
with  ahHude  4 


<^tumn  > 

Aret  of  a  triangle 
with  bate  5 

To  answer  this  question,  you  need  to  know  how  to  find 
the  area  of  a  triangle.  To  find  the  area  of  a  triangle,  you 

15 
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tm6  to  kno«^  th«  itngth  of  •  tMM  and  th«  titltud*  to 
that  bas«.  You  can't  find  tha  "araa  cf  a  triangia  w)th 
altltu<}a  4"  mho{i\  knowing  tha  baaa.  90  tha  araa  of 
auch  a  trla^gla  could  ba  any  numbar  dapanding  on  tha 
langth  of  tha  baaa.  LIkawlaa.  you  can't  find  tha  "araa  of , 
a  triangia  with  baaa  5"  without  knowing  tha  langth  of ' 
tha  alhiuda.  Sinca  you  can't  tall  anythlngabout  tha  two 
araas.  t  ha  corract  answar  is  (0). 


THE  TEST  OF 

STANDARD  WRITTEN  ENQLISH 


Tha  quastlona  on  tha  Taat  of  Standard  Writtan  Engllah 
avaluata  your  ability  to  racogniza  atandard  writtan  En* 
gllsh.  tha  iinguaga  of  moat  collaga  taxtbooks  and  tha 
English  you  will  probably  ba  axp«ctad  to  uaa  In  tha 
papafs  you  writa  for  rnoat  collaga  coursas.  Tha  TSWE 
taats  soma  baalc  princlplaa  of  grammar  and  usaga 
such  aa  agraamant  of  subjact  and  varb  and  of  pronoun 
ar>d  antacad^nt.  and  It  alao  daals  with  mora  complU 
catad  writing  problama  such  as  whathar  or  not  tha 
comparisons  mada  In  a  santanca  ara  logical. 

No  quastkm  aaka  you  to  datlna  grammatical  t*rma  or 
Idantify  particular  v«rb  tanaaa  or  corract  apalling  or 
capita  itza  I  Ion.  In  only  a  faw  quaatlons  ara  punctuation 
marks  iika  lha  aamlcolon  or  tha  apostropha  Importanl 
In  arriving  at  an  answar. 

Tha  bast  praparation  for  tha  TSWE  la  to  raad  widaly 
In  works  by  akillad  writars  and.  of  couraa.  to  gat  ragula; 
practica  in  both  analyzing  good  modala  of  prosa  and  In 
writing  and  rawrlting  your  Own  proaa.  HOwavar.  you 
ahouid  alao  find  It  hatpful  to  raad  tha  matarials  In  thia 
publication  and  bacoma  familiar  with  lha  diractlona 
Mf\6  tha  two  typaa  of  muttipta-choica  quaatlons  uaad  on 
tha  taat.  , 

Tha  taat  baglns  wlth<^  uiaga  quastlona.  than  has  15 
aantanca  corractlon  quastlona.  and  ands  with  10  mora 
us«ga  qvaatlona  * 


UMf*  OtMttlOOt 


Ym  wM  Hntf  MmI      #nW(  H  liMf%  It  #fv#t  to  un4irtln#4  m4 

1$ 


EXAMfLE«: 

t.  H#  a^akv  Wuntty  m>4  an^rity  la  wa  tyactatafs. 

^  — —      -~  — .  g 

i         ^  <D<t>m<t><D 

At  C 
finsnciclty  Inav^vnawit  In  hcc  vW  saa>  Nc  anvf 

0  ~ 


Usaga  quastlons  ask  you  to  racognlza  writing  that  doaa 
not  follow  tha  convantlons  of  standard  writtan  English. 
For  axampla,  thay  last  tha  usa  of  approprlata  varb 
tansas.  tha  agraamant  of  pronoun  with  antacadont.  tha 
malntananca  of  paralial  structura.  and  tha  usa  of 
Idiomatic  axprasalons.  Each  quastlon  consiata  of  a 
santanca  with  four  worda  or  phrasas  undarllnad  and 
lattarad.  You  ara  to  choosa  tha  ona  undarllnad  part  that 
must  ba  changad  to  maka  tha  santanca  accaptabia  In 
standard  writtan  English.  Ramambar  that  tha  arror 
must  ba  ona  that  you  can  corract  by  changing  tha  un* 
darllnad  part.Jf  you  thtnk  that  tha  santanca  is  ali  right 
as  it  Is.  mark  tha  fifth  cho!ca.  "No  arror."  Raad  tha  an* 
tira  aantanca  and.consldar  tach  choica  bafora  you  a** 
lact  your  anawar.  Soma  of  th  a  santancas  ara  corract  so 
don't  hasitata  to  mark  tha  "No  arror"  choIca  If  you 
can't  find  a  mistaka.  Kaep  in  mind,  howavar.  that  arrors 
of  word  choica  as  wall  as  grammar  or  usaga  can  ba  in- 
cludad. 

Balow  ara  soma  sampla  usaga  quastlona  and  axpla> 
nations  of  tha  corract  answar^. 

1.  Umt  paap<<  win  1tn4  H  —tit  la  a#itt la  ttm tmtrte  aytfii 
A 

»y>Ma<ctwn  famWi«r  wtth  it  Mar*  tht  chmmur 

■  C 
saMfrSa  H%  wrv 

0  E 

Tha  problam  In  this  santanca  is  that  of  shift  in  par* 
son.  Tha  writar  baglns  talking  about  "most  p«opla" 
and  than  changas  to  "you."  Tha  aantanca  could  ba 
corractad  by  changing  aithar  "most  paopla"  or 
"you.'*  Howavar,  "you"  la  undarllnad  and  "most 
paopla"  Is  not,  so,  accarding  to  tha  diractlona. 
"you"  la  tha  only  part  oj  tha  aantanca  whara  tha 
changa  can  ba  mada.  Tha  conatruction  In  choica  (A) 
Is  accaptabia.  tha  prapoaition  In  choica  (C)  ia  tha  ac* 
captad  Idiom,  and  tha  numbar  and  tanaa  of  tha  varb 
In  (D)  agrM.  Tha  corract  answar  is  (B).  Tha  ravlsad 
aantanca  would  raad  "Moat  paopla  will  find  It 
•aalar. . .  If  thay  bacoma. . 

A 

maw.  WtwuahaaarawM  that  »mhtCf»a»M«%ac<i>»ay 

i      '  CO 
aetata.  Maaaar 

E 


32o 


320 


Th«  tntwtr  It  (A).  In  th«  contMt  of  thit  ttnttf^*. 
tiM  "h«vlng  »W  l»  no\  tcc^ptibU.  In  tttndwd 
wrilttn  Encii«|i.  you  thouW  wrlU  "Mtny  Utv«l«f» 
cttim  to  hav«  5««n. .  "  Chofc*  (B).  "bol."  links  th« 
two  ptns  of  th«  Mnt«nc«  In  •  toQlcat  vnd  appro* 
prItU  w«y.  vnd  th«  •xprtttlon  »HC)  and  th«  »dv«rt) 
•t  (D)  tr*  «l»o  »cc«pt«bU. 


Althouoh  th«  ld««»  MprMMd  In  th«  Mnl«nc«  might 
b«  conv«y*d  with  dlff«f«nt  words  »nd  sxprssslons. 
lh«  s*nltnct  contslns  no  0'«'n'n«t'c»l.  Idlomstic, 
lofllcsl.  Of  stf  uclufsl  sfrors.  T?>«»n»wsf  Is  (E). 


Th«  •r|>f  Is  thst  of  subJ^ctYtf  b  agrMmsnt.  B*c«us« 
Ihs  sublsct  of  ths  Mntsncs,  "Hol#t,**  Is  plurst,  ths 
fttt>  must  also  t>9  plorsl:  "s«0O«»t«"  •hould  b« 
chsng^d  to  -»pfloa»t."  Always  chtck  to  s#a  that  tha 
varb  agraaa  with  tha  aobfacl.  aspaclatly  whan  tha 
vatt)  Is  saparatad  from  tha  aobjact  by  a  F^rasa  or  a 
clausa  or  whaf^tha  varb  comas  bafora  tha  tubjact. 
(B),  (O.  and  (C»>ra  stl  accaptabia  In  standard  writtan 
EngUsh.Thaa7»waffs(A>. 


Savrtanca  C 


•  HrtarsN 


OfcaaH#wai    sa^pt  al  Ifca  'aiiaww^i  ••on 

•  Mw  niMt  sMaaUM  santaifa,  ^,ttM(  is 
MM«t  Ma«w«4MM  ar  II  >li|il^.  Ml4 

 ^  ^^>m  m  ymm  MtiMT  •^M4^  hi 

^  th»  inylrinHti  al  rtan^f^  wr» 
•  al       »  aHaJaa  that 

1  atwara  IM  mmm  Iha  u«#a»*li»»<  ^art. 
k»  M      H**  *•  ari|l«al  swHtftsa  ri»a4if  r»« 


(A)  plMwInt  (■)  M«  Ha«w>«<f 
(€)  h#fa  jl#jwtarf  . 
(0)  wHhs^  ;i)  ^IMS 


Many  of  thasa  quattlons  peasant  complax  f suits  In  tha 
lofltc  Of  slruclura  of  a  santanca,  ar fors  that  raqulra  sub- 
stantial raw  riling,  Tha  diractlons  ask  you  to  salact  tha 
fit  vafslon  of  lt»a  santanca.  so  you  must  consldar 
/acf/vanass  of  axpraaslon  as  wall  as  corraclncJa.  took 
at  aach  of  tha  fiva  cholcas  carafutly  bafora  you  salact 
your  answar.  If  you  think  mora  tlian  ona  answar  It  ac* 
captabia,  rasd  aach  choica  as  part  of  tha  aniira  san« 
lanca;  aomaumas  a  cholca  makas  sansa  by  Itsalf  but 
not  as  psrt  of  tha  santanca.  Soma  of  tha  cholcas  may 
ba  grammatlQslry  corract  and  logically  and  struclurally 
conalslant  with  tha  cast  of  tha  santanca.  but  ihay  may 
•till  not  ba  tha  corract  rasponsa  bacausa  lhay  ara 
wordy  or  awkward  or  bacausa  thay  lack  forca  of  am* 
phattt. 

Each  of  tha  cholcat  la  Jlkaly  to  daa!  with  mora  than 
orta  writing  problam.  If  you  ara  r»ot  carafut,  you  may 
pick  an  answar  that  corracts  ona  problam  but  craatas  a 
naw  ona.  You^ra  mora  Jlkaly  to  pick  tha  corract  ra- 
aponsa  If  yoi^ask  yoursalf  quattlons  Ilka  thasa:  la  tivs 
santanca  grAmallcally  corract?  Is  It  a  comptata  san* 
lanca?  Ara  A  alamants  In  tha  tantanca  parallal?  Ara 
tha  partt  of  tha  tantanca  Hnkad  In  an  approprltta  mtn- 
nsr?  Ara  tha  Idaa9  axpraatad  or  comptrad  logtcttly?  Is 
ths  wording  claar  and  concita? 

B4I0W  ara  toma  aampta  tantanca  co/ractlon  quat* 
tlont  and  axplanatlona  of  tha  corract  tnswars. 
1,  Tlw»h»rtaf>ai>awMiaws»»awfaW»a^tch»loslfyau 
'   ■■    '  It— »f im»ft<maftwwf iwai. 


WMawyMimaiiintMwwniaM  ^  ^ 
(■)  i  iimM  that  is  aaty  t*  Htt  anrf  maiwuvar 
(Q  •«  •••y  fiia4»l  sa  far  as  Httint  a»i<  iMftauwlof 
(p)  ■  insiil  wl»  isn  aflHtim  •nd  alaa  m9mum 

Tha  tantanca-lattt  diractnatt  and  alfactJvanasa  o» 
axprattlon.  Cholcat  (A)  and  (E)  sra  grammstlcally 
corract.  but  ata  not  as  wall  axprassad  as  cholca  (B). 
CMca  (C)  la  awkward,  Cholca  (D)  doas  not  mslntain 
ptraltal  structura.  Only  choica  (B)  I»  conclsa. 
•nd  Idiomatic,  " 

i.mf  <M>aaw  was  Wis  flra<  HaO  Aiwartcsn  ta  »jftw«*y 
ttn»aschyi»<a«isWHaw<y<ay<'«*«*«<^ 
UU  AHhM  QikMi«  rr;     *  mi  Kack  AiMrtc«n  <•  win  ins|«r 

t«wta  dMiaplwMhl^  SfXpUy*^  bilS*  ittOa, 
m  ANhaa  QiUait.  M/n  lha  first  Waek  Ai»i«rfcw»  ta  w»n 

'inriar  twwis  chary  »lansh»s.  •»<  pttyhn  hi  ttw  itfO*. 
(Q  AHhM Olkaa«.^»yWifl«ftsi»»s.M«ilht»r»t Hack 
Aiwsrteaw  la  wim  iMt»  iarwli  sMnylawsh»s. 
,  m  ANha.  Oiasati.  «h«  Haya^  ^  «»•  IMOs.       *•  Hrt* 
itotliAiiia»teanl»w*wiii«|trNwftlsthswyln»h»». 
(f)  AHhM  OiaaM  ptayarf  »«  «»•  l****.  ahs  wt«  th.  Ilrtt 
_  ilMkAiM»*aa«v*wiaiaaMta«»toehMiflMahlf». 

Whan  a  tantanca  rpakaa  mora  than  ona  ttatamant.  It 

Is  customary  to  Indlcata  tha  ralstlonshtp  batwaan 
thasa  statamantt.  It  tha^ttatamants  ara  aqual  In  Im- 
portanca.  rank,  of  dagraa.  tha  writar  ctn  uta  a  con- 
junction Ilka  "and"'  or  •'but/'Thlt  mathod  of  Unking  Is 
catlad  coordlnstlon.  If  ona  ttatamant  Is  to  ba  ampha* 
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sU«d  mor*  th«n  th«  oth«r.  lb*  wrlttr  c»n  um  •  con> 
junetlon  Ilk*  "btc«uM"  ol  "5lnc«"  or  otr>*r  words 
tik*  "who"  or  "that."  Thit  nkthod  of  linking  It  c«ll«d 
subordi nation. Som«tIm«t.  th«  Intention  of  \h%  wriltr 
d«t«rmlri*t  whlchrm«thod  It  mott  «ppropri«t«.  in  (h« 
und«rtin«d  9«nt«i>c«  about  AltliM  Gibton,  ir>«  wrlt»r 
h«t  "•r>d"  to  join  Wto  stat«m»nti  about  th« 
•thl«t*.  Th«  Mnttnc*  (and  tr>«rtfora  cholct  A)  It  not 
•fftctfv*.  how«v«r,  b«c«u««  "«nd"  dots  not  tdt* 
qu«t«ly  conv«y  th«  rttttlonthlp  b«tWMn  tht  two 
•t«t«m*ntSr  A  n>or«  Inltrttting  Mnttnc*  wOuld  Indl* 
c*t*  which  on*  of  th«  tt«t«fn«ntt  w««  mor*  Impor* 
t«nt  10  th«  wrlt«r.  Th«  only  cholc*  thtt  do«t  to  U  (0). 
it  It  «  w«II-conttructtd  t«nl*nct,  ont  with  tppro- 
prltt*  tubordlnttiontnd  ttHphntit. 

?  ■ 


(f)  Tlw  plMlTi  «l WW  <■  iMWiiite  In     Hm*  pmimK  >y 
iiliii1li1^liittoh.9*lliMtriiii|Miri 

Th«  prlm«r^pfobl«m  with  lh«  t«nttn«»  It  that  It  cpn- 
ttlnt  t  dangling  modlflar.  A  dtngllnfj  modlflar  tt  « 
phrata.  a  clagaa.  or  an  adjactlv*  that  a««mt  to  mod* 
ify  a  word  that  h  waa  not  intandad  lo  modify.  Dan- 
gling modifl«rt  oftan  raautt  In  aantancaa  that  ara  am- 
biguout  or  Illogical.  Modlflara  thould  utuaify  l>a 
piacad  naxt  to  or  cloaa  to  tha  word  lhay  ara  .ntandad 
to  modify  to  avoW  problamt  of  ambiguity,  iacauaa  of 


tha  way  tha  original  santanca  and  cholca(A)ara  con- 
atructkl.  *ha  ph'»*a"placad  in  tha  tima  capsula" 
aaama  to  modify  "lha  tclantltts."  Howavar,  thit  ra- 
latlonthip  njakaa  no  aanaa.  Tha  writar  doatn't  maan 
that  tha  aclantlttt  wara  placad  in  tha  tima  captula 
but  that  tha  sclantltta  placad  tha  documantt  In  tha 
tima  captula.  Choica  (B)  containt  a  timllar  arror  and 
addt  to  It  by  uting  tha  pronoun  "It"  without  a  claar 
antacada'tt.  Choica  (C)  hat  a  dangling  modlf  lar  prob- 
lam  and  it  furthar  waakanad  by  tha  dittanca  ba- 
twaan  "tham"  and  tha  word  It  rafart  to.  "docu* 
manit."  Choica  (E)  doat  not  hava  a  dangling  modi- 
fiar.  but  it  uaat  tha  pattlva  voica  In  an  awkward 
mannar  and  it  unnacataarlly  wordy.  Tha  intandad 
Idaa  of  tha  original  a^ntanca  It  axprattad  claarly 
and  logically  only  in  choica  <D).  thacorract  antwar.  . 

4.  liinf— Hw— ahiMiww,  tha  tM««  wvrt  •loa^laMlly 
Mfhwtiaii  that  latin  ttracka 

(A)  MnftsKwaaafuVinaafi 
m  WNhttwMaaitathii  , 
(C)  DwatathartMnflafiiliMan 
(0)  ttaawtt  lha  maaw  wac  twi 
<Q  Tha  maan  waa  iHi 

Thit  quaation  praaantt  probiamt  In  wording  and  in 
atructura.  Choicat  (A).  (•).  and  (0)  uaa  ax^rattlona 
that  ara  not  ordinarily  uaad  In  tiandard  writtan  En* 
gllah  C'Ming  •«  it  wat."  "Wiih  tha  moon  at/;  "Dva  Ic 
thara  baing").  Choica  (E)  Joint  two  a«ntancat  with  a 
conima,  a  mathod  that  it  not  accaptabia  In  ttar.dard 
writtan  Engllah. 

What  It  naadad  It  aoma  Indication  of  tha  ralatlon^ 
ahip  batwaan  tha  firtt  part  of  tha  aantanca  and  tha 
•acond.  Choica  (0)  aolvat  tha  problam— lha  word 
"bacauaa"  clarlflaa  lha  rala'.lonthip  hy  Indicating 
that  tha  tituatlon  daacrlbad  In  tha  first  part  affactad 
lha  tituatlon  daacrlbad  in  tha  sacond.  Tha  answar  It 
choica  (0).  , 
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THE  SAMPLE  TEST 


Th«  Mmpl«  tMt  th«t  foltowa  Is  th«  •ditlon  ol  th«  SAT 
gN«n  on  April  4.  1M1  (In  N«w  York  St«t«  on  Jun«  C. 
mM  it  Incluitos  ooly  ftv*  ol  \t\%  six  ••ctiooa  in  th«  ac- 
tual taat.  Th«  axparimafltai  aaction.  Sac t Ion  4  in  this 
aditlon.  has  twan  omittad  bacauaa  It  contains  quaa- 
tions  that  may  usad  in  f utura  adltionaof  tha  SA*^  and 
doaa  not  count  toward  \ty  scorat.  Tha  sampia  taat  wiil 
ba  moat  halpful  if  you  taVa  it  ur>dar  conditions  aa  cioaa 
as  poaaibta  to  thosa  of  th«  actual  taat: 

•  Sat  asida  two-aml-ona-half  hours  whan  you  will  not 
t>a  intarruptad.  so  that  you  can  comptata  alt  of  tha 
taat  In  ona  sitting. 


•  Sit  at  a  dasK  with  no  othar  papara  or  books.  You  can't 
taka  •  calculator,  dictionary,  othar  booka.  or  nota* 
Into  tha  tast  room. 

•  Hava  a  kltchan  tlmar  or  clock  In  front  of  you  for  tim* 
Ing  yoursalf  on  tha  sactiona. 

•  Alkiw  yoursaif  only  20  mtnutaa  for  aach  saction  of 
tha  tast. 

•  Fill  in  tha'  sampia  answar  shaat  on  paga  47  Just  as 
you  ^^^Id  at  a  ragutar  tc^t. 

•  Raad  tha  Instructions  balow.  Thay  ara  raprintad  from 
tha  back  covar  of  tha  taat  book.  Whan  you  taka  tha. 
tast.  you  will  ba  askad  to  raad  tham  bafora  you  bagin 
answaring  quaations. 

•  Aftar  you  finish  the  practica  tast.  raad  "How  to  Scora 
Your  Sampia  Tast/'  on  paga  44. 


SCHOLASTIC  APTITUDE  TEST 
and  T*tt  of  Standard  Writttn  English 

Y^wiU  hava  thraa  hours  to  work  on  tha  quaations  In  this  tast  b^k,  which  Is  divldad  Into  six  30- 
mlnuta  sactiona.  Tha  auparvisof  will  tall  you  wfian  to  bagln  and  aTTd  aach  saction.  If  you  finish 
bafof  a  1 1  ma  is  caliad,  you  may  c  hack  your  work  on  that  sac  t  Ion » but  you  ara  not  to  work  on  any  othar 
saction 

Oo  not  worry  U  you  a/«  unabta  to  fintsh  a  aactton  or  if  thar o  ara  soma  quaatlona  you  cannot  answa? 
Oo  not  was*a  t  ma  pualing  ovar  d  quaatlon  tr^at  saama  tco  difficult  for  yoo.  You  should  work  as 
rapldjy  fts  yo.i  c«:n  without  sacrificing  accuracy. 

Studants  of  tan  aaK  whathar  thay  should  guasa  whan  thay  ara  uncartcin  about  tha  answar  to  a 
quastlon.  Your  tatt  scoras  will  ba  oasad  on  tha  numbar  of  quaations  you  anawar  corractiy  minus  a 
fracttonofthanumbaryou  answar  Incorractly.  Tharafora.  It  Is  Improbable  that  random  or  haphazard 
guassing  wtii  changa  your  scoras  significantly.  If  you  hava  soma  knowladga  of  a  quastion.  you  may 
ba  abia  to  ailmlnata  ona  or  mora  of  tha  answar  choicaa  as  wrong.  It  ta  ganarally  to  your  advantaga  to 
guass  which  of  tha  remaining  cholcas  is  corract.  Ramambar.-howavar,  not  to  spand  too  much  tima 
on  any  ona  quastlon. 

Hark  all  your  answaraon  tha  saparata  answar  shaat.  Mark  only  ona  answar  for  each  quastion  Since 
tha  answer  sheet  will  be  machine  acwaiJ.  be  aura  that  sach  mark  is  dark  artd  that  It  completely  fills 
the  answer  space,  fn  each  saction  of  the  answer  sheet,  thare  are  apaces  to  answer  50  questions. 
When  there  are  fewer  than  50  questions  In  a  section  of  your  test,  mark  only  the  spaces  that 
correspond  to  the  quastlon  numbers.  t>D  not  make  stray  markson  the  answer  sheet,  if  you  srasa,  do 
so comp lately, because  an  incomplete  erasure  may  ba  scored  as  an  intended  response. 
You  may  use  the  test  book  fw  scratchwork.  but  you  will  not  receive  credit  fof  Information  written 
there/ 


DO  NOT  OPEN  THIS  BOOK  UNTIL  THE  SUPERVISOR  TELLS  YOU  TO  DO  SO. 
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Sample  Teit 

SECTION  I 
Time— 30  minutes 
45  QUESTIONS 


For  e»ch  quetiioii  m  ihis  section,  choose  (he  best  answer  tnd  bUcken  the  corresponding  sptce  on  the  answer  sheei. 

Etch  question  below  connsts  of  a  word  in  capital  letten. 
followed  by  five  lettered  words  or  phrtses  Qioose  the 
word  or  phrase  that  is  moct*nearly  opponte  in  meamni 
to  the  word  in  capital  ktten.  Since  some  of  the  quet- 
tioni  require  you  to  distmtulih  fine  shades  of  meanin|. 
consider  all  the  choices  before  dedduig  which  is  best. 
Example;-  * 


Each  sentence  below  has  one  or  two  blanks,  each  blank 
indlcatmi  that  sotnethlng  has  b«en  omitted.  Beneath 
the  sentence  are  fite  lettered  words  or  Kts  of  words. 
Choo«;(,  the  word  or  set  of  words  that  best  fits  the 
meanini  of  the  sentence  w  *  whok. 
Example; 


COODr  (A)  sour  (•)  bad  (C)  red 
(D)  hot    (E)  ugly  _  ^  , 


I.    BAN:  (A)  bonow    (B)  regret 

(C)  peimit    (D)  conquer    (E)  exaggeraCe 


Although  its  publicity  has  been  — .  the^  fUm  it»lf 
is  InteQigent,  well-Kted,  handsomely  produced, 
and  altogether  ^ 

(A)  tasteless,  .respectable    (B)  extensive,  jnoderate 
(C)  sophtstkatcd.'^atcur    (D)  nsqu<..ciMde 
(E)  perfect,  jpectacular  .  ^  « 


2. 

4, 

5. 
6. 
7. 
t. 
9. 
10. 

12. 
13. 
14. 

15. 


COMPRESSION:  (A)  equality  (B)  expansion 
(C)  cxpo«ife    (D)  endurance    (fe)  excitement 

FRAUDULENT:  (A)  dynamic    (B)  masterly 
(C)  possible    (D)  lenulnc    (E)  abundant 

PARASITE   (A)  expert    (B)  impoeter 
(C)  inatigatof    (D)  self 'assured  snob 
(E)  self-sufTKient  individual 

SPARSE:  (A)  thick    <B)  Udy 

(C)  wealthy    (D)  round    (E)  sticky 

DENOUNCE^  (A)  overstate    (B)  acclaim 

(C)  destroy    (D)  refuse    (E)  hasten 

FLY.BY.NlCH?r  (A)  unbalanced  (B)  moderate 
(Q  permanent    (D)  incredible    (E)  modem 

STERILE;'  (A)  venal    (B)  productive 

(G)  generous    (D)  variegated    (E)  unalloyed 

REJOICE,  (A)  defend  against  (B)  shnjgoff 
(C)  criticize    (D)  bemoan    (E)  diKrimlnatc 

FANATICISM:  (A)  optimism    (B)  hedonivn 

(C)  penitence    (D)  didacticism    (E)  apathy 

^^i^|CIAL.  (A)  fuUy  developed 
(B)  publicly  announced    (C)  offensive 

(D)  prorvincial    (E)  mi/aculous 

DIVERT:  (A)  bore    (B)  rescue    (C)  espouse 

(D)  judge  faidy    (E)  question  relenilesaly 


HACKNEYED*  (A)  integrated 
(C)  inventive    (D)  acceptable 


(B)  appealing 
(E)  improper 


ALACRITY;  (A)  Indolence    (B)  bravery 
(C)  wisdom    (D)  pungency   (E)  retenUon 

BURGEON i  (A)  fail  to  prove 
(B)  shrivel  and  die    (C)  pursue  «i>d  capture 
(D)  disobey  regulations    (E)  apeak  incoherently 


16.  Rather  thin  —  wagon  trains  and  —  the  poneer's 
movement  westward,  many  American  Indians  acted 
as  guides  and  companions. 

(A\  <  ncounterlng.  Jielptng 

(B)  seeking^  .encoura^ 

(C)  attacking..hindering  ^ 

(D)  welcoming,  allowing 

(E)  repuUlng..fonowing 

1 7.  Althoui^  Rjcardo  looked  tired,  he  was  enormously 
—  by  Maria's  election,  a  victory  they  had  botK 
labored  so  hard  for. 

(A)  eUted    (B)  baffled    (C)  faUgued 
(D)  surprised    (E)  exuperated 

IS.  The  earth's  atmosphere  —  surface  temperatures  by 
distnbuiing  heat  absorbed  on  the  sunlit  side  to  the 
side  in  shadow. 

(A)  wsmu    (B)  resisU    (C)  ten«rs(es 
(D)  moderates    (E)  amasses 

19.  Professor  Greene's  — ,  detailed,  and  lucid  lectures 
match  the  gravity  of  her  subject 

(A)  blithe    (B)  studious    (C)  jaundiced 
(D)  obscure    (E)  uproarious 

20.  It  would  seem  that  the  —  of  science,  the  building 
and  nuking  of  ihlngs,  have  stirred  the  American 
In*.a|instIon.  but  thtt  the  —  roots  of  such  activi* 
ties  have  not. 

(A)  applications. .theoretical 

(B)  hypotheses,  .practical 

(C)  formulas^Jtctual 

(D)  offshoots. extrinsic 

(E)  products,  iuture 
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EKh  pisute  below  is  foUovctl  by  quertioni  based  oh  its  conter.l.  Answer  itl  questions  foUowing  a  pw«|e  on  Ihe  b««s 
of  what  U  suted  or  implied  in  that.  pasu|e.  ^ 


1 


(This  p«m|ewu  written  in  1961  ) 

The  claMKs  are  the  t^eat  works  of  human  mteilifence 
that. whether  produced  In  Iwael, Greece.  Rome, or 
England. have  demonstrated  the  capKliy  forbein|Ufykr. 
stood  over  a  lon|  period  of  lime  and  in  a  variety  of  places 
They  introduce  \i.t  student  to  the  significant  ideas 
common  to  Western  cmliution.  But  moat  students  are 
so  buty  leamini  the  lan(ua|e  of  the  classics  that  they 
never  become  acquainted  with  the  idea*  in  them, 

I  know  not  how  many  Gauls  Caesar  slaufhtered.  But 
I  know  that  leaming  Utip  from  the  OtUlc  Wtn  has  killed  ' 
the  interest  of  leneratiom  of  Americans  in  the  classics. 
More  than  sixty  years  a|0.  a  committee  of  educational 
consullar.U  affiirned  that  the  G«llic  Win  did  ftot  belong 
in  the  classroom.  According  to  the  committee,  *TTie  book 
is  altogether  too  difficult  for  bcfinners.lt  is  too  military 
in  content  to  be  generally  Interesting.  Its  vocabulary  is  too 
restricted  to  marches.  i»e|e*.  and  battles  to  afford  the  best 
introductton  to  subsequent  reading."  Yet,  of  the  glory  that 
was  Greece  and  Rome,  this  is  what  high  school  sludenu 
first  encounter.  And  since  they  are  forced  to  further  waste 
time  by  teadmg  it  in  the  original, ^his  is  often  their  only 
encounter. 

The  stubborn  attKhment  to  Caesar  Jpnngs  from  an 
underlying  insistence  that  the  ultimate  purpose  of  teaching 
the  clasucs  is  to  teach  Utln  and  that  therefore  the  simple 
style  of  Caewr  isappropriatec  For  the  same  reason, 
Bfowulfhtt  been  jet  as  an  impenetrable  barrier  to  a  Iwe 
of  English  literature  by  those  who  believe  that  the  study  of 
En^ish  literature  must  begin  with  the  knowledge  of  the 
Anglo-Saxon  language.  « 

However,  if  we  uae  the  classics  to  offer  a  glimpae  of  the 
seminal  ideas  of  Western  culture.quite  different  texts  can 
be  held  forth.  AD  studaoU  can  re*d  aoine  AiWophines  or 
Thucydides  or  Oiaucer  with  interest.  Inclusive  lists  are  of 
no  importance,  for  these  texta  should  be  the  beginning, 
rather  than  the  sum,  of  their  reading.  And  they  should 
begin  by  reading  the  good  English  translations  that  are 
avaJable.  No  translation  is.  of  jcourw,  the  equivalent  of 
the  original,  iut  the  question  is  not  whether  The  Chudt 
should  be  read  in  Greek  or  In  English:  the  question  U 
whether  It  should  be  read  in  English  of  not  read  at  all.  It 

•  is  more  Ukely  that  a  few  students  wili  be  drawn  to  study 
the  languafe  through  knowledge  of  Its  literature  than  that 
any  wiU  be  drawn  to  the  literature  through  drill  in  the 
language. 

*  2I«   Which  of  the  following  best  expresses  the  malnjdea 

of  the  passage? 

(A)  The  C*Uic  Wm  U  more  appropriate  today  than 

it  was  many  yatn  ago.  , 

(B)  Molt  students  are  more  Interested  in  learning 

languages  than  in  leamlng  history. 
(O  The  place  of  the  classics  in  high  school  has  been 
greatly  overrated. 

(D)  Good  English  translations  of  the  clautcs  are 

usually  stylistically  superior  to  the  originals. 

(E)  The  elastics  should  be  used  in  the  high  school 

to  present  meaningful  ideal. 


22  It  can  be  inferred  that  the  committee  of  educational 
consultants  mentidhed  in  the  passage  recommended 
that 

(A)  Latin  be  studied  in  the  high  ichools,  ^ut  from  a^ 

text  other  than  Caesar's  Ctllic  Wan 

(B)  Caere's  Cilbc  Wars  continue  to  be  studied  in 

Amencan  schools,  but  from  a  good  English 
translation  ' 

(C)  the  study  ofthe*cl*ss!cs  be  dropped  from 

American  school  Curricula 

(D)  Latin  be  studied  from  Caesar's  Gallic  Wm 

because  the  style,  if  riot  the  content ,  is 
appropriate  for  beginners 

(E)  an  abridged  version  of  the  GtUic  Wan,  omitting 

much  of  Ihe  military  content,  be  published 

23.  Which  of  the  following  would  the  author  probably 
recommend  as  the  best  approach  to  the  study  of 
daaaics  in  American  hi^  Khools? 

(A)  The  classics  should  not  be  studied  in  any  form 

(B)  The  classics  should  be  studied  irf  the  original 

language,  but  a  restricted  vocabulary  shoyld  be 
used. 

(C)  An  apprecution  of  the  classics  shodd  grow  out 

of  a  thorou^  knowledge  Qf  them  in  their 
original  languages. 

(D)  The  classics  should  be  read  in  English  transla- 

tions, 

(E)  The  classics  should  be  studied  in  relation  to  the 

hterary  theories  of  the  time  In  which  each 
work  was  ^*Tltten, 

24.  The  author  refers  to  Aristophanes  and  Thucydldes  as 
examples  of  classical  authors  who  are 

(A)  included  in  most  high  «hool  courses 

(B)  ofintrlnalc  interest  to  young  people 
(Q  destroyed  by  awkward  translations 

(D)  of  no  Interest  because  of  their  difficulty 

(E)  difficult  to  relate  to  the  rest  of  the  literature 

curriculum 

25.  According  to  the  author,  the  uit  of  the  claaiia 
in  hS^  schools  was  primarily  baaed  on  the 
instructor's  desire  to 

(A)  stimulate  students'  interest  in  languages 

(B)  teach  stude»»ts  self-diKipline  and  promote 

a  methodical  approach  to  learning 
(O  develop  In  students  a  famlHarity  with  a 
paiticular  language 

(D)  give  young  people  an  appreciation  of  contem- 

porary achievements 

(E)  familiarize  students  with  the  important  names 

in  Westem  literature 
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Th«  renewed  interest  m  rifiinie  it  one  of  the 
rnott  Ciinouc  cam  of  ehanpni  mustcal  taste  tfl 
recent  years.  The  rewrgence  bejaa  in  1970  when 
a  recording  of  eifht  rap  by  the  inimitable  Scott 
/i;  /oplin  appeared, 

Thts  recording  was  not  a  rediKovery  oft 
forgotten  material,  for  ragtime  had  remained 
popular  With  jau  and  Dixieland  audiences,  }iu 
J        musicuns  had  altered  the  steady  beat  of  the 
nO}  mu$)C.  adding  syncopations  and.  tn  the  procesi. 
eluraiutmg  the  contrasts  that  highlighted  the 
melodies:  D»>elar>d  musiaans  had  done  the 
pieces  very  fau.  damaging  ihe  lyrical  qualities. 
But  in  the  1970  recording,  the  muncwas  played 
m)  exactly  as  Joplin  had  wntten  it.  What  emetged 
was  a  debcate  music,  with  graceful  melodies  and 
compelttng  rhythms,  that  captivated  a  la/ge.new 
audience.  Since  then,  modified  ragtime  recordings 
have  inundated  the  market. 
(if)}        Ragtime  was  created  during  the  last  yean  of 
the  nineteenth  century  by  ittnetant  black  mulictans 
of  the  Midwest  out  of  previoutly  disparate  ele< 
ments,  Prom  the  minstrel  song  they  took  the 
melodic  style  characrenstic  of  banjo  aceompani* 
ment,  from  the  march  (hey  took  the  bass  figures 
and  rhythms;  from  the  cakewalk  ihey^ook  a 
mock-ierious  combination  of  stalely  procession  and 
energetfc  tmpro>iutk)n. 

Present-day  ragtime  enthususts  seem  to  delight 
i)J>l  in  emphasizing  the  difftculttes  that  faced  ragtime 
composers.  However,  to  cast  a  mail  such  as 
Jopdn  as  an  "all  but 'forgotten  black  American 
genius"  not  only  ignores  important  elements  of 
Joplin's  life,  but  also  misrepresents  the  develop- 
Hit  ment  of  popular  music  in  the  twentieth  century 
Within  months  of  the  publication  of  "Maple  fiaf 
Rag,"  /opin  became  a  nch  and  famous  man  and 
remajijed  so  until  his  death.  Also,  the  relative 
decline  of  ragtime  cannot  be  blamed  on  hostibty 
t*0}  to  black  culture,  since  another  form  of  black 
music,  p//,  became  the  new  rage  when  the 
ortgmal  ragtime  boom  receded^ 

 JlicalltiDpuojsslmilaleLjagtim^LjntQJhc  

romantic  myth  of  the  artist  neglected  by  society 
can  be  seen  as  part  of  an  effort  to  recast  ragtime 
as  "senous"  or  "ciassicar  music.  Admittedly,  of 
all  the  forms  of  popular  music,  ragtime  it  the 
most  amenable  to  "classical"  treatment  Unhke 
jazz  and  folk  music,  ragtime  is  not  improv&atory. 
tiO)  It  IS  fully  written  out,  with  no  reliance  on  aural 
jradition.  And  unlike  the  work  of  the  popular 
songwriters,  ragtime  is  written  for  the  solo  piano - 
Ihe  preeminent  clasiical  instruments  Nevertheless, 
it  IS  also  true  that  the  rag  is  a  modest  form,  with 
tM)  an  elementary  structure  and  technique.  Burdening 
ragtime  with  an  unnecessary  load  of  musicaj  pre* 
tension  and  political  meaning  may  sink  this  music 
into  a  deeper  oblivion  than  the  relative  neflect 
from  which  it  has  bwn  reKued. 


26  According  to  the  passage,  Dixieland  musiciaru 
altered  the  ongjnal  style  of  ragtime  music  b> 

(A)  highlighting  the  melodies 

(B)  adding  syrKopations 

(C)  {laying  the  music  veiy  fast 

(D)  giving  the  music  a  steady  beat 

(E)  omittinf  the  lyrtcs  of  the  music 

27  By  the  statement  "prevwutly  disparate  elements" 
(lines  22-23).  the  author  is  refernng  to  the 

fact  that 

(A)  blacks  had  never  before  organized  to  develop 

an  authentic  s^yle  of  music 

(B)  the  source  of  a  particular  style  of  music  had 

never  before  been  attributed  to  a  particular 
repon  of  the  country 

(C)  ragtime  was  the  first  black  music  to  attract 

a  large  and  varied  audience 

(D)  ragtime  was  the  Hrst  black  music  in  which 

the  puno  rather  than  the  ban;o  was  the 
dominant  instrument 

(E)  ragtime  was  created  by  mixing  various 

aspects  of  other  types  of  music 

23.    It  can  be  mferred  from  the  passage  that,  when  it 
was  written.  Scott  Joplm's  music  was 

(A)  overrated  by  cntia 

(B)  dismissed  as  unprofitable  * 

(C)  ignored  by  audiences 

(D)  acknowledged  as  unique  and  praiseworthy 

(E)  considered  classical  nther  than  popular 

29    With  which  of  the  foUowuig  statements  regarding 
ragtime  would  the  author  probably  agree? 

I.  What  is  best  in  ragtime  may  be  lost  in  the 

effort  to  make  it  something  it  Is  not. 
K  Joplin's  ragtime  did  more  than  a.ny  other 
style  of  muue  to  revolutionize  Amencan 
music, 

III   Ragtime  differs  in  some  important  ways  from 
most  other  popular  music. 

(A) "I  on]y^.^(B)^I  and-ll  only^  (Q.Iand  III  only. 
(D)  II  and  III  only    (E)  1. 11.  and  III 

30.   In  developing  the  passage,  the  author  does  all  of  the 
foUowing  EXCEPT 

(A)  present  evidence  from  other  people  to  support 

the  views  expressed 

(B)  give  historical  information  regarding  the  ongms 

of  ragtime  music 

(C)  attempt  io  convey  a  feeluig  of  the  nature  of 

ragtime  music 

(D)  offer  statements  to  tefute  certuji  aspects  of  the 

opposing  point  of  view 

(E)  descnbe  a  potential  consequence  of  the  opposing 
'         point  of  view 
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S<^teci  Ihc  word  ot  se(  of  wordi  lhaz  belt  ^.omplctes  each 
of  the  foUowinf  Kniences^ 

3h   Miny  of  ihc  officcri  were  umympathciK.,  even  — , 
(o  theu  new  and  inexperienced  comminder 
(A)  lukewinn    (B)  induftent 

(C)  >emle    (D)  ho«iJe    (E)  unpirlul 

32.  The  niial  Republican  and  the  ufban  Democrat  were 
immensely  different,  and  the  —  that  Kparated  them 
was  not  —  ^iccessfulJyxlunnt  the  postwar  era 

(A)  buIwajMniilt 

(B)  ^j«>rfr:achi<ve<l 
^^..'•''iS^ft^U  .brid{e4 

^  (D)  economy., widened 
(E)  electorate.. enfranchises! 

33.  Whereas  his  predecessors  were  careful  to  >t>y 
wiihin  the  boundaries  of  fsctuil  evidence. 
Df.  Artman  debvered  an  address  that  was 

by  pretentious  and  —  theorizinf. 

(A)  marred,  .irresponsible 

(B)  undermmetJ  unaisumini 

(C)  supported.  .11  a wJcss 

(D)  refuted.  unvenHable 

(E)  represented,  ^unquestionable 

34.  Beciuse  of  their  extremely  simple  structures, 
viruses  have  proved  invaluable  to  those 
scientists  vvho  are  interested  in  constructinf 
—  for  the  larger,  more  complex  molecules, 
(A)  a  cur'e    (B)  a  response    (C)  an  ediUcC 

(D)  a  uni^-erse    (E)  a  paxadifm 

35.  Many  early  Americans,  for  all  iheir  dishke  of 
monarchy,  firmly  believed  in  —  society. 
(A)  a  democratic    (B)  an  idealutic 

(C)  a  stratified    (D)  a  historic    (E)  a  flexible 


Each  question  below  t^onststs  of  a  related  pair  of  words 
or  phrases,  foUowtd  by  fi%e  lettered  pain  of  words  or 
phrases.  Select  the  lettered  P«ir  that  best  expresses  a 
relationship  similar  to  that  expressed  in  the  onpnal  pair 
Example.  

YAWNrBOREDOM  •  (A)  drcam:ileep 
(B)  an(er, madness    (C)  smile: amusement 
(D)  face. expression    (E)  impatience  rebellion 
CD  CD  •  CT  CD 


36.  FOOD;STARVATION:;  (A)  liquor, inebriation 
(B)  water:s«turation    (C)  heat.'inflanunatlon 

(D)  privacyniolation    (E)  air.'suffocation 

37.  TAPE  RECORDER: EAR  ,  (A)  radio.antenna 
(B)  camera  :eye    (Q  phono|raph:v^ume 

(D)  Journa]:hand    (E)  telephone  .speech 

38.  SUMMONS:ATTENDANCE 

(A)  allowance: money    (B)  bill: payment 

(C)  purchase :article  (D)  question: examination 
(E)  continuation:action 

39.  HOPEiDESPAlRINC.   (A)  confidence: friendly 

(B)  respect  :tovemIn|  (C)  wit t mess: humorous 

(D)  Jollity  .'gloomy    (E)  unconcern: poised 

40.  ACT:TRACEDY";  (A)  slanziipoeni 
(B)  palette: artist    (C)  inventor. machine 

(D)  gate: fence    (E)  cover: book 

4 1 .  ENIGMA :  MYSTERIOUS 

(A)  beginning: vague 

(B)  deciiion:cautious' 

(C)  memory j  forgotten 

(D)  meeting  place:random  ^ 

(E)  tumL'tf  point: significant 

42.  WHEtP:DOG::  (A)  mule:ho(se 

(B)  kitlen:pet    (Q  child; human  being 
(D)  criminalrcommunity    (E)  school:fbh 

43.  ANNOYt ABUSE::  (A)  alter :change 
(B)  encourage ipfod    (C)  clamor: silence 

™.^(D)nfioIatc;xttdt ,  {E)-CoruiikxidiKftYet   . 

44.  1>ART1CLE:AGCREGATE  :  (A)  athlete: rivalry 
(B)  moIecule:iurface    (C)  asteroid; planet 

(D)  animil:herd    (E)  motoripower 

45.  UNWrrriNC:  INTENTION:: 

(A)  {rKon^kuous:strate(y 

(B)  alone:assiitance 

(C)  lavish: expense 

(D)  impnctkaliexptanition 

(E)  fulOe:diuppointment 


STOP 

IF  YOU  FINISH  BEFORE  TIME  IS  CALLED.  YOU  MAY  CHECK  YOUR  WORK  ON  THIS  SECTION  ONLY 
DO  NOT  WORX  ON  AW  OTHER  SECTION  IN  THE  TEST. 
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SECTION  II 
/  '  Time— aOmlnuifes 

25  QUESTIONS 

b)  Ih^  section  wlvc  eadt  probkm,  using  any  available  space  on  the  page  for  scratchwork.  Then  deade  which  a  the  best 
of  the  choices  pven  and  blacken  the  coaesponding  space  on  the  answer  sheet 
Hie  f<^owing  Information  ta  for  your  reference  in  solving  jome  of  the  pioblenis. 


Circle  of  radiui  r:  Area  CucumfereiKe  =  2i(r 

The  number  of  degrees  of  arc  in  a  circle  U  360. 
The  measure  in  d«gn«rof  a  strai^t  angle  U  !$0. 
Oeflniiions  of  symbols; 

»   it  equal  lo  ^    ia  less  tfian  or  equal  to 

^    u  unequal  to  ^    is  greater  than  or  equal  to 

<   ts  ksi  than  H    ts  parallel  lo 

>   IS  grater  than         i    is  perpendicular  to 


TnangJe.  The  sum  of  the  measures  in 
degrees  of  the  angles  of  a 
triangle  is  ISO. 

If  LCDA  is  a  right  angle,  then 


(1)  area  of  C^ASC  = 
(2;  AC^  ^AD^  4- DC^ 


A8  X  CD 


Note   Figures  whxrh  Kcompany  problems  ^  this  test  are  intended  to  provide  mformation  useful  in  solving  the  problems, 
iney  are  dravtrn  as  accurately  as  possible  EXCEPT  when  a  is  staled  in  a  specific  problem  that  its  figure  is  not  drawn  to 
scale.  All  figures  lie  in  a  plane  unless  otherwise  indicated.  All  numbers  usei  art  real  numbers 


I.    If  jc'  -  I  «  y  and  ;c    3.  then  =» 
(A)  81    (B)  64    (C)  9    (D)  8    (E)  4 


Itcd 


ret  low 


Xed«llu« '  fntfU 
Red  ♦Yrllowi  Orange 
llu<  ♦Yellow '  Green 

2.  The  figure  above  showifl(tp«  of  colored  glaaa  that 
overlap  to  form  other  colori^M  shown  by  the  cc4or 
chart.  Which  two  labeled  ihainguUr  regidm  would 
be  green? 

(A)  I  and  III 
(1)  I  and  IV 

(C)  II  and  V 

(D)  III  and  VI 

(E)  iVandVI 


In  the  figure  above*  if  fi,  I  fi,,  £3  IS,,  and 
fi|  1  S4.  which  of  the  fc^owingslatemcnumust 
be  true? 

I.  I  S, 

II.  Cji£, 
III.    fi,  1  (4 

(A)  None    (B)  I  only    (C)  I  and  H  only 
(D)  II  and  III  only    (E)  1, 11.  and  III 


^4.^  lf^I0O^'*^"400^an<r*^sVmultipte  of  5;6;7r 
and  10.  then 

(A)  105 

(B)  ISO 

(C)  210  I 

(D)  300 

(E)  350 
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$.  In  a  restaufini  whcic  the  jaJe»  tax  on  a  $4X» 
hinch  it  S0.24.  what  >iU  be  (he  uJci  tax  du« 
on  a  $15.00  dinner? 

/  (A)  $0.60 

(B)  $0.75 

(C)  $0.90 

(D)  $1.20 

(E)  $L74 


U(  Row 
2nd  Row 
^rd  Row 
4th  Row 
5th  Row 
6th  Row- 


0  1  0 
0  110 
0  12  10 
0  13  3  10 
0  1  4  6  4  1  0 


6.  the  noftzero  numben  above  forni  a  trianplar  array, 
fcf  nninf  with  the  second  row,  each  nonzero  nunv 
ber  in  a  row  U  the  sum  of  the  two  number?  nearest 
to  it  in  the  row  immediately  above.  If  a  sixth  row 
u  added  in  iMs  faihioft,  what  will  be  the  sum  of  all 
the  numben  in  the  sixth  row? 

(A)  S    (B)  10    (O  16    (D)  32    (E)  64 


7,   If  X  is  a  po«tlvt  intctcr  and  =*  n,  which 

of  th«  foUowini  couJd  be  iht  value  of  n  ? 


(A)  14 

(i)  »5 

(C)  It 

(8)30 


9.  If  111,111  +  A'a  181,111, then  JVa 

(A)  7X10* 

(B)  7  X  10* 
.    (C)  7  X  10» 

(D)  8  X  10* 

(E)  9  X  10* 

10.  In  the  United  States  in  a  certain  year,  food  produc 
tion  per  person  was  15  per  cent  jrcatcr  than  food 
consumption  per  person.  If  the  average  daily  con. 
sumptiqn  per  person  in  the  United  States  in  that 
year  was  3.000  calories,  wfut  was  the  avera|c  daily 
production  (in  calories)  per  person  in  that  year? 

(A)  -3,200    (B)  3,450    (C)  3.600 
(D)  3^50    (E)  4^00 

11.  0,06  is  the  ratio  of  6  to 

(A)  1^    (B)  100    (C)  10 
(D)^  (E)^ 


U 


TJ 


8.   If  one  more  of  the  lit  signals  on  the  rear  of  the  ar 
abovt  were  cut,  what  per  cent  of  all  the  rear  signals 
would  then  be  Ut? 

In 


(A)  25%  (B)  3)^*  (C)  50% 
(D)  66|%    (E)  75% 


In  the  figure  above,  ABCD  «  a  square. 
If  B£^2£C,iUtn  x  = 

(A)  100    (B)  110    (C)  120 
(D)  150  (E)  160 


I  MOM  TO  THE  HEX! 
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In  the  fifure  ibovt,  a  rcclan|u]ar  piece  of  paper 
ABCD  a  folded  alooj  doited  line  kZ  lo  that  A 
IS  ofl  top  of  and  Z7  is  on  top  of  Y  and  then 
folded  aloni  AT  to  that  0  b  on  top  of  K'  and 
C  U  on  top  of  i?.  A  small  acmkircle  S  with 
diameter  on  iKT  is  cut  out  of  the  folded  paper. 
If  the  paper  is  un  folded » which  of  ilie  foQdwinf 
could  be  the  rtwit? 


15.  Amy  is  twice  as  old  as  Bill.  Fiva  years  a|o  she  was 

3  times  as  old  as  ZUl  wu  (hen.  llow  old  is  Bill  now? 

(A)  20 

(B)  15 

(C)  10 

(D)  5 

(E)  It  cannol  be  determined  from  the  information 

pnn. 

16.  (3x'-4x+7)-(2x  +  l)(x-5)  = 

(A)  x'+5x  +  12 

(B)  x'  -  5x  +  12 

(C)  x'  -  5x  +2 

(D)  5x'-l3x+2 

(E)  5x'  +I3X  +  I2 

17-  In  t^ABC,  the  ratio  of  the  lenfih  of  side  AB  to 
the  penmeter  is  I  to  3.  Wliat  is  the  raiio  of  (he 
lentth  of  side  BC  to  the  penmeter? 

(A)  7 


(C)^ 


(E)  It  cannot  be  detemiined  from  the  information 
|)ven. 


^3;(Ar-2X^-4XArj>6XAr-f)-l  ^^^^^^^ 
if  N  U  equal  to 

(A)  I  only 
.(B)  2  only 

(C)  9  only 

(D)  anyoddlntefer 
(£)  any  even  Integer 


H.   If  Sr  -     =  8  and  X  =       then  y  ' 
(A)  I 


(C)  2 
(E)  4 
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19.   Thttc  equal  scnrUdrcIcs  ate  drawn  on  a  dJameter  of 
the  circle  with  center  0  at  shown  above.  If  the 
area  of  drcle  0  is  9ir,  then  the  area  of  the  shaded 
'  re^on  is 


(A)^  i%)4t 


(C) 


9ir 


(D)  5jr 


23.  How  many  minutes  will  it  take  a  rocket  to  travel 
4^  rmles  iflu  averafe  rate  U  100  miles  every 
t  wconds? 

(D)  40r 


20.   If  each  an|^  of  quadrilateral rneaiures  leu 
than  ISO*  and  if  3  of  its  anises  each  measure  x*, 
which  of  the  foUuwing  must  be  true? 

(A)  X  >  60  , 

(B)  X  =  60 
(O  X  <60 

(D)  A8CD  is  s  parallelotram  but  not  a  square. 

(E)  ^00)  is  a  square. 

21  •  Hie  set    consists  of  all  numbers  which  are  the, 
sum  of  3  consecutive  prime  numbers.  For 
example,  the  number  109  is  in  P,  since 
31  +  37  +  41  «  109.  The  least  prime  number 
in  ^  it 

(A)  13 
"    (B)  17 

(C)  19 

(D)  23 

(E)  31 


22 


0(6,2} 


(E)  2,400r 

24.    Iftheaverafeof  X, /,  and80is6more  than  th« 
avera|e  of     r,  and  80,  what  is  the  value  of 
x-i? 

(A)  2 

(B)  3 

(C)  6 

(D)  18 

(E)  It  cannot  be  determined  from  the  information 

ipven. 


^(2.-2) 

the  coordinates  of  pdnu  ^,  Q,  and  R  are  shown 
In  the  figure  above.  U  PQ RS  »nd  PQ  1 RS, 
what  are  the  coordinaus  of  5 


(A)  (2.6) 
(D)  (2,9) 


(B)  (2,7) 
(E)  (7,2) 


(C)  (2.8) 


•  1 

4cin| 

6an 

the  figure  above  shows  how  a  rtctaniuUx  piece  of 
paper  is  roiled  to  form  a  cylindrical  tube.  If  it  is 
^med  that  the  4<entimet«r  sidM  of  the  rectangle 
mee t  with  nc  overlap,  what  is  the  area,  in  square 
cendmeterst  of  the  circular  baae  region  enclosed? 

(A)  I6w 


(B) 
(C) 
(D) 
(E) 


STOP 


IF  YOU  FINISH  BEFORE  TIME  IS  CALLED,  YOU  MAY  CHECK  YOUR  WORK  ON  THIS  SECTION  ONLY. 
DO  NOTpWORK  on  ANY  OTHER  SECTION  IN  THE  TEST. 
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SECTION  III 
Time— 30  minutes 
40  QUESTIONS 

For  CKh  qu««lion  m  ihi$  KCtiOft,  chooie  the  be«t  answtr  and  blwken  Ihe  cofretpondint  sp.ce  on  the  inr*cr  »h«t 


EAch  qu«ttlon  b«Iow  confisO  of  a  word  In  capital  lellen, 
foUowtd  by  Tive  iellered  wordi  orphraies.  Chooie  the 
word  or  phraie  that  U  moti  (waily  oppoiitein  meaninf 
to  the  word  in  captal  ktter*.  Since  wme  of  the  que** 
tioAs  require  you  to'6stinfui>h  flne  shades  of  meaninf. 
consider  aU  the  choices  before  decidins  which  if  best 
Example'  * 


GOOD.'  (A)  iou(    (B)  bad    (C)  red 

(D)  hot    (E)  u|ly  (2>  •  OOXP 


U   ORDINARY:  (A)  numeiiod    (B)  rational 
(C)  Impolite    (D)  sUbiKh    (E)  abnomul 

2    ATHEIST,  (A)  Deiiever    (B)  Kholar 
(C)  reclu»e    (D)  expatrUte    (E)  pauper 

3.  FUCJCER:  (A)  riacilowiy    (B)  bum  steadily 
(C)  waimcompUtely    (D)  fume    (E)  coUide 

4.  SERRATED  (A)  undervalued  (B)'att:euive 
(C)  smooth  afld  tvtn    (D)  {oom  and  flexible 

(E)  supremely  cor  fident 

5    COSMOfOUTAN-  (A)  indecislyc    (B)  Ineffectual 
(Q  antafoniitic    (D)  parochial    (E)  deferential 

6.  HYfOCRITICAL  (A)  fuJeless    (B)  eccentric 
(C)  perspicacious    (D)  untnistwbrthy 

(E)  salacious 

7.  ACCOLADE-  (A)  appetii^r    (B)  censure 
(C)  recoil    (D)  seizure    (E)  referendum 

a;  pROfouND; 

(A)  remove  from  consideration 

(B)  defend  without  evidence 

(C)  avoid  without  reaaon 

(D)  view  with  humility 

(E)  rescue  from  imprisonment 

9.  EBULUENT.  (A)  staid    (B)  anxious 

(C)  feminine    (D)  unique    (E)  respectful 

10,  EXCULfATE:  (A)  require    (B)  yield 
(C)  reinstate    (D)  vivify    (E)  convict 


Each  sentence  below  has  one  or  two  blanks,  each  blank 
indicatini  that  somethlnf  has  b«en  omitted.  Beneath> 
the  sentina  are  Hve  lettered  words  or  sett  of  words. 
Chooie  the  word  or  set  of  words  that  best  fits  the 
meaninf  of  the  sentence  at  a  whole. 
Examjlf  ,  ,  


Although  iu  publicity  hat  been  — .  the  Aim  itself 
ii  inltU«ent.  weU-«cted,.hand»3ineiy  produced, 
and  eltofetlie;  — . 

(A)  tuteless>  retpccteble    (B)  ertensivs  jnoderate 
(O  sophisticated. amateur    (D)  risqu<. .ctydc 
(E)  peifect.  jptctacuUf  •  <i><o  <I><Z> 


H.    At  touri«n  u^d  industr}*  develop  along  the  shcrei 
of  the  Gulf  of  California,  it  is  pottible  that  the 
increased  human  —  may  drNe  the  pay  whales 
from  their  —  cahrinj  sites, 

(A)  *«esi>  >forsaken 

(B)  knowledge,  impending 

(C)  activity.. prefened 

(D)  indi/Terence.. destined 

(E)  concern,  .despoiled 

12.  Because  of  Its  Immenw  scope,  crillct  have  rightly 
referred  to  the  bock  a»  the  niott  ~  examination  of 
minority  concerns  in  the  United  States  ever  written. 
(A)  deficient    (B)  intuitive    (C)  obscure 

(D)  unaspiring    (E)  comprehensive 

13.  Hie— of  personality  that  strikes  us  in  Julia 
Cameron's  best  pictures  gives  her  work  a  coherence 
that  is  —  in  the  work  of  leu  accomplished  personal 
photographers. 

(A)  Idea.. compounded    (B)  image. implied 
(C)  theory. .evolving    (D)  force.Jacking 
(E)  feeling,  restrained  ^ 


I  61  WTi 


2$ 


3  3  / 


91-170  0-82  22 


332 


14.   In  addition  to  ihe  traditional  functiont  of 
coUectinf  and  ditplayinf ,  a  muieym  eaUblUnet 
th«  offldal  —  of  an  artiat'i  works,  —  them 
a  prtttife  unattainable  in  a  commercial  ihowcaae. 
(A)  utility,  .propoauif  for 
(•)  subjectivity. jhanng  with. 

(C)  Itylc.  .concedu^  to  ■ 

(D)  importance,  xonferrini  on 
(£)  dciciny.  ^imtlnf  from 

!$.  Althou^Spaldmg —  the  importance  of  the  phytkal 
necewtief  of  life,  her  most  lucceiitful  endeavor  wu  , 
the  —  of  the  condition  of  the  impowlAed. 

(A)  deprecated,  .alleviation 
(•)  emphaiized.  Jnveitiiatiofi 

(C)  accentuaM.  jmelioratio« 

(D)  epitomized,  .delineation 

(E)  diar«prded..detccrat{on 

Eadi  qMestKM  below  coniitts  of  a  related  pair  of  wordi 
or  phraaei,  followed  by  Ave  lettered  pain  of  worda  or 
phruM.  Select  the  lettrrid  paliihat  belt  expreuet  a  ' 
rehtionihip  limUar  to  that  exfrtaied        Oft|lnal  pal/. 

Example;  \  


YAWN: BOREDOM:^  (A)  dream :ilaep 
(i)  anfir:ma<%^ji    (C)  am8e:amuaement 
(D)  facciex^caaion    (E)  impatience  ;rebel]K»i 
\  <p  a>  •  a>  g> 


16.  SAND10X:fLAYV 

(A)  picture: Me    (•)  offkt:wofk 
(C)  library  :pi4>tiah  \(D)  reauurant:  guide 
(E)  lundcrivten:  manipulate 

\ 

\ 


TENANT: RENT::  (A)  i 
(•)  ^rformeT:tid(H    (C)  iAmtor:ln(«rett 
(D)  clkiit;fc«    (E)  profeaaot;  tuition 


It.    DAWN.DAY.   (A)  moon:Di#it    (•)  star:sun 
(C)  week-year    (D)  birth:Iife    (E)  be^infend 

19.  MALLET:P0LO'.  (A),  putteridub 
(B)  bat^baxball    (C)  nddifootball 

(D)  puck:hockey    (E)  lane:bowlin| 

20.  TERR£STR1AL:LUNG;:  (A)  marsupial: pouch 
(B)  ftoral.root    (C)  aquatic;pll 

(D)  perennial :ieed    (E)  caninc:mouth 

21.  DEFAMEREfUTATION:; 

(A)  de moralize :miaery    (•)  challenie: opinion 

(C)  promote  :tal(nt    (D)  disfigure  ^appearance 
(E)  jeopardize: peril 

22.  NEUTER:GENDER::  (A)  lincereMruth 

(B)  uniform;enors    (C)  futile '.hindrance 

(D)  nimble' enctfy    (E)  destitute :poaiestions 

23.  HONE:BLADE::  (A)  cut:scisaors 
(B)  strike:bel]    (C)  reduce:fat 

(D)  focus:ima|e    (£)  fbtten:hiU 

24.  DEBATE:FORENSIC:: 

(A)  decathlon:athletic 

(B)  appbu»e:dranutic 

(C)  co«troversy:8cientifk 

(D)  anthology  ;deacriptivc 

(E)  dia|noais:e)iperimental 

25.  ANNEX: BUILDING::  (A)  tenure:omce 
(B)  rider: document  (C)JeaM:apartment 

(D)  chapter:lext    (E)  limb-extremity 
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Each  passa|«  below  »$  foUowed  by  quest toru  based  on  its  <.ontent.  Answei  all  qucjttons  foUowjnj  a  pasu|e  on  the  baus 
of  shhai  u  stated  onmphti  ui  ihit  pisifge. 


,  One  of  the  favorite  operations  of  the  alchemists  was  t 
process  they  called  '*calcinin|."  It  consisted  of  ^acin|a 
minera!  or  a  metal  into  a  crucible  and  heatin|  it  until  tt 
was  completely  converted  into  a  powdery  solid.  Since  this 
powdery  solid  evidently  resisted  proloflfed  heating  better 
than  anythinielse^it  was  belie /ed  to  have  special  'Vtrtucs" 
and  was  called  "calx."  as  for  example,  the  calx  of  arsenic. 
Calctnuif.  incidentally,  provided  further  proof  of  the  super* 
ioriiy  of  (toid  becauK  r>Id  did  not  have  a  calx 

In  1489  a  German  alchemist,  Eck  von  Sul/bach,  made 
the  stattlinf  discovery  that  the  calx  of  a  metal  weighed 
more  than  the  metal  before  calcining.  The  only  explana> 
tion  he  coiild  think  of  was  that  a  "ghost"  had  come  from 
somewhere  and  moved  into  the  calx,  thereby  increatin| its 
weight. 

We  now  know  that  f<k  von  Sulzbach  had  come  close 
to  (he  truth.  Calcuiing  a  metal  means.  In  present-day  term* 
Inology.  to  oxidlje  it  with  the  oxygen  in  the  atmosj^ere, 
and  naturally  the  compound  of  metal  plui  oxygen  wOl 
weigh  more  than  the  metal  Itself,  But  the  fifteen th<entury 
alchemist  could  not  arrive  at  this  conclusion  because 
Aristotle,  vkhose  word  was  still  undisputed,  had  uid  that 
air  was  an  element  that  did  not  combine  with  metals  How* 
ever,  the  time  wm  not  far  off  when  this  statement  was  to 
be  questioned.  ^ 

26    The  passage  primarily  answers  which  of  the  following 
questions? 

(A)  Why  was  calcining  a  favorite  process  of  the 

alchemists^ 

(B)  Who  was  Eck  von  Siilzbach  and  how  hai  he 

influenced  the  progress  of  idence'? 
(Q  To  what  extent  were  alchemists  influenced  by 
the  teachin]^  of  Aristotle? 

(D)  What  js  calcining  and  how  did  the  alchemists 

interpret  it? 

(E)  How  did  other  alchemists  react  to  Eck  von 

Sulzbach'idiKovety  of  a  "ghost**? 


According  t?  the  pamge.  the  calx  of  two  ounces  of 
arsenic  will  weigh 

(A)  less  than  one  ounce  ' 

(B)  one  ounce  ^ 

(C)  one  and  one-half  ounces  " 

(D)  two  ounces 

(E)  more  than  two  ounces 

The  last  sentence  of  the  passage  suggests  that,  after 
the  fifteenth  century,  some  alchemists  began  to  woft< 
der  whether 

(A)  the  calx  of  a  metal  had  any  special  'Virtues" 

(B)  air  or  some  part  of  it  could  combine  with  metals 

(C)  Aristotle^  description  of  gold  was  accurate 

(D)  calcining  Increased  or  decreased  the  value  of^ 

metal 

(E)  the  calx  of  metal  really  weighed  more  than  the 

metal  did  before  calcining 
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**Thftt*i  ri|hl.  My  wilcMes  wcfe  on  thc~fMt|pIanl( 
md  thtre  wm  Annk  on  the  quay.  That  wai  the  fint 
time  I  thoui^t  of  her  at  all.  AmIc  is  my  wife,  but  ihe 
wMn't  th«n.  I  lookad  at  her  In  the  pouiini  rain  with 
u«n  in  her  eyei  and  the  porten  hitting  up  apinil  he^ 
I  got  to  thinking  of  the  thingi  Td  said  to  her  one  tunc 
or  another.  You  know  th»  thinfi  you're  apt  to  uy  to 
agirir 

**l  do.*'  nid  the  you|\g  man. 

**!  imd  to  fet  back  for  a  few  last  words  with  he i 
bMt  1  had  to  k*ep  standing  aasde  to  let  people  paas, 

"'Come  on  up.  Manny.*  Aouted  the  lads  from  the 
deck. 

**'Goodkye.  Manny/  Annie  called  in  a  little  voice." 
"You  didn't  go  down!'* 

"Down  I  went.  The  boys  called  me  to  come  back 
bMt  the  wind  blew  their  words  away. 

*"l  knew  you'd  com*  to  your  senses.*  Annie  said. 
*WK*re's  >our  fiddle?* 

'"•y  God.  if  I  hadn't  left  the  fWdle  on  deck!  I 
shouted  at  Hmmy  Coync-that's  the  fellow  next  to  me 
in  the  photo.  He  pUyed  the^uno  m  our  band,  by  the 
way. 

"The  flddk!'  I  shouted  against  the  noiae  and  con- 
ation of  the  boat  pulling  away.  Tlmmy  right  away 
ducki  down  then  upc  and  rests  the  fiddle  case  on  the 
rails.  'Catch!'  he  rftouu. 

,  "A  ftUow  in  (he  crowd  next  to  me  leaps  to  catch  it 
bu>  you  know  how  tlipptty  then  wooden  ^rds  can  be? 
WiD.  down  liipa  the  fellow  and  flddle  and  caae  and  even 
#ic  little  bow  were  sma^d  to  smithereens.  You  should 
have  heard  the  crowd  laughing.** 

■^t  did  Annie  say?** 

"it's  tha  hand  of  God.*  ah*  s^.** 

79.   In  the  context  of  the  paaaaga^  the  phraae  '*That's 
ri#)t"  (Imc  I)  iu«atu  primarily  that  ^ 

(A)  MMayandthcpMionheiiaddtMiii!c*^iA 

compkt*  agrvamant 
(•)  the  cottvtrjatkM  w«  are  about  to  read  »  already 

inprograaa 

(Q  MannyiaMfartorfCOunthisexp«nenc<to 
whomtvtrwiUUsten 

(D)  one  story  hat  been  told  md  another  is  about 

tob«fkn  ^ 

(E)  Minny  wants  his  liatenci  to  bettev«'what  he  hai 

toldhkn 


30.   It  can  be  inferred  that  all  of  the  following  contributed 
to  Manny's  daciaion  to  rejoin  Annie  on  the  dock 
EXCEPT 

CA)  Annie's  tears  ' 
(i)  the  sight  ofAnnlf  in  the  rain 

(C)  the  sight  of  Annie  jostled  by  porters 

(D)  the  weakness  of  Anide's  voice  uymg  goodbye 

(E)  fit  attitude  of  the  men  on  the  deck  tocrard 

Annie 


In  the  context  of  the  passage,  the  flddle  is  represent 
tative  of  aU  of  the  foUowing  EXCEPT 

(A)  fraedom 

(!)  youth 

(Q  religious  faith . 

(D)  creative  imagination  ^ 

(E)  unexplored  poaaibility 
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•        Thote  who  Ihuik^f  evolution  as  merely  a  proceu  of 
*  adaptation  lo  particular  er./ironmenis  re^rd  the  emer- 
^lencv'  of  life  from  the  water  as  having  been  made  poutble 
by  Its  adaptation  to  the  dry  environment  outside.  Thou|^ 
this  hypotheus  is  not  fi]s«  in  iis<If.  it  represents  too  ihoU 
J  WW,  In  the  long  vkw.  evolution  has  been  toward  an 
eveMiure^ung  independence  of  the  natural  external  envl> 
ronment.  w^haiever  tt  n>ay  be< 

lei  mc  give  an  example^  To  this  day,  the  development 
of  a  fertUued  animal  cell  through  the  embryonic  stage  can 
lake  place  only  in  a  liquid  environment.  Therefore,  the  < 
first  organisms  to  emerge  on  Isnd,  repreKriied  today  by 
frogs,  had  to  retum  to  t(ie  water  to  lay  their  eggs.  What  * 
,   finally  brought  about  compIetMndependence  from  ifie 
water  was  ihe  development  of  the  amniotic  egg.  which 
packaged  the  watery  environment  required  by  the  embryo 
inude  a  memb.an*  or  shell  (i  e..  an  amnion).  So  the  liquid 
environment  that  a  human  embryo  requires  is  provided 
innde  an  amnion  inside  the  mother's  womb.  A  human 
embryo,  unlike  that  of  a  fish.irindependent  of  the  envl< 
ronment  external  to  its  mother,  indifferent  to  chahges  of 
temperature -indifferent,  even,  to  whether  the  enviionrnent 
IS  wet  or  dry. 

The  first  human  beings  to  emerge  from  the  earth's 
atmoiplierk  envelope.  In  the  1960'$.  were  able  t?doso 
becauM  they  packaged  that  atmosphere  m  their  amniotic 
spacesuiti  and  spaceihipi.  Thus,  human  belnp  are  now 
/ble  to  vitlt  the  moon  in  spile  of  a  lunar  environment  that 
would  kill  them  on  ioniaci  What  these  astronauts  repre* 
sent  IS  not  adaptation  to  the  natural  environment  but  in- 
dependence^  it.^ 

32,  The  author's  primary  purpose  in  the  pauage  Is  to 
(A)  reveal  the  .niracle  of  human  reproduction 
(0)  offer  a  wider  interpretation  of  evolution 
(O  explain  the  larger  meaning  of  the  word 
"amnion" 

(D)  illustrate  the  difference  between  a  frog  embryo 
"anTiTKuman  embryo 

(E)  cor/pare  the  space  age  with  the  emergence  of  „ 

life  from  the  water 


35. 


From  the  tone  and  content  of  the  pasuge  it  can  be 

inferred  that  the  author  u  addressing  which  of  the 

following  audiences? 

(A)  Highly  specialized  scientists 

(!)  Marine  biologist! 

(C)  Educated  nonprofesaionals 

(D)  Aspiring  astronauts 

(E)  Environmental  conMrvaiionists 

The  author  uses  the  development  of  the  amniotic  egg 

to  illustrate  which  of  the  following? 

(A)  The  freeing  of  the  reproductive  process  from  its 

earlier  dependence  on  :he  external  environ- 

nKnt 

(i)  The  continual  JepenJence  of  life  on  a  liquid, 
extemal  environment. despite  the  emergence  of 
creatures  on  fmd 

(C)  The  adaptation  of  organic  life  to  the  external 

-      envlroruneni  \ 

(D)  The  independence  of  the  first  organisms  to 

emerge  on  Imd 

(E)  The  adapihre  nature  of  the  evolutionary  proceu 

We  :*n  infer  from  the  pasuge  that  the  author  sees 
sp«c«fuiti  and  spaceships  a»  examples  of 
(A)  atmospheric  adaptation  ^ 
(•)  artificial  pfogfesa 

(C)  futuristic  apparel  « 

(D)  a  technolo^al  variation  of  evolutionary 

progreM 

(E)  an  innovative  packaging  in  modern  technology 
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Amoni  •coaonutti.  John  Maywrd  Keynes  rank* 
with        Smith  and  Kail  Marx  in  the  influence 
that  ha  viewi  hive  exerted  on  the  genenl  public 
He  h«d  the  vi«on  to     that  ccononua  iKked  i 
gmtttH  theory  o  f  demand,  and  he  proceeded  wuh 
boldnev^d  brlilknce  to  ccnitiuct  one. 

Hit  lh«ory  produced  the  siartlinf  cCMKhtnon  that 
hl|hly  deT«k>p«d  induitria!  countries  wffer  from  a 
chronk  deflckncy  of  demand  and  that  thk  deAden' 
cy  »  bound  to  irow  worae  at  countries  become 
richer.  Hence,  Kc^mes  called  on  fovemment  to  ^ 
aiaurx  a  new  reaponsibillty  and  a  new  furKtion:  to 
close  the  growinf  pp  between  the  power  of  profrcs* 
tlve  economies  to  produce  and  the  see  of  efTective 
private  demand.  Keynes  sunested  two  genera]  lines 
orsctiofv-that  ofcontroUinf  the  lize  of  the  gap 
through  changes  in  the  distribution  of  income  and 
that  ofofTietting  the  pp  through  greater  govern- 
ment spending. 

Keynes's  theory  contributed  invaluabk  tools  of 
analysu  to  economics  and  started  hundreds  of  able 
eccnomrsti  in  many  lands  studyirtg  the  important 
probiemi  that  the  theory  opened  up.  No  one  in  the 
hutory  of  ecooomVa  ha*  done  at  much  as  Keynes 
to  itimuUte  good  work.  M  Keynej's  theory  hw 
turned  out  to  be  wrong  in  all  its  essentials.  Although 
intended  to  be  a  ''general"  theory,  applicable  to  aU 
conditions,  it  was  unduly  molded  by  the  depressed 
Thirties,  the  period  during  which  Keynes  composed 
it.  Since  then,  ecmomists  have  determined  that 
advanced  economies  do  not  wlTer  from  »  cljronic 
deAciency  of  demand^they  suffer  from  a  chronic 
excess  of  demand.  It  would  be  hard  today  to  fold 
an  advanced  economy  that  u  not  struggling  to  con- 
trol demand,  and  most  of  them  ^  having  only 
partial  success. 

It  is  among  the  undeveloped  economies,  precisely 
.where  Keynes  did  not  expect  to  And  a  chronic  short- 
age  of  demand,  that  unemployment  is  endemic  and 
most  tevtre.  Keynes's  theory  that  unemployment  is 
caused  by  an  excessive  disposition  to  ttve  obviously 
does  not  explain  the  high  unemployment  in  countries 
that  are  too  poor  to  have  any  aa/inp  at  all  The  high 
unemployment  in  undeveloped  counirKs  !s  best  ex- 
plained by  Marx's  theory  of  unemployment -that 
people  lack  work  because  savings  are  Insufnoent  to 
provide  the  growing  labor  force  with  the  tools  of 
production. 

Why  hu  Keynes  turned  out  to  have  been  so 
completely  wrong?  He  made  two  basic  mistakes.  In 
the  flrst  place,  he  assigned  to  consumers  *  relatively 
passive  role  in  determining  the  demand  f'or  goods. 
In  the  second  place,  he  overlooked  the  fact  that  the 
development  of  invtstment  opportutUtletls  itself  an 
expanding  industry,  able  to  supply  the  community 
with  a  rapidly  growing  number  of  investment  outlets. 


36.  The  author  is  primarily  concerned  with  which  of  the 
following? 

(A)  Rebutdng  Keynes's  theory  of  demand 

(B)  Presenting  a  tlworetical  approach  to  the  problem 

ofunemployment 

(C)  Extending  the  range  of  influence  of  Keynesian 

theory, 

(D)  ContrMing  Keynesian  economics  with  Marxist 

theories 

(E)  Establishing  the  economic  respontibihties  of 

modern  governments 

37.  It  can  be  infened  that  the  author  attributes  the 
unsoundness  of  Keynes's  theory  chiefly  to  the  fact 
that  it 

(A)  lacks  conclusive  proof  and  IS  untried 

(B)  rejKts  a  positive  course  of  action 

(C)  considers  as  universal  some  rules  that  pertain  to 

a  specific  economic  era 

(D)  allows  too  many  exceptions  to  its  basic  concepts 

(E)  doesnot  concur  with  theonesofcontcmporsry 

economists 

38.  Whichofthe  following  does  the  author  particularly 
emphasize  as  a  Keynesian  contribution  to  the  fleld 
of  economics? 

(A)  Foonulation  of  a  new  attitude  toward  govern- 

ment 

(B)  AnaJystt  of  the  theory  of  Unemployment 

(C)  DevelopnKnt  of  a  theory  of  mcome  distribution 

(D)  Stimulation  of  the  thought  and  work  of  other 

economists 

(£)  Expansion  of  the  theories  ofSmith  and  Marx 

39.  The  author  notes  that  one  of  the  causes  of  unem* 
ployment  that  Keynes  overlooked  is 

(A)  excessive  private  demand 

(B)  insufficient  lavings 

(C)  governmental  intervention 

(D)  lack  of  Initiative 

(E)  mechaniutlon 

40.  As  used  in  line  39,  the  word  **endemic"  can  best  be 
interpreted  to  mean 

(A)  conUgious  and  increasing 

(B)  exchithre  and  persistent 

(C)  unhkely  to  be  found 

(D)  difficult  to  explain 

(E)  native  to  the  locality 


STOP 

IF  YOU  HNISH  lEFORE  TIME  IS  CALLED.  YOU  MAY  CHICK  YOUR  WORK  ON  THIS  SECTION  ONLY 
DO  NOT  WORK  ON  ANY  OTHER  SECTION  IN  THE  V£SX, 
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«J  SECTION  V 

Time— 30  minutes 
35  QUESTIONS 

tn  this  section  solve  each  problem,  usinf  any  svsiisble  iptct  on  the  ptfc  for  scrat  J\work.  Then  <lecide  which  is  (he  best 

of  the  choices  tr^n  and  blacken  the  conespondlnS  ip»c<  on  the  inswer  sheet. 

The  foUowini  jnfornuticn  h  for  your  reference  in  tolvint  some  orihe  problems. 

Orde  of  radius      Area  =  jrr?;  Circumference     2fr  Triangle   The  sum  of  the  measures  ift 

The  number  -of  depecs  of  arc  in  a  circle  is  360.   •'  y\  de|rtes  of  the  angles  of  a 

The  measure  In  degrees  of  a  stiai|ht  angle  is  ISO.  /  j\  triangle  b  }S0. 

DennilJOfts  of  symbols:  .  /    l\       If /IQW  is  a  right  angle,  then 

"    is  equal  to  ^    ii  less  than  or  equal  to         y       H    \  AB  X  CD  ' 

1*    IS  unequal  to  ^    is  greater  than  or  equal  to  ^  ^    '       (0  area  of  AXJC  =  

<   is  lest  than  1|    is  paraUel  to  /2\  ^^a  a        +  p^a 

>   IS  greater  than         1    is  perpendicular  to 

^j<>te.  Figures  whivh  accompany  problems  in  ihit  ies(  are  ui  tended  iu  provide  m  forma  lion  useful  in  solving  (he  problems. 

They  are  drawn  as  4c«.u rarely  as  possible  EXCEPT  when  it  js  stated  in  *  spevifiv  problem  (hat  us  figure  is  not  drawn  to 

scale  All  figures  l;c  in  a  plane  unless  othcrwue  indicated.  All  numbers  used  are  real  numbers. 


I«    If  2x  +4  =9,  then        ^  = 

(A)  2    (8)  3    (C)  6    (D)  12    (E)  14 

2.  (Sv/TX2v^)=^ 

(A)  4«    (B)  72    (C)  96    (D)  298    (E)  576 


-I  0+1 

On  theliumber  line  above,  a  particle  starts  at  0 
"^andjnoves  a  distance  of  2  to  the  tight,  then  from 
theie^bves  4  to  jhe  left,  then  6  to  the  right,  and  so 
on,  alterftating  directions  a^ld  lengthenirig  each 
mo\e  by  2.  At  the  end  of  the  fifth  move,  where 
on  the  number  line  will  the  particle  be  located? 

(A)  -8    (B)  -4    (C)  +1    (D)  4«  (E)-+IO 


4.    In  the  figure  above,  jf  ss 

(A)  120    (B)  90    (C)  60    (D)  45    (E)  30  \ 


5.  If  X  and  ^  are  positive  integers  and  if  J 
and  (jf  +^)'  =  which  of  the  following 
CANNOT  equal  z'' 

(A)  4 

(B)  9 

(C)  16 

(D)  36 
.  (E)  64 

6.  If  i  $27,000  prize  was  divided  among  three  people 
in  the  ratio  of  2.3.5,  what  was  the  value  of  the 
lariat  share? 

(A)  SIS,900 

(B)  SI 3,500 

(C)  J«,100 

(D)  $5,400 

(E)  $2,700 

7.  If  ^  is  some  number  between  4  and  10,  which  of 
the  following  could  be  the  average  of  the  numbers 
2. 5, 6, 8, 9,  and  y? 

(A)  4.3 

(»)  6.2 

(C)  7.8 

(D)  9.1 

(E)  10.0 
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Qmttiow  t.27  Mch  coniist  of  two  quwuties,  one  in  Coiumn  A  and  one  in  Column  B.  You  are  to 
compwt  dM  two  quantitiei  and  on  the  aiuwcr  sh«et  bUcken  sp»c« 

A  if  the  quantity  m  Columo  A  U  freater; 

B  if  the  quantity  in  Column  B  it  freater;  ^ 

C  if  lh«  two  quantities  are  equal; 

D  if  the  nlationahip  cannot  be  (ktermined  from  the  infonjution  pven. 
Kotea:   1,  In  certaki  quettiom,  information  conceminf  one  or  both  of  the  quantiUea  to  be  compared  is  centered 
above  the  twocoiumns.  ' , 

2:  In  a  pven  question »  a  symbol  that  appears  in  both  colUmns  represents  the  same  thint  in  Column  A  u  It 

dc«a  in  Coiumn  B.  ^ 
3.  Letteis  such  as    it,  and  k  stand  for  real  numbers. 


EI. 

EXAMMJES 
Column  A         Coiumn  B 
2X6  2+6 

i  Answers 
1  •  a>  <D  CT 

E2. 

110  -  X  y 

1  a>  (P  •  cx> 

E3. 

p. q                q-  p 

|a><j>  o  • 

Column  A 

Column  B 

8. 

6  +  4' 

x  +  S"  19 
y  +  S'^li 

% 

X 

y 

10. 

J  +  2A 

C+J  +  < 

nXi  and  qAm 


Column  A 
-Oj013 


Column  B 
-00*7 


x^O 


3x' 


(3x)' 


14. 


p>q>r>(k 
p'^  pq  +  qr 


TELEPHONE  RATES 


From 
Pto 

First  3, 
Minutes 

Each  AddiUonal 
Minute 

0 

45^ 

S 

15^ 

S4 

IS.   Hie  coat  of  a  20-nf«nutc 
call  from  P  to  S 


SI  00 


x>'r  >0 
x<0 


16. 


16*  of  2xa96. 


l6%of  X 


48 


I  CO  OHIO  IHENtXIMCE^ 


/ 
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SUMMARY  DIRECTIONS  FOR  COMPARISON  QUESTIONS 

Antwtf>  A  if  ihe  quantity  m  Cduim  A  is  Vtutt, 

B  if  the  quantity  m  Colitim  B  is  jteaicr. 

C  if  the  two  quaniitws  ate  equal: 

D  tf  the  relationship  cannot  be  deternuned  from  the  infotnution  tiven. 


Column  A  Column  B 

-7  <  71  <  -3 


18. 
19. 


Volume  of  a  cylinder  Volume  of  a  cylinder 
with  radius  2  \vith  radius  4 


Acartraveh  d  Julometenm  /  minutes  at  a 
constant  rate  of  60  kilometers  per  hour. 


21. 


UST  I:  1,2,3 
LIST  II:  2.3,4 

X  IS  a  number  choien  at  random  from  List  1  and 
y  is*  number  choten  at  random  from  Ust  II. 


The  most  likely  value 
of  ;t  +^ 


23. 


s  C 

Note-  Fijure  nol  drawn  to  scale. 


Column  B 


X  k  an  intvfer  ireater  thin  1.  [T]  denotes  th< 
uniQett  positive  faitefer  factor  of  x  not  equal 
to  I. 

□  0 

71  is  a  positive  intefer. 

25.       i-ir  (i+(-i)r 


26. 


Note;  Figure  not  drawn  to  scale^ 
2x  x+36 


BiX2) 


(1.0) 

Note  Figure  not  drawn  to  scale, 
£^OBC  has  an  area  of  12. 
4  8 


/ 
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SoJve  each  of  the  rcmainmj  Pfobkn»  m  thu  fccuon  usmi  iny  iraiJjbk  jpice  fw  icfiichwoik  Then  decide  which  it  the 
best  of  the  choices  mti  md  blacken  the  coiieipondinj  Jpace  on  the  *n$wer  sheet 

32.   Ihe  pcoible  scores  on  t  weekly  truth  quiz  itn|e 
♦  from  0  to  100.  If  Pit  receives  scores  of  65  ind  75 

on  the  first  two  quizzes,  what  is  the  lowtst  pOMible 
Kore  Pit  can  receive  on  the  third  in  order  to  averafc 
75  on  the  firet  4  quiuesi 


2t.   In  the  figure  above ^  if         ii  equilateral,  what 


is  the  ratio  ^ 


(A)- 


in)±  (C)^ 


(D)  I    (E)  2 


The  difference  between  6  j  hours  and  7y  hours 
u  how  nun/  nunules? 

(A)  40    (B)  «    (C)  50    (D)  56    (E)  64 


30,    For  *  0, 


(A)->'    (B)-^  (C)-#^ 
J' 

(D)fl'*>'    (E)  l+i>' 


31.  In  the  Hfure  above,  which  of  the  fdiowmf  must 
be  equal  to  i  ? 

$+b 

C  +(/ 

"'5 


(A)  None  (B)  I  only  (C)  U  only 
(D)  land  II  only    (E)  IJI,  and  III 


(A)  50 

(B)  55 

(C)  60 

(D)  65 
(£)  70 


33.    In  the  fifure  above,  the  area  of  the  senudrcle  is 
(A)  36ir    (B)  lljr  .(C)  12*    (D)  9it    (E)  ■ 


Ihe  re  are  fewer  than  40  students  enrolled  in  a  cer* 
2 

tain  class.  If,  at  a  certain  time,  ^  ofthestudenU 


have  tone  to  the  bbraty.what  u  the  total  class 
enroUment? 


(A)  18 

(B)  27 

(C)  28 

(D)  32 

(E)  36 


O 


35.    In  the  (ipire  ibove,  whil  ii  the  ptneu  nombei  of 
nonoverlippinc  re|fofU  tnto  which  the  shaded  ie|ion 
an  be  divided  with  exacil/  two  iiiai|hi  linn'! 

(A)  6    (B)  5    (O  4    (D)  3    (E)  2 


STOP 

IF  YOU  nWSH  BEFORE  TII^E  IS  CALLED.  YOU  I^AY  CHECK  YOUR  WORK  ON  THIS  SEOION  ONLY 
DO  NOT  WORK  ON  ANY  OTHER  SECTION  IN  THE  TEST. 
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SECTION  VI 
Time— 30  minutes 
50  QUESTIONS 

Ttm  M«non       yout  ibilUy  to  uk  jundard  wijucn  Eniluh,  the  kind  yf  Enjjiih  found  in  most  vol!c|c  textbooks 
D>rccnons   The  foliowinf  Mntencei  voniain  prublemj  in  jrimnin,  ouje,  duUon  (choiwe  of  wofd$).  and  idtom 

Some  sentences  are  correct 

t^o  sentence  contains  more  than  one  error. 

Vou  w%i\  fin  J  thai  the  error,  li  theie  is  yne,  is  underlined  and  lettered.  Assume  thai  all  ythei  elements  of  Ihe  sentence 
are  <.<>rrevl  and  tannoi  be  vhanfcd.  In  chwosinj  answers,  follow  the  lequirements  of  standard  written  EnjJiJh. 

It  iheie  IS  an  eiroi^  selevi  the  one  underlined  paii  thai  must  be  vhanfed  to  make  the  sentenvc  wutrevt,  and  blacken  the 
correspor^dm/;  tpacc  on  your  ansv^^r  iheet. 


If  ihcfc  IS  no  error,  blacken  answei  space  'J^* 


EXAMPLI: 

SAMPLE  ANSWER 

lie  »poVe  bluntly;  and  angnly  to  we 
A             B  -C 

ij^vlators.  No  error 
L 

I     Most  p<ople  bifn  lu  the  weather  loreiast  eveiy  day.  4. 

but^they  know  hardly  nothini  about  the  forces 
A  B  C 

that  influence  the  weather  No  error 
D  E 

2,    Ibrn  and  the  «jthei  dclejcates  immediately  aA.4.«pt«d  5 
A  B  C 

the  icsolution  drafted  by  the  neutral  states 

i> 

error 

— r~  6 

)     ftte  fouoJaiions  of  psychoanalysis  were  established 
A 

by  Sjipnund  Freud«  who  be|;un  to  develop  his 

B  C 
theories  in  the  ISSOV  No  error 
15  E 


{60  Oil  TO  THE  MKT  TACE 


C^artei  flights,  althou^  nm'.h  less  expensive  than 
A  B 

scheduled  travel,  is  well  knuwn  for  late  takeoffs 

C 

and  othei  inconveniences   No  error 


Many  women  reenter  the  job  market  when  their 
A  6 

youniest  children  st>f  tfd  kindergirten  No  error 
CD  fc 

After  facing    many  jroupt  of  angry  people, 
A 

Martin  Luther  King,  ir  became  accustomed  to 
B 

confrontations  that  were  unpredictable  and  even 

^  U 
potentuUy  explosive.  No  error 
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Dunnf  the  early  MtddJe  Afe5.  before  the  devetop* 
A 

mcnt  of  the  pnnlint  preu.  virtudly  th«  only  books 
B 

were  tho»e  that  are  labors outly  copied  by  mOnU. 

C  D 
No  error 


13.   tn  contra$tinc  to  the  popular  v»ew.  the 
A 

characterutte  way  of  life  of  many  Native 
B 

AiTKrkan  peoples  was  neither  nomadtc  not 
"C*  TT 

warlike.  Ko  error 


Tht  deasion  that  has  imt  ixtn  aireed  w^th  by  the 

A  g 
committee  members  should  serve  as  a  basis  for  th<Hr 

work  m  the  yean  to  come.  No  etrof 


U.   Until  rectf^tly.  Americani  drartk  five  cups  of 
A  B 
coffee  for  every  cup  of  tea,  but  now  ihey  are 
C 

drlnkinc  more  of  it.  No  error 

"IT  ~r— 


9,    In  her  novels.  NelU  Urion  focuied  on  the  problems 
A 

ofVouni  black  women  which  lived  m  Europe  and 
B  C 

America  dunnt  the  I920's.  No  error 
D  E 


IS.    All  our  nei|hbor$  are  wondertn|  what  the  {overn 
A 

ment  will  do  about  the  raisini  laaoline  prices  and  the 

B  C 
shortaie  of  otl.  No  error 
D  E 


10    As  general  fupcrvtsor.  Ms  Rodrfiuet  expects  hei 
A 

staff  to  work  as  carefuUy  and  as  haid  the  way  she 

— r~  c  D 

herKlfdoes  No  error 


1 1.  People  who  dishke  cats  sometimes  ctittdzg  th^m 

A 

for  btini  aloof  and  independent;  t>«ople  who  are 
» 

fond  of  c<ts  often  admire  them  foe  the  same 
qualities.  No  enor 

12.  Only  a  few  feet  beyond  those  abaj)don#d 

X  B 
and  cruroblini  buOdiftji  stand  a  beautiful 

duller  of  waepinc  willow  tries.  No  error 


16.  There^certain  areas  of  the  southern  United  States 

A  B 
where  snow  has  rtever  fallen.  No  error 
C  D  E 

17.  When  Pele'  was  playint  soccer,  {le  was  as  talented  as. 

A  B  ,  . 

or  more  talented  than,  bavebail  or  basketball. 

 e  D  

No  error 
£— 

IS.   the  needs  of  diDdren  often  axe  rx)t  taken 
A  B 
Into  account  in  the  desitn  of  public  bukJuiis 

nor  residential  areii.  No  error 

TT  ""in 
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19.  In  a  Kctnx  created  wiMlife  refufe,  the  birds 

A 

are  now  buildlni  their  neiu,  thereby 

5  IT 

great ty  changr^  the  ecology  of  the  area. 
D 

No  enor 

20.  Becaute  Rashes  of  ti|ht  distract  them,  entertainers 

A 

often  request.that  people  with  a  camera  refratn  from 

B  CD 
takinf  pictures  durinf  performances.  No  error 
E 

21.  Color  blindness  rmy  handicap  one  in  some 

*  A 

respects,  but  >ou  can  stilj  function  normally 
m  almost  all  situations  you  encounter  No  error 

22    RtWit  at  1  iije  of  ten  inches  per  hour,  the  Red  River 
A^™3 

soon  posed  a  .«rious  threat  to  the  residents  of  the 

C  D 
vatky  No*rror 


23.  Astronomy  and  astrotofy  are  both  concerned  rn 

A  B 
the  heavenly  bodies,  but  thtu  purposes  and 

methods  are  quite  different.  No  error 
g  g— . 

24.  As  the  discussion  between  the  two  candidates 

A 

continued,  they  spoke  more  and  nwre  loudly 

B      ,  C 
and  with  less  and  less  dignity   No  error 

25.  The  doctor  lived  in  the  tropics  for  three  years 

A  B 
before  he  was  inflrcted  by  malaria  No  error 

C  ^  E 


I  to  Pit  TO  THE  HEX!  PUE^ 
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The  foUowint  Mnlencet  lesi  cortectMSS  and  effecuveneu  of  expression. 

Rfcctions  In  each  of  the  followini  Mntences,  lome  pari  or  all  of  the  xnlence  is  utiderlmed.  Under  eich  s«r)lence  you 
wiHi'HndYivt  ways  of  phrasing  ihe  underlined  pari.  Select  the  answer  that  produces  the  most  effeclive  sentence,  one  ihai 
w  clear  and  exKr,  wlihci^i  awkwardness  or  ambi(uily,  and  blacken  the  corresponding  space  on  your  answer  sheet.  In 
choosing  answers.  foUow  the  requirements  of  standard  wrttlerv  English,  but  do  not  mike  a  choice  ihal  changes  the 
meaning  of  the  original  sentence. 


Answer  (A)  u  always  the  same  as  the  underhned  part.  Choose  answer  (A)  if  you  rhmk  (he  original  sentence  needs  no 
revision. 


EXAMPLE 

SAMPLE  ANSWER  - 

Ms.  Rose  planning  to  teach  a  course  in 

CDCEx©  <§>  • 

biology  next  summer. 

(A)  planning 

(B)  are  planning 

(C)  have  planned  ^ 

(D)  with  a  plan 

(E)  plans 

26.  Because  dodo  birds  could  not  fly  >  so  they  were 
killed  by  the'hogs  and  monkeys  brought  to  the 
tsianJs  by  the  explorers. 

(A)  fly,  so  ihey  were  killed —  - , 

(B)  fly,  they  were  killed 
(Q  ny  and  they  were  killed 

(D)  fly.  and  thu  alk>wed  them  to  be  killed 

(E)  fly,  kJhng  them 

27.  Performing  before  an  audience  for  the  fir^t  time. 
fear  suddenly  overcame  the  child  and  she  could 
not  remember  her  lines.  ' 

(A)  fear  suddenly  overcame  the  child  and  she 

could  not  remember  her  lines 

(B)  the  lines  could  not  be  remembered  by  the 

child  because  she  was  overcome  by  fear 

(C)  the  child  was  suddenly  overconte  by  fear  and 

could  not  remember  her  lines 

(D)  the  child  was  suddenly  overcome  by  fear. 

she  could  not  remember  her  lines 

(E)  Middenly  the  child  was  overcome  by  fear,  and 

consequently  not  remembering  her  fines 

28<    Young  people  are  not  rejecting  marriage,  but 
some  postponini  It. 

(A)  soffw  poilpontng  it  * 

(B)  some  ate  postponing  it 

(C)  II  ix  postponed  by  some  of  them 

(D)  n  ii  being  postponed 

(E)  some  having  postponed  it 


29    Violin  makers  know  that  the  better  the  wood  is 
seasoned,  the  better  the  lestilts  for  the  tone  of  the 
Instrument. 

(A)  better  the  results  fot  the  tone  of  the  instrument 

(B)  better  the  tone  of  the  instrument 

(C)  belter  the  result  is  for  the  instrument's  tone 

(D)  resulting  tone  will  be  better 

(E)  result  will  be  a  belter  Instrument  tone 

^Q,  Althpugh  today  many  fabrics  are  inadt  from 
syntheric  fibers,  at  one  time  ail  natural  fibers 
were  used  >n  their  manufacture. 

(A)  all  natural  fibers  iere  used  in  their  manU' 

facture 

(B)  all  fabrics  were  made  of  natural  fibers 

(C)  they  were  making  them  all  of  natural  fibers 

(D)  they  made  fabrics  all  of  natural  fibers 

(E)  their  manufacture  was  of  all  natural  fibers 

31.   Between  three  and  four  pet  cent  of  all  children 
born  with  hearing  defects  serious  enough  to 
require  medical  treatment. 

(A)  born  with  hearing  defects 

(B)  being  born  with  hearing  defects  that  are 

(C)  are  born  with  hearing  defects 

(D)  are  bo.Ti  with  heanng  defects,  these  are 

(E)  born  with  hearing  defects  which  are 
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6 

yL    I«u<d  in  Crcal  Idtilo  In  1S40,  the  fint  lummed 
pcntitt  ^tampln  hbiory  wm  Icnown  u  the 

(A)  the  fInt  lummed  pottafc  sump'  tn  history 

wu  known  ss 
(i)  th«y  called  the  flm  fummed  postar  stamp 

(n  history 

(C)  Hstory  refen  to  the  first  fummed  pottage 

stamp  as 

(D)  WM  the  Hfst  lummed  po$ta|e  stamp  in 

history. 

(E)  the  first  fummed  poctafe  ttamp  in  history 

bein{  known  ss 

33.  A  number  of  pvents  are  concerned  about  the 
protection  of  hjjh  school  athletet  and  the  many 
Injuries  belni  reported. 

(A)  athktes  and  the  many  injuries  beinf  reported 

(B)  athletes  and  numerous  reports  of  injuries 

(C)  athletes  because  of  reports  of  numerous  injuries 

(D)  athletes,  but  many  injuries  axe  bein(  reported 

(E)  athletes,  numerous  injuries  hive  been  reported 

34.  Many  inferior  films  earn  a  great  deaJ  of  money  for 
their  productri,  some  extremely  food  ones  do  not 

(A)  Many  Inferior  fUnueam 

(B)  Many  an  Inferior  film  earns  < 

(C)  With  many  Inferior  fUms  which  earn 

(D)  However, many  inferior  films  earn 

(E)  Although  many  Inferior  films  earn 

35.  Gas  rationing  would  force  consumers  to  tjse  their 
cars  less.  u*e  public  transpot ution  mote,  while 
conserviint  gasoline, 

(A)  while  conserving 

(B)  as  wtil  as  conseiving 

(C)  conjerring 

(D)  and  thereby  con$efve 

(F)  to  conserve 

36-    Dolphins  h.tve  a  basic  locla!  orpnlatioo,  a  system 
of  communication,  and  their  brains  are  MthW 
developed. 

(A)  and  their  bttms  ue  hijthly  developed 
,    (B)  and  highly  developed  bttint 

(C)  with  h^lily  developed  brains 

(D)  while  their  brain*  ut  developed  highly 

(E)  but  their  brains  are  developed  highly 


37.  "Ow  Romans  built  many  mafniHcent  aqueductt 
and  roads,  they  were  truly  the  treat  engUieers 
of  the  ancient  wortd.  ' 

(A)  roads,  they  were  truly  the  great 

(B)  roads,  consequently  they  were  truly  the  great 

(C)  roads  and  as  a  consequence,  they  were  truly 

the  greatest 

(D)  roads;  truly  the  great' 

(E)  loads;  they  were  truly  the  great 

38.  The  Japanese  bepn  ih«i!L«in«!*«ble  Jiosl**»,  

recovery,  but  they  were  able  to  recover  from  the 
psychological  effects  of  the  war, 

(A)  recovery,  but  they  were 

(B)  recovery,  where  they  were 

(C)  recovery  only  when  they  were 

(D)  reoover/only  When  being 

(E)  recovery  because  it  was 

39.  For  success  in  sports,  it  is  important  not  only  to  be 
in  tood_physKal  condition  but  also  to  know  the  rules 
of  the  garne. 

(A)  to  be  in  good  physical  condition  but  also  to 

know  ' 

(B)  being  in  good  physical  condition  but  also  to 

know 

(C)  to  be  tn  good  physical  condition  but  also 

knowing 

(D)  being  in  good  physical  condition  but  also 

knowing 

(E)  that  one  be  in  good  physical  condition  but  also 

that  you  know 

40.  Founded  in  1910.  the  Urban  League  was  established 
and  has  continuously  hid  for  its  purpose  the  aim  o? 
assisting  blacks  wtio  live  in  large  dtiei. 

(A)  was  establishe4  and  has  continuously  h(d  for 

iu  purpose  the  ilm  of 

(B)  was  established  to  aim  in  the  purpote  of 

(C)  has  continuously  had  for  its  purpose  the  aim  of 

(D)  has  alwiys  aimed  at 

(E)  was  with  the  purpow  of 
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Note;  The  rcnttininf  questions  ate  like  thote  »l  the  be|(nnin|  of  the  tection. 

Directions^  In  each  sentence,  telect  the  one  underlined  part  that  mutt  be  chin|ed  lo  nuke  the  sentence  correct,  and 
blacken  iKc  correspondini  space  on  your  answer  sheet. 
If  there  u  no  error,  blacken  answer  space  CD . 


EXAMPLE: 

SAMPLE  ANSWER 

He  spoke  bluntJy  and  angnly  to  we 

CD  <£>  •  CS>  CD 

A            B       T  . 

spectators.  No  error 

b  E 

41 «   Meahsts  are  rwt  always  as  igtorant  of  realities  as  fiis 
AS  C 
crltta  wouJd  like  to  believe.  No  error 
D  E 

42.  Once  an  Itanan  colony,  Enlrea  was  captured  by 

A  fi 
the  Bniiih  in  1 94 1  and  was  united  with  Ethiopia 
C 

ui  the  early  I950's   No  error 

43.  More  women  ut  compclinj  in  uhletks  as  new 

A  B  r 

opportunities  for  i raining  develop  and  as  sports 
proinnu  will  expind.  No  error 

|y  E 

44    Mayor  Jameson  was  eater  to  demonstrate  that  she 
A  5 
was  not  prejudiced  in  favor  of  any  particular  political 

groups  and  residents  of  spcdHc  areas  of  the  city. 
IT  U 

No  ettpf 

4S.   In  any  lively  debate,  there  is  st  least  two  sides  to 
A  F 
an  issue  and  flv«  arguments  foe  tvtry  point  of 


view  presented.  No^rrof 


46.  After  she  had  spoke  for  fifteen  minutes,  the 

A 

senator  answered  candidly  the  questk)M  aakcd  by 
B 

the  reporters,  whose  skepticism  was  obvtout. 

"IT 

No  error 

47.  Demonsi rating  new  products  is  a  more  expensive 

A 

but  more  effective  sales  technique  than 
B 

merely  talking  about  them.  No  error 

C  TT  E 

48.  Moscow's  dty  ofAdak  plan  doubHm  the  sixe  of 

A 

the  diy*s  subway  system,  which  already  induda* 
nwit  than  one  hundred  nties  of  track.  No  fror 


49.  The  speaker  argued  that  neither  industry  nor 

A 

tovemment  have  taken,  full  responsibility 
B 

for  redudni  the  spiral  of  Inflation.  No  error 
C  D  E 

50.  The  average  taxpayer  waits  untH  April  to  file  a 

A 

tax  return  unless  they  expect  to  receivi  a  refund 
of  considerable  alxe.  No  error 

 D  r- 


IF  YOU  nWSH  BEFORE  TIME  IS  CALLED,  YOU  MAY  CHECK,  YOUR  WORK  ON  THIS  SECTION  ONLY 
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HOW  TO  SCORE  YOUR  SAMPLE  TEST 


SAT  3C0<*t  ar*  rtporttd  on  *h«  Coll«gt  Board  scalt  ol 
200  to  800j  a  scort  ol  200  isn't  ntctssarily  tquat  io 
z*ro«  nor  do«3  a  scort  of  800  mtan  that  you  answtrtd 
\  tvcry  question  corrtcily.  Tht  TSWE  scor*  fs  rtporttd 
\  on  a  scalt  of  20  to  60  ^  .  Tht  TSWE  fs  not  lnttndt<t  to 
^dlsKnQulsh  arnong  studtnts  whoSt  command  of  Erv 
-gllsh  is  btlttr  than  avtragt^  Thtrtfort.  students  who 
rtctivt  a  scortbf  60V  can  concludt  that  thtttstfsnol 
wfllcult  tnouQtTjo  mtasurt  tht  upptr  limits  of  thtir 
al^lHty, 

Th#rt  art  two  sttps  in  scoring- 

tdtttrminino  vtrt^ai,  mathtmaticai.  and  TSWE  raw 
shorts  (countrno  iht  numbtr  ol  right  rtsponsts  and 
subtracting  a  Iraclion  ol  iht  numbtr  wrong),  and 

2.  fli^ding  tht  Colltgt  Board  scaitd  scorts  lor  tht  cor 
rt|ponOino  raw  scorts 

Y<HJ  will  undtrstand  tht  scoring  proctss  bttttr  if  you 
try  ta.apply  it  lo  tht  sampit  ttst  you  just  took. 

1 

_J  

Otttf mining  Your  Raw  Scort 


i 

fot  th^t SA T  v9rb$l S9Cttons  snd tht  TSWE 

TM  tk  qutstions  in  sections  1  and  3  yrtid  tht  vtrbal 
scora  Chtck  your  answtrs  against  the  table  on  page 
45  Scan  tht  verbal  qgtstions  (sections  1  aruJ  3)  ar>d 
couni  th^  numbtr  of  right  answtrs  and  tht  numbtr  of 
wro(>9  answers  Count  ont  point  for  tach  corrtct  ft- 
9pO(lst  For  tach  wrong  responst,  subtract  ont-fourtt> 
ot  a  point  Thtrt  iS  no  nttd  to  count  Iht  qutstlons  you 
omtfttd  becaust  thty  {}o not  alftct  your  scores 

(Ra#  scort  a  number  right  minus  one  fourth  of 
j  the  numbtr  wrong   

Fdf  example,  if  you  have  46  right  responsts  to  the  vtr 
bat  qutstlons  iti  sections  1  ar^  3  ar^  31  wrong'9t 
si/onsts.  thtn  your  vtrbal  raw  score  is  46  minus  ont- 

fourth  of  31.  which  tquais  36  Or  46  -  -(31|  »  38^ 

/  *  * 

vthirh  rounds  d9wn  to  38  (tht  ntart&t  inttgtr) 

^*  You  caKlind  your  TSWE  scort  in  tht  samt  way  For 

^xanplt,  if  you  havo  39  right  rtsponses  to  tht  TSWE 

,qutvtlors''in  section  8  and  10  wrong  lesponsts,  thtn 

youi  TSWE  Mvv  score  iS  39  minus  ^nt-fourth  of  10, 

which  tQuiil$3r  Or  39  -  ^  <I0)  -  3«^^  which  rounds 
up  to 37 
44 


For  th9  SA  PmithtmiUctlstcVons 

Dtttrmlning  tht  mathtmatical  scort  Is  a  lltllt  mort 
complicated  btcaust  somt  of  tht  qutstlons  contain 
only  four  pottlbit  antwtr  cholct*  intttad  of  tht  usual 
llvt.  Count  Iht  20  four-cholct  qutstfon*  (numbtrs  8 
through  27  In  stctlon  5}  at  a  stparatt  tcof t.  Count  tht 
40  fivrchoict  mathematical  question*  <al)  ol  stctlon  2 
and  numbtrs  1  through  7.and  28  through  35  tn  stctlon 
5)  as  a  stcond  mathtmatlcat  scort.  Obtain  tht  raw 
scorts  as  follows: 

Raw  scort  for  20  four-cholct  qutstlons  «  numbtr  right 
minus  onrthird  of  tlit  numbtr  wrong 

Raw  scort  for  40  f ivrcholct  qutstlons  »  numbtr  right 
minus  ont  fourth  of  tht  numlMr  wrong 

Add  Iht  rtsult*  of  tht  two  scorts  to  obtain  ont  total 
mathtmMlcal  raw  scort.  For  txamplt.  suppost  you 
havt  10  right  and  10  wrong  for  tht20  fourcholct  quts^ 
tions,  thtn.  tht  raw  scort  fs  10  minus  ont*third  of  10. 

2  1  2 

which  tquals  8*.  Or  10  -  ^(10)  m  S-^.And  suppost 

you  havt  24  right  and  11  wrong  for  tht  40  flvt^cholct 
qutstlons;  thtn  tht  raw  scort  Is  24  minus  ont^fourth  ot 

11.  which  tquals  21^.  Or  24  .l(n)  ■  21^ 

2  1 

To  Obtain  tht  total  raw  scort,  add  8~to  21  jfor  a 

Mathtmatical  scort  of  28, (Round  any  scorts  with  frac* 
tions  to  whole  numbtrs  only  afttr  tht  (wo  parts  art 

summed)  <v 


Finding  Your  CoM«g«  Board  Scort  Rang* 


Use  the  table  on  page  48  io  find  the  range  of  Colltgt 
Board  scorts  for  tht  SAT*vtrbal.  SAT^mathtmatlcal. 
and  TSWE  raw  scorts  youobtalntd  on  tht  sampit  ttst. 
For  txamplt.  in  tht  column  htadtd  "Raw  Scort,"  find 
your  vtrbal  raw  scort  or  th^  scort  ntart.st  to  It.  In  tht 
column  htadtd  "SAT-vtrbal."  find  tht  rangt  of  Colltgt 
Board  scorts  for  It.  ttl's  say  your  vtrbal  raw  scow  Is 
38,  Tht  numbtr  clostst  to  It  Is  40.  Tht  column  htaudtd 
"SAT  vtrbal"  shows  that  tht  rangt  ol  Colltgt  Board 
scorts  for  a  raw  scort  of  40  Is  480-480.  Tht  rangt  for 
your  scort  of  38  would  bt  somtwhat  lowtr. 

Tht  tabtt  shows  a  rangt  of  scorts  btcaust  thtrt  art 
slight  variations  in  tht  difficulty  of  difftrtnt  vtrsions  of 
tht  ttst.  On  an  tasl6r  vtrsion  of  tht  ttst,  tht  raw  scort 
obtalntd  would  result  In  tht  Colltgt  Board  scort  that 
Is  at  Iht  lowtr  tnd  ol  tht  rangt.  For  a  mort  difficult  vtr< 
slon,  tht  raw  scort  woufd  rtsult  in  tht  Colltgt  Board 
scort  that  Is  at  Iht  hlgt^'tr  tnd  of  tht  rangt. 

Ltt's  lakt  anothtr  .txamplt.  Suppost  your  matht* 
maitcat  raw  scort  is  27  Tht  ntmbtr  clostst  to  it  in  tht 
column  htadtd  '  Raw  Scort'  is  25.  Tht  column  htadtd 
'SAT  mtthtmaticai"  shows  that  tht  rangt  of  Colltgt 
Board  scorts  for  o  raw  scort  oi  25  Is  470-493.  Th^  rangt 
for  your  scort  of  27  would  bt  somtwhat  hfghtr. 
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ANSWERS  TO  SAMPLE  TEST  QUESTIONS  AND  PERCENTAGE  OF  STUDENTS 
ANSWERING  EACH  QUESTION  CORRECTLY  ^ 
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B  90 
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A  71 
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C  M 
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0  M 
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A  24 
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A  73 
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B 
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0  57 
B 
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50 
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«2 
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47 
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• 

7 
0 

9 
10 

11 
.12 
13 
14 
15 

1« 

17 
18 
19 

20 

21 
22 
23 
24 

25 


B 
B 

E 
C 
C 

0 
E 
C 
B 
B 

B 

C 
A 

c 
c 

A 
E 
0 
B 
A 

0 
B 
A 

0 
0 


80% 

92 

U 
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9 
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B  19 
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84 
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B 
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0 
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Wh«n  you  taK«  th«  SAT.  your  scor*  it  to  dllf*r 
Irom  th*  9€or«,you  obtained  on  th«  sampi*  tMt.  PtopI* 
perform  at  dlff*rtnt  Iav«l9  at  d(tf«rtnt  tlm«»  (or  r^Mona 
unr*lat*d  to  th*  t«9t  ItMlfJn  addition.  th«pr»cl»lon  of 
any  ttat  is  limited  b«cau9«  it  f tprtsants  only  a  sampft 
Of  all  th«  pos«lbl«  quaations  that  coutd  b«  4$k*d. 

t 

MM  scones  CONVCftTEO  TO  SCALED  SCORES 


r»wc 

15 

too 

10 

750770 

75 

710-730 

70 

irOMO 

16 

I3OC50 

10 

590430 

800 

56<^5«) 

7407*0 

50 

530550 

©90720 

4S 

49O510 

540«ro 

40 

440-400 

eoo«3o 

52 

35 

420-440 

s«o5ao 

47  50  . 

00 

39O410 

$10530 

42  45 

» 

350370 

4704» 

37^ 

20 

43O450 

31-34 

IS 

2IO3I0 

30O-4OO 

26-29 

to 

250270 

^360 

21  24 

210240 

J9O320 

20  * 

0 

2002)0 

250280 

20 

in  addition  lo  corrtct  answers  to  th*  aampi*  t*9t.  th* 
iabi*  on  pag*  45  oiv*9  ptrctntag^a.  which  ar*  ba«*d 
on  th«  analysis  oHh*  answtr  sh**ts  for  a  random  »am 
pl«  ol  students  Who  took  this  t*st  In  April  1M1  and 
wttos*  mMn  scor»»  w*r*  430  on  th*  SAT-v*rbal  stc^ 
tlon$.470onth«  SAT  mathematical  sections,  and  43  on 
th*  TSW&  T^•  ptr'c*ntao*a  will  Q\vi  you  an  ld*a  of 
how  hard  MCh  qutstlon  was  for  studtrUs  with  at>out 
avarag*  verbal  of  mathtmatlcal  ability. 

For  axampla.  th^  ptrctntaga  for  question  6  In  varbal 
sactlon  t  Indicates  that  75  p«rc*nt  of  a  group  of  stu- 
dents scoring  430  would  probably  answar  this  itemcor- 


ractty.  Tha  quattlon,  tharafora.  Is  not  vary  hard  for 
tham.  Q(Aistion  10  wouid  ba  mucfi  hardar  for  such  • 
group. Only  32 p«rcant  gotquaatlon  lOrlght. 

Aftar  you  hava  acoiad  yoar  taat,  analyze  your  parfor* 
manca.  ^  * 

•  For  instance,  did  you^omlt  <7ue»tiona  because  you 
ran  out  of  time  before  you  reached  the  end  of  a  tec* 
tlon?  Reread  pag*a3  througti  il.  The  suggeatlona  In 
them  may  help  you  pace  youraelf  better. 

•  Old  you  take  so  long  readlrfg  directions  that  you 
didn't  have  enough  time  \o  anty^r  questions?  if  you 
become  thoroughly  familiar  with  the  teat  dIrecUona 
reprinted  In  this  booklet,  you  won't  have  to  spend 
much  time  reading  them  during  the  teat. 

•  Look  at  the  apeclfic  queatlona  you  missed.  Did  you 
get  caught  by  a  cholce.that  was  only' partly  correct? 
FIgure'out  what  step  you  overlooked  In  your  reason^ 
Ing, 


RECEIVING  YOUR  SCORE  REPORT 


About  six  weeka  after  you  ta\e  the  SAT  and  TSWE.you 
will  receive  a  report  that  Includes  your  scorea  and  per* 
centile  ranks.  The  percentile  ranks  show  how  yog/ 
scores  compare  with  the  scores  ol  ceitain  other  groups 
of  students  who  have  taken  the  SAT  and  TSWEpWith 
the  report^  you'll  receive  a  tx>oklet.  Your  Student 
porf.  which  will  help  you  Interpret  arxl  understand  th« 
scorea,  percentile  ranks,  and.other  Information  that  ap> 
pear  on  your  report.The  booklet  will  also  explain  how 
colleges  use  your  scorea.  Vour  counselor  will  have  ad- 
ditional Interpretive  material.  ^ 


We  hope  that  Ukln^  th^  SAT  has  proyfded  Infor- 
mation that  win'  Increase  your  confidence  when 
you  take  the  teat.  Your  sugcestlons  and  com- 
ments concerning  tne<"tntents  of  the  booklet  will 
be  welcome  Send  them  to  College'Board  ATP. 
Box  592,  Princeton.  N  J  06541. 
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AMaMag«to  Stutkntt 


Th«  qu»$llon  is  Irequtntty  tsktrf.  Whal  can  I  do  about  ralJjno  my  SAT  $cOf«$  or 
♦boul  maWng  ih«m  bailor  than  may  would  ba  olhofwis«?  If  answtr  1$:  Quickly 
and  fmmadiataly  probably  not  much:  ovar  longar  pojioda  It  dapands  upon  how 
much  tima.  tMort,  and  concaolrallon  goas  Into  prapuralion. 

Tha  Scholastic  Apllluda  Ta$l  maa$ura$  lha  axjanl  to  which  your  raasontng  abili- 
ty and  Skills  with  words  and  mathamatlcal  concapU  hava  baan  davalopad  up  to  lha 
tima  you  taka  tha  last.  Thasa  ara  abitltias  that  ara  ralaiad  to  acadamic  succass  In 
colloga  arwJ  (hat  grow  ovar  a  llfatlma  through  laarnlng  axparlancassuch  as  tho$a  In 
lha  family.  In  school,  with  your  Irlands  and  a»so<5jaias,  and  In  reading  and  Indapan- 
dent  study.  The  bast  praparatlon  fo<  tha  SAT  Is  lo  pava  had  varlad  opportunltlas  ol 
this  kind  and  lobava  mada  lha  mos{  ol  Iham. 

Tha  Skills  aM  abllltlts  tha  SAT  lasts  land  to 'grow  ralallvaly  slowly  and  at  dinar* 
am  /atas  lordiltarani  paopta.Whather  youhava  mora  or  lassrof  thasa  ablllilasdo^s 
not  sa/,any!hlng  about  your  worth  as  an  Individual  Many  oihar  Individual  qualllias 
not  maasurad  by  lha  SATrSuch  as  molivaUonrcra^atWIlyrand  artistic  skills,  hava 
>  much  10  do  with  your  sansa  of  salisfaciion  and  your  succass  In  Ufa. 

tf  you  or  your  parants  h^va  b«an  thinking  about  spaclal  praparatlon'for  tha  SAT 
ouislda  your  ra^ular  classroom  acllvllias.  thasa  six  points  ara  worth  ramambarlng 


1  The  SAT  maasures  davaioped  varbai  and  mathamat 
(cai  raasoning  attlMltas  that  ara  mvoivad  tn  succass 
fut  acadamic  work  tn  coil':ga,  M  is  riot  a  tast  ol  soma 
Inborn  and  unchanging  capacity. 

2.  Scoras  on  tha  SAT  ara  subjact  to  improvamant  as 
aducalionat  exparianca.  both  m  and  out  ol  school, 
causas  thasa  varbai  and  mathamatlcal  abilltias  lu 
davalop 

3  Davaiopmant  of  thasa  abthtias  is  ralaiad  lo  tha  lima 
and  alfort  spant.  short  tarm  drill  and  cramming  ara 
llkaiy  to  hava  liiila  aflact.  longar  iarm  praparatlon 
that  devaiops  skilts  and  abitllias  can  hava  graaiar 
atfact 

4.  Whila  drill  and  praciica  on  sampla  tast  quastions 
ganaralJy  rasult  in  Hllta  altact  on  last  scoras.  prap* 
aratlon  ol  this  kind  can  lamlliarlza  you  with  dlfjar* 
ant  quasllon  lypas  and  may  haip  to  reduca  anxiety 
about  what  to  axpact.  rou  can  halp  yoursoll  to  be- 
ooma  familiar  with  tha  tast  by  using  tha  axptana 
tlons  and  full  sampla  last  in  this  booklet 

5.  Whether  idnger  preparation,  apart  Irom  that  avail 
abia  to  you  within  your  regular  high  school  coursas. 


IS  worth  the  time,  ellort.  and  money  Is  a  daclslon 
you  and  your  parents  must  make  for  yourselves, 
results  seem  to  vary  considerably  from  prograrnio 
program-  and  tor  aach  person  within  any  one  pro- 
gram. Slpdies  ol  special  preparation  programs  jcar* 
riad  on  In  many  high  schools  sho^  various' raaulis 
averaging  about  10  points  for  the  verbal  aectlor^  and 
15  points;  for  the  mathematical  over  and  above  the 
^average  increases  that  would  otherwise  be  ax> 
jplicted  from  Intellectual  growth  and  practice.  In 
other  programs  results  have  ragged  from  virtually 
!no  tmpfOvemanl  In  scores  to  average  gains  as  high 
'as  25-30  points  for  particular  groups  of  students  or 
particular  programs.  Recent  studies  of  commarcial 
» coaching  have  shown  a  similar  range  of  resulli. 
j  You  Should  satisfy  yourself  that  the  results  of  a  spe- 
cial program  or  course  are  likely  to  make  a' differ- 
ence In  relation  to  your  collage  admisslorvs  plant 

Generally,  the  sound«it  preparation  for.the  SAT  Is 
to  study  widely  with  emphasis  oniacademic 
courses  and  extensive  outside  reading]  SAT  score 
Increases  of  20-30  point*  correspond  to  ibout  ttirar- 
addilional  questions  answerad  correctly.  Such  a  re- 
,  suit  might  be  obtained  by  Independent  »tudy  \ri  ad- 
dition to  regular  academic  cou  o  work  I 
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AsE.T.S.  sees  it 


Standardized  testing  has 
become  education's  latest  scapegoat 


■yScirviil  And«r»o<i 

WE  AMERICANS  have  i  lont 
hUiOfy  of  explainint  awiy  iny 
diiMiiifxtton  wtih  our  educAiion  lyi* 
ittn  by  blimiOf  lucctssively  vulncfibk 
p«ni««.  Firil  we  bUmed  ihe  flu(i<flii. 
ih<n  we  bUm«d  ihnr  pirenti  (indicimi 
Dr,  Spock  ilong  the  wiy),  ihen  we 
blimcd  ih<  ieich«ri,  ind  of  courtt  id 
mmiiirifori  irwiyi  ire  blamed  for 
cverythint  But  |h«  Itie  I970f  brought 
more  bad  nrwr  $(ud<ni  Kofci  on  the 
SirhoUiiic  Ap<iiud«  Test  (i.a.t  )  con* 
tinucd  10  dcciine;  nxdny  volunie<rf  in 
th<  irmcd  forces  were  libcted  incorepc' 
tefli  in  bavc  ikitli.  colleges  bnm  to  of 
fer  more  rein«di«t  courKS>  ih«  crime 
rate  went  up— ill  of  thii  in  ipiie  of  u^^ 
prrcedeoicd  tocieiii  iiteniion  ptid  to 
edocalion  IcgtilKion  andtnnov«i>on 

Ckirly.  the  nme  wii  right  to  nomi 
nate  a  new  villain  for  the  "what'i" 
wrong  wiih-our-Khooli?'  drama.  No 
group  wai  more  eager  to  terve  ai  the 
calling  agent  (han  thot«  who  most  re 
cenily  had  been  feitured  play 
en— ieach«ri>  or  more  ipctiftcatiy.  oik 
of  th«  two  ma)or  teach<r  unioni.  Wilh 
out  so  much  ai  an  audition,  the  Na 
tional  Education  Aiiocutton  (n  i  a.j 
quKkiy  ptckcd  sttndardntd  munt  ai 
th<  vittain  The  chOKe  wai  praised  by 
(h<  Naiioul  Aliooaiton  for  Ihr  Ad 
vancement  of  Colored  People.  Ralph 
Nader.  s«vna1  state  (egistalori,  and  two 
sociat  Ktentisii  al  the  Harvard  Medical 
S<hool 

Thetr  arguments  against  lesttng  were 
paiierncd  after  the  logic  of  Lewis  Car 


0//V  £(tvt9t*0^t  TtiUng  Stf^Kt 


roll,  auihoe  of  Atict's  Advtnturti  in 
Wondtrhnd'  If  minorities  Kored  lowee 
on  tests.  If  test  scores  were  gotng  down. 
it  students'  KOfes  on  tests  could  be  im> 
proved,  then  the  trouble  lay  with  the 
tnts,  nox  with  the  Khools.  "If  only  the 
tests  were  cleared  away."  they  said,  "n 
would  be  grand." 

But  tests,  of  course,  have  not  been 
'cleared  away"— nor  are  ihcy  bkely  to 
be.  Educators  wCHitd  be  wise  lo  recog 
niie  this  fact  and  to  redirect  thetr  ener- 
gies from  damning  tests  to  learning  as 
much  as  they  can  about  them  (sec  ac 
companying  article  on  page  2g)  Only 
Ihen  can  progress  be  made  rowird  tm 
proving  test  scores— >aftd  (ktermining 
the  proper  role  of  testing  tn  education.^ 

Consider  for  a  moment  the  factors 
thai  contr)bute  to  a  student's  perfor 
nunce  oa  any  kind  of  test,  wtNthCT  it  is 
teacher-made  oe  staitdardized.  If  the 
lest  IS  a  good  one— that  is,  both  v§Ud 
(measures  what  it's  supposed  to 
measure)  and  relimNe  (yKlds  consistent 
results)— then  students'  scores  aredeter 
mined  first  and  foremost  by  knowledge 
and  skill  Does  know  ihr  answers  to 
the  questions  on  the  test?  Can  they  do 
the  tasks  that  are  required?  We  must 
remember  this  at  aJI  tires  T^eie  is  no 
magtc  that  will  enable  students  to  sue 
ieed  on  a  good  test  if  they  don't  know 
the  subjeet  matter  or  po'^.sess  the  skills 
that  the  test  measures  (short  of  cheat 
ing.  that  IS) 

Let  me  lell  you  a  story  about  the  di 
rector  of  research  in  a  large  public 
school  system.  He  was  dismayed  be 
cause  student  scores  on  a  utionat 
standardised  reading  lesi  had  dropped 
from  the  year  before,  and  he  refused  to 
release  the  scoees— to  the  supertnlen^ 


dent,  to  the  press,  to  anybody.  JFirst  he 
asked  the  school  system's  Computer 
center  to  rescore  the  tests,  there  musth< 
an  error,  he  thoughts  There  wasn't 
Then  be  asked  the  computer  people  to 
check  all  the  statistical  compulations. 
Still  no  error.  After  several  weeks  and 
clamors  on  alt  sides  to  see  the  scores,  the 
head  of  the  computee  center  met  the  re< 
search  directoein  the  perking  lot  'Hey, 
buddy."  latd  the  computer  specialist. 
"1  think  I've  figured  out  how  to  get 
those  test  scores  up." 

"How?  How?"  asked  the  relieved  re 
search  director. 

"Teach  those  kids  how  to  read." 

Given  that  test  performance  is  deter 
mined  largely  by  what  students  know 
and  can  do,  here  are  some  other  pos 
sible,  if  lesser,  influences  on  test  Kores 

J.  Teal  dir*ctS«M.  tf  the  directions 
say  to  select  the  lemij  probable  ex  plan  a 
tion  for  an  event  and  a  student  selects 
the  most  probable  explanation,  then  he 
or  she  has  mused  the  question,  if  one  of 
the  choices  for  a  set  of  mathematics 
questions  ts,  "The  answer  cannot  be  de 
lermined  ffom  (he  information  given.' 
and  tf  the  student  ignores  that  choice, 
the  student's  score  might  suffer.  If  stu 
dents  are  told  to  answer  four  out  of  five 
essay  questions,  and  they  answer  all 
five,  then  Ihey  have  waited  time  that 
could  have  been  devoted  to  more  com 
ptete  answers  to  four  questions 

2.  Test  p»€int.  When  there  >s  limited 
lime  10  take  a  test,  students  should  p<ce 
Iheir  work  so  they  have  sufficient  time 
lo  gel  through  questions  Ihey  know. 
Ihey  shouldn't  let  hung  up  on  questions 
they're  unsure  of  They  should  save  the 
difficult  questions  to  ponder  at  the  end 
of  the  test 
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)  NMtMM.  A  bfUti«nt  cmy  c«n  be 
dolW  ky  I  sloppy  ot  uk»ibk  p«p<f ,  w 

ACAtfKM  couiiu.  So  doct  KtentKM)  {0 
Uil.  Miichint  question  numbers  <o 
spAccs  oa  the  Antwcr  thcet  ind  com* 
p4<tely  erasing  answers  when  students 
ehange  (heir  minds  can  be  of  mijor  tflfi* 
ponance  on  a  machine  Koced  lest 

4,  PHyM  (MMN4i«M.  There  is.  of 
CDurK.  a  rather  broad  ringe  of  loler* 
ance  before  performance  will  be  ad 
vers«ty  affected  by  pkyxKtl  condition  it 
the  test  site.  Xelattvety  poor  ttihiinf.  or 
a  testing  room  that  is  a  Iiitk  roo  warm. 
mi|M  make  the  test  liker  uncomfon* 
able,  but  neither  is  hkdy  (o  jeopardite 
test  performance  if  the  student  is  cap- 
able of  doing  the  uiksonthe  test 

).  gaiada— I  •r  pkytkal  UtHk.  A 
slight  cold  probably  would  have  httle  in* 
ftuence  on  a  student's  test  performance, 
but  a  bad  caK  of  the  flu  with  accom* 
panjring  ftver  Kriously  >»ould  reduce 
the  student's  ability  to  perform  test 
talks,  (One  of-iny  prof«W$  described 
stttdK*  he  dJd  dwlng  WorSflfrar  II  that 
showed  aptitude  (est  KOrcs  were  af* 
fe<ied  only  ilighily  when  recrtJits  took 
tests  ri'ghl  after  an  all  night  march  )• 

More  troublesome  are  emotiona)  dis- 
turbatKeSt  the  nio«t  relevant  of  which  ts 
catled  "test  aniiety  "  We  know  that 
tonv  people  gel  more  amtoui  about  a 
lest  than  others;  we  alio  know  that 
aMiety  vanes  with  ho«  well  prepared 
students  think  they  are  and  with  what 
they  think  it  riding  on  the  ouieome.  For 
example,  we  would  eipcci  students  to  be 
more  antioui  about  a  lest  that  was  to  be 
used  in  determining  their  eligibility  for  a 
sigmricant  award  thaa  on  a  rcsr  that  was 
only  one  of  several  m  a  Khcol  course* 
We  shouldn't  forget,  however,  that 
there  ^ff  ■  few  among  us  who  actually 
tike  taking  tests  and  are  inclined  to  gi*e 
our  all  in  a  testing  situation  regardleu 
of  the  purposes  of  the  lest. 

The  measurement  and  stwly  of  k*i 
aniiety  are  complei  and  >*f>t  chal- 
lenged a  Dumber  of  pt^thologtsts 
through  the  years.  In  spite  of  aU  the 
work,  we  still  cannot  predKt  the  number 
of  people  In  a  given  population  who  will 
have  paralysng  test  injoety;  the  numba 
probably  is  small.  On  the  other  hand, 
we  know  that  a  little  anxiety  probably  is 
f»aUt§tlng  rather  than  debilitating. 
(Think  about  your  own  performance 
when  you  know  you  are  being  Judged  by 
important  audiences)  Even  though  1 
don't  bdicve  test  anxiety  is  a  terioui 
determinant  of  performance  for  many 
people,  I  would  oo<  dismiss  its  value  »* 
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an  ego-savini  devKe  for  thvuunds  of 
students  ind  their  parents.  If  the  terra 
"tesi  anxiety*'  d>d  not  exist,  we  prob- 
ably would  have  to  invent  it  to  preserve 
the  self<oocepu  of  those  who  otherwise 
would  b*»e  to  blame  their  own  igno- 
rance or  lannew  for  poor  test  per- 
formance 

Now  that  we've  examined  some  of  the 
major  influences  on  test  seores.  we  must 
consider  what  we  as  educators  and 
teachers  c<n  do  to  reduce  the  negative 
innuences- 

•  We  certainly  can  design  testing  ton 
ditions  in  whKh  directions  ire  as  clear 


No  magic  formula 
will  enable  kids 
to  succeed  on 
a  good  test 
if  they  don't 
know  the  subject 
matter  or  possess 

the  skills  that 
the  test  measures 


as  possible,  test  administrators  >re 
friendly  and  helpful,  the  physical  en- 
vironment is  comfortable,  and  students 
who  are  >U  are  offered  make  up  exam 

•  We  ako  can  teach  studenu  test-tak- 
ing skilti— paang,  handling  machine- 
scored  answer  sheets,  understanding 
different  type*  of  questions,  and  so  on 
Familiarity  with  objective  tests  is  not  the 
problem  it  once  was.  In  the  tuu  Icuing 
UMdy  I  cm  did  (m  mi,  at  George  f  ca- 
body  College  for  Teachers),  we  found 
that  many  of  the  freshmen  had  no  previ- 
ous experience  with  objective  tesu  and 
machine-scored  answer  sheets.  So.  we 
inifituied  practice  tests  to  try  to  even 

,o«t  any  differences  associated  with  the 
mechanics  of  test  taking.  Today,  almost 
all  children  are  exposed  to  a  variety  of 
standardized  tests  as  they  go  through 
sehool 

•  If  we  can  identify  the  most  ex 
tremely  anxious  students,  we  might  be 
able  to  recommend  personal  therapy  for 

them. 

What  can  we  do.  though,  about  the 
biggest   factor  that  affects  student 


scores  knowledge  and  skills?  The  best 
answer  to  that  is  to  teach  reading,  writ- 
ing, and  whatever  skills  tests  demand 
Unfortunately,  if  the  knowledge  or 
skills  are  significant,  this  takes  a  rather 
long  time.  Everyone  wants  to  know  if 
there  are  any  shortcuts. 

Enter  coaching,  one  of  the  most  con- 
fusing elements  of  the  debate  on  stand- 
ardized testing  The  HI  A  and  others 
say  that  tests  are  no  good  if  they  are 
coaehable.  But  this  denies  the  link  be- 
tween education  and  the  testing  process 
I  think  there  is  little  place  in  education 
for  tats  on  which  performance  cannot 
be  influenced  by  instruction.  But  to  dis. 
cuss  coaching  inteUtgently.  we  first  need 
to  consider  the  nature  of  the  coaching, 
the  length  of  the  coaching,  and  the  kind 
of  test  that  is  being  coached  for. 

Coaching  usually  can  be  distinguished 
from  regular  instruction  by  its  duration, 
its  purposes,  and  its  techniques- 

•  Ituinaion  generally  is  during  a 
long  term  period;  totcht/if  generally  in- 
volves a  few  hours,  days,  or  weeks 

•  The  purpose  of  instruction  is  to  de-^ 
>eIop  skills,  knowledge,  and  under- 
standing to  an  appropriate  level  of 
maiteiy— for  their  own  sake  If  students 
do  better  on  tests  as  a  result,  fine  The 
purpose  of  (otchi/if.  however,  is  to  im- 
prove performance  on  a  specific  examt 
nation.  If  students  improve  their  skills, 
knowledge,  and  understanding  >s  a.re- 
sult.  fine. 

•  A  good  instructional  program  gen- 
erally includes  alternative  explanations 
of  phenomena  and  solutions  to  proi^ 
lems.  allows  for  practice  with  varia* 
tions,  and  provides  a  eertain  amount  of 
enriching  detail-all  of  which  will  help 
)he  student  to  understand  as  well  as  to 
know  Coaching,  on  the  other  hand, 
concentrates  only  on  the  ktndi  of  ques 
tions  that  are  likely  to  be  asked  on  the 
test,  or,  quick  solutions  to  typical  prob 
lems,  and  on  associations  of  test 
language  with  certain  types  of  re- 
sponses. Drill  IS  a  signincant  part  of 
most  coaching. 

I  was  coached  in  the  evenings  for 
three  weeks  for  my  Ph  D  examination 
in  German,  BecauK  the  examination 
orOy  required  me  to  translate  passaies. 
and  becauK  we  were  allowed  the  uk  of 
a  dietioniry.  I  did  not  spend  much  time 
learning  long  lists  of  vocabulary  words 
f  {/^memorize  the  articles  and  common 
ptepositions.  conjunctions,  adjectives, 
and  adverbs  so  I  wouldn't  have  to  spend 
time  looking  them  up  My  tutor  taught 
me  how  |o  look  at  a  German  Kntence, 
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(jukkly  p4Ck  out  the  tubj«ci  and  predi 
Cite.  ajMj  determine  which  wofdt  went 
wtih  Mch.  And  bccauK  we  knew  the 
ex«M  would  be  in  my  neldfpiychoi^y). 
wc  pTMiieed  on  ibttractt  of  artictes 
from  German  p«ychol9|Kal  journals, 
not  Oft  iravel  booki  or  short  ttortes.  If 
my  okjeci  hid  been  to  learn  to  read 
scieniirk  German  flueniiy  lo  I  could 
keep  up  with  current  literature,  my  lutor 
okviotn^'would  hivC  taken  a  very  dif 
fefent  approach,  tnd  if  I  really  had 
wanted  to  iuin  German,  even  more 
rime  would  have  been  required 

f  patted  the  exam  handily,  but  today  I 
know  pfaciKally  rjo  German.  UnfOf- 


Thc  amount  of 
time  students 
spend  being 
coached  seenis 

to  make  a 
difference  in 
test  performance, 

but  only  up 
to  a  certain  point 


iunately.  rctenlion  of  facit  learned  dur 
(ng  coachini  frequently  It  poor  Coach 
inl  teemt  to  work  belt  when  it  tt  of  the 
"refrether"  variety  If  a  uudent  hai 
been  out  of  school  for  a  few  yean  or 
hain't  tludted  a  certain  lub^ect  recently, 
coaching  can  clear  away  tome  of  the 
eobwebt  from  tkillt  the  tiudent  o»ct 
had 

The  amount  of  nme  tludentt  tpeivi 
bcinl  coached  teemt  to  make  a  differ 
^MKCJD.  lesL  pa/oimaAce,.bu:  oniy  up  ta 
a  point  Studies  of  the  I  a  t  ihow  a 
potitive  relationthip  between  the 
amount  of  time  tpent  tn  coaching  and 
Kore  lAcreatet  The  law  of  dimtnithtng 
reiurnt.  however,  soon  beiins  lo  op«r 
ate.  For  example,  an  inaeaM  of  10 
point!  on  the  t  A  T 't  200  to  SOO-pomt 
verbal  Kale  might  be  atiocuted  with  12 
hourt  of  coaching,  to  iAcreaie  scores  by 
JO  points,  however,  might  require  57 
hourf.  )0  potnis  might  require  260 
hourt  ExUapoUttnf  beyond  exitting 
data,  tt  appcart  that  foe  a  40- point  gain 
OA  the  verbal  portion  of  the  s.a.t  . 
something  close  to  1,200  hourt  of 
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4.oa«hini  fime  «.  (^Id  be  required.  That** 
full'timeKhoo.ini. 

Another  problem  The  broader  and 
more  general  a  test  it.  the  mote  diffKUlt 
It  the  tatk  of  preparing  for  it.  That's 
makes  i.oai.hing  for  tptttudt  tests 
lo  diffKUlt  it  would  be  impossible  m  a 
couple  of  weeks  lo  teaih  all  the  words 
that  might  be  ituluded  on  the  vocabu^ 
)ary  section  of  ihe  i.a.t.  lut  if  the  test 
were  on  American  literatuie.  you  cer- 
tainly could  hit  some  of  the  high  spots  m 
two  weeks  And  if  the  test  were  even 
more  sharply  focused  (testint  knowl- 
edge of  the  symbols  for  chemical  ele 
ments,  perhaps),  students  probably 
could  learn  everything  they  needed  to 
know  in  leu  than  iwo  weeks. 

Here's  how  I  would  summarize  my 
position  on  coaching:: 

•  Those  who  would  condemn  lests  be- 
cause  they  are  coachable  ignore  a  funda> 
mental  relationship  between  lesiing  and 
teaching. 

•  The  success  of  coaching  depends  on 
many  factors,  including  student  motiva> 
tion.  the  nature  and  duration  of  coach- 
ing»  and  the  type  of  test  In  general, 
aptilude  tests  are  harder  to  coach  for 
ihan  are  achievement  tests 

•  Whether  coaching  sctuaiiy  im* 
proves  rest  scores,  many  students  tx- 
lifve  coaching  is  helpful  (often,  they 
say  becauie  It  redut.es  aniiety).  There 
fore,  schools  vsould  be  welt  advised  to 
provide  interested  students  with  appro 
priale  opportunities  to  prepare  for 
lesis—espeoally  tn  lest  laking  skills. 
Just  two  u  three  sessions  should  do. 
Ihis  will  help  avoid  charges  of  inequity 
between  students  who  can  afford  eiipen 
sivc  commercial  coaching  courses  and 
those  who  can't 

Tests  are  the  (itesr  scapegoat  for 
failures  atiributed  lo  education,  but  the 
label  IS  not  likely  to  suck.  As  American 
Federation  of  Teachers  President  Albert 
Shankef  pui  it.  "You  can't  blame  the 
thefmoAKter^for  the  patient's  fever/' 
Considering  the  growing  publK  and 
legislative  demand  for  educarional  ac 
counlabihly  and  productivity,  tests , 
probably  will  occupy  a  more,  rather 
than  a  less,  important  pUct  in  the  edu 
caiNM  scene  ''<rr.  Nuently.  it  behooves 
educaio'.  10  learn  as  much  about  niea^ 
suxemeiu  as  they  an  tn  order  to  monitor 
testing  practices,  to  resisi  »flapproprlate  , 
usA  of  tests  tn  the  school  systems,  to 
counter  the  misuse  of  test  results  m  un 
warranted  attacks  on  education,  and. 
most  important.  lO  harness  important 
resting  tools  for  their  Own  decision- 
making  needs^  O 


Take  this 

Tests  are  an  easy  mark  for  education  s 
critics,  partly  because  tests  are  not  well 
understood^by  educators  or  the  publK 
Here  s  a  crash  course  on  the  various 
types  of  lests  and  what  they  are  designed 
to  accomplish.  You  can  increase  your 
understanding  of  almost  all  types  of 
education  lests  by  detetmining  (l> 
whether  they  measure  aptitude  or 
achievement,  (2)  what  kind  of  response 
the  student  makes.  (3)  how  the  results 
are  interpreted,  and  (4)  who  makes  them 
up 

i  Apttlvdt  tens  versus  mchievemeni 
tens  There  is  a  difference  between  apti' 
tudc  and  achievement  tests,  but  it  is  not 
always  immediately  apparent.  Perform* 
ance  on  both  types  of  tests  depends  on 
what  students  have  learned,  not  just 
what  they  came  into  this  world  with.  (A 
wolf  Child  would  not  do  well  on  either 
kind  of  test.)  For  example.  Sample  1 
contains  two  questions*  Question  A  is 
from  A  well  known  measure  of  scholas 
tic  aptitude.  Question  B  is  from  a  basic 
skills  achievement  lest.  In  general,  so- 
called  aptitude  tests  measure  skills  that 
have  developed  Over  a  long  period  of 
time;  they  also  measure  applications  of 
skills  in  new  situations.  It  would  be  un^ 
usual  to  look  ai  an  aptitude  test  ques 
tion  and  be  able  ro  say  precisely,  "I 
learned  that  on  Tuesday  or  '.Mrs 
Parker  laught  me  that  "  Aptitude  tests 
are  valued  primarily  for  (heir  prtdKUnt 
value^  We  say  that  scores  on  aptitude 
tests  provide  some  irvlication  of  how 
well  people  will  do  m  college,  at  the  po 
Ikc  academy,  or  m  advanced  math.  Be^ 
cauw  the  skills  measured  on  aptilude 
tests  develop  Over  a  long  period  of  time 
and  from  a  variety  of  influences,  it  is 
not  fair  to  blame  the  schools  tnttrtly  if 
the  students  Kore  poorly  on  aptitude 
tests.  Unfortunately,  schools  ^er* 
^Wamedtn-manyquarterr-whem  a  t 
score  declines  became  big  news  (Of 
course,  kWis  shoulder  part  of  the 
blame  if,  after  11  or  12  years  of  educa« 
tion.  students  cannot  handle  words  and 
number  concepts  as  well  as  studentsof  a 
few  years  before.) 

Achievement  tests,  on  the  other  hand, 
geneially-are  more  easily  undetstood 
and  appreciated  by  the  public  than  are 
aptitude  tests  That's  because  the  ques- 
tions on  achievement  tests  can  be  related 
more  readily  to  school  curriculum^ 
Scores  on  science,  history,  titeraiure, 
and  mathematics  tests  should  be  mflu- 
enced  by  the  quality  and  recency  of  rele* 
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crash  course  on  test  design 


vjftt  in\tiUktion  a*  at  by  the  «u 
Jeni't  in^Imadon  10  icjrn  U  a  fair  to 
blame  ihe  uhool  and  ihc  twchcti.-  i\ 
«eii  a^the  ^tudenti— tf  »u<ifnx\  Jo  ^aJ 
Iv  on  a  leu  ihait  kOver*  maicfial  the;  (Uit 
have  completed  or  on  a  te^i  thjt 
meature^  skilU  ihey  hj^e  been  tju|ht 
fof  tcverjt  yejrt 

To  Oveaimplify.  ihc  lorofmaiion 
ttosn  jptiiuJe  te»H  n  'looking  ab«jd 
infoimJtiOn  Do  ttudentv  hJve  the 
kno*led|e  oi  tkilh  nf«»*ary  lo  h<{p 
them  »Uh(eed  in  Ihe  future*  The  m 
fofmjtion  from  achievement  test*  i» 
"lockmi  bjck"  informjlion  Did  the 
jtudenit  learn  >»hji  *j»  iaj|hi*  Of 
couiK.jf  iiudenltiie  not  lejirtin<  *hjt 
the  v^hooh  <lte  lejching.  Jnd  vvhooh 
find  Ihu  out  in  a  rejtonjble  time,  they 
van  m'.tilute  procedures  lo  .emed/ the 
titujcion  Consequently,  one  heart  fe* 
er  ^hjr|e»  of  loi  b'n  leveled  a|jm»t 
jvh.evement  te»t»  ihjin  a<4m»t  aptitude 

2  fypr  of  MutSrnt  rtipontt  Re 
tpontei  bj$i<Jlly  jie  of  (»o  kind»  The 
tludenl  mu»t  ffcotrurt  the  appropniJe 
jniwei  10  4  4ueutt>n  problem,  or  the 
iludent  mull  prudu^e  the  Jn»*er 
Re^oinition  quesitont  '>n  mMt  profei 
iionatly  produced  letiv  are  muliiple 
^.hoKe  item*  Teacher*  fiequenily  u*< 
tiue^falte  or  mjtchmi  items  at  well  In 
ipite  of  popular  0p.ni0n.  muldple- 
<hoice  queilioni  ctn  provide  >n  effec 
Hvc  mejjure  of  rejtonini  proce^iei  a» 
Meil  i»  ttrjiiht  memory  Look  ai 
Sample  2.  Question  C  The  question 
does  no4  simply  Jtk.  "What  jf ejs  of  ihe 
v>orld  hJve  ihe  highest  population  den- 
sities*" Rather,  it  presents  a  novel  tituk 
tion  in  whKh  Ihe  studeni  must  infer 
injt.  of  the  choKes  offered,  o^h  pop^- 
httOn  tfrntity  ((^hOiCe  A)  »s  ptau>ibl( 

The  most  frequently  us<d  prodiKtiOn 
letts  are  short  answcf  oi  "fnU  m 
Ihe  blank"  tests  jnd  "»ay  quey.ons 
An  example  of  a  short-ans^er  test  i«em 
"The  sum  of  J<ores  duided  ky  the 
flumb<r    of   wores   is   called  the 

 ^  ^  _^     "    The  student 

fcOuld  write  in  "mean.**  "jrithmeiic 
mean,"  or  "averJie  "  Yoo  probably 
jie  lamiliJir  *»«h  essjy  questions  from 
yO«r  own  Khool  diys  for  example 

'^^hat  »s  meant  by  the  statement  that 
fran^e  before  1719.  *  as  »,entrahftd  but 
net  on.fitd*  '  Or  "Why  did  the  Drey 
fus  affajr  b«ome  an  issue  Of  interna 
iiOnal  siiniruance*"  Or,  more  typical 
|v  "'Deshfibe  your  summer  vacation  " 


Of  course,  the  belter  vOnsiructcd  the 
questions  and  Ihe  clearer  the  directions 
to  students,  the  easier  essa>  tests  are  lo 
KOre  But  even  ihen.  Korini  ts  not 
simple  To  avOid  biased  and  idiosyn 
craiK  sconn|.  scorers  need  to  have  in 
advancf  a  clear  outline  oi  just  what 
components  will  be  scored  and. ho* 
much>*e>|M  *inbe|iifentoeich  Will 
essays,  for  example,  be  Kocrd  for  style 
and  »ie«banitfs  as  well  as  substance'  A 
successful  scorini  technique  used  by 
professional  rest  makers  (but  rarely  by 
teachers)  is  called  'holistic  scoring." 
Raters  agree  onthcvharacreristics  that  a 
top  paper  will  have  and  choose  samples 


that  epitomize  that  standard;  they  do 
the  same  for  papers  at  each  of  the  to»er 
ranks  Scores  then  are  assigned  to  all 
papers  by  comparing  them  to  the 
samples 

Production  tests  do  have  their  prob 
Ums  They  cin  be  tough  to  score;  fe*er 
such  questions  usually  can  be  presented 
In  a  given  period  of  time,  so  less 
coTTjptehtflsive  coverage  of  an  area  is 
possible.  So  *hy  do  testers  use  such 
questions  at  all'  Because  production 
tests  measure  Characteristics  that  rccog^ 
nition  tests  canriOt  If  you  want  to  find 
out  how  well  students  write,  there's  no 
substitute  for  asking  them  to  write  To 


Samples  of  major 
types  of  test  questions 

QtetrVoa  A.iTtom  »•  *ptU94<  test) 

In  the  currency  of  the  country  of  U|,  I J  dopi  ire  equal  to  I  tif  If  lOdop*  tqm 
I  decadop.  what  is  Ihe  value  In  tifi  of  6  decadopi? 

(A)  I/IJ  *B)  2/J  (C)  J/2  (D)  )  (E>  4 

Qw«llo«  S.fFroa  aa  MkkvrflKVt  kat) 

[fyour  local  taks  taJi  is      what  ts  the  toitl  coit  of  a  $2  70lufKh7 

tA)S2  73  tB)J2.7t  iQIJOO  (D)$J.J| 


QmmIm  C. 

*    The  shading  on  the  above  map  is  used  to  utdicaie 

(A)  population  density 

(B)  percentage  of  total  labor  forctmagncuJture 
(O  per  capita  Income 

(D)  death  rate  per  thousar>d  of  popuUuon 
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lh«  Mme  ihinf  Xo»  ihmk  uf  many 
o<h<r  e«4mpl»  aanilaiinf  a  patwie 
frum  CjiCro.  >peaking  e«iempofaricouk 
iy  on  a  popuiai  lopi^.  analysing  a  blooU 
Mmple.  editing  a  ir^hniv^i  manu»(,upl. 
makint  a  touffle.  diMHcmMing  a  ufie 

This  diiunvtivn  bci«eeii  ir«i>gnaiv)n 
jnd  production  tetit  it  an  tmpouani 
one  A  tiudenl  MhomigM  c^ggnt/eap 
propfiaie  laboratory  procrdurn  from 
word  and  picture  deKiipiion>.  for 
evampie.  might  Melt  »d4  «»aiei  to  ^ul 
phuijt,  a(,id.  >n»tead of  fue  »ei>^>  *hen 
left  jhxvc  mihe  fab 

)  Tesi  tftitrpretauon  festi  «an  <k 
interpreted  in  i«o  wayi  by  leferetKe  to 
the  performame  cfothei  people  (norm 
^efereiHed)  and  by  iereren(,e  lo  itt^t 
menul  »tjndasdk  Unieimn  lefnentedi 
in  a  noim  refer en^rd  le^^  foi  e« ample, 
*e  would  vay  ihat  Bettr  »  Kute  ii  nn  the 
top  quarter  of  jtoret  of  itudentt  m  her 
graduating  ilait.  or  above  the  mean  for 
<£  national  group  of  i*elflh  grad<r>.  or 
It  ih<  £Oth  perien'ile  for  >eniort  m  the 
state  (meaning  ihai  60  percent  of  the 
itaie  %  leniort  Kored  iontt  ihan  she 
Jidi  This  example  alt^»  >ndii.aio  that, 
wtth  lejpevt  lo  ihe  tkillt  meatured, 
Beiiy  had  'nvre  vompetiiiun  m  ihe  wate 
than  >n  het  o*ft  *lai»  (note  irui  ihe 
itood  tiighet  tn  Aei  than  »he  Jid  in 
theitaiea}a«hole) 

Criterion  refererKed  lettt  are  iiitei 
pteied  jCiO'ding  to  )udgir,enit  about 
i*hal  cvnitiiuiet  ^ppiopttaie  pcifurm 
jRve  hiibly  uiisfaiioty.  adequate,  or 
minimal  depending  on  ihe  leti  and  ibe 
purpose  for  which  >l  was  given  for 
e<amp*e.  a  group  cf  teachers  might 
agree  that  a  uorc  of  60  *a»  a  patsmt 
Kore  on  Te)t  X  or  iihai  ten  lorrcct 
answers  oot  of  '2  nems  on  a  math  Quu 
jindKatcd  atiepiable  maiiet>  of  a  ion 
«ePi  An  important  thing  iu  keep  in 
mind  IS  that  thete  are  no  unj%etul 
criteria  for  such  tetts  Sitty  percent 
might  be  a  passing  Kore  for  one  teii  but 
not  passing  on  an  easier  leil,  ten  lorrcct 
answers  out  of  12  items  might  be  io/i 
sKkred  mastery  fol  one  (.orxept  but  not 
for  another 

It  js  unfortunate  that  iritenon^tefei 
enced  and  norm  referenced  measute 
mem  often  are  virwed  in  sharp  i.oniraii. 
sometime)  with  the  attitude  that  Mn% 
one  is  food  practice  and  ihe  other 
b«d  practKe  In  fact,  the  two  ap' 
prixachrt  fie^ucntly  overlap  attd  ^ci 
lamly  are  uteful  lupplemenik  to  each 
olhet  Moreover,  normative  lonsidera 
tions  usually  underlie  the  choice  of 
standards  fo<  ifiierion /efcremcd  jejU 


tatthough  ihete  lonnderaitonk  might  be 
implicit  fjihet  than  evpticit)  For 
example,  we  may  lei  50  woidi  per 
minuie  with  twu  errors  a^  ihe  minimum 
standard  for  graduation  from  a  three- 
month  typing  lourse  We  don  t  }ei  ten 
wordi  pet  minute  or  ISO  words  per 
minute  be->au>e  ihex  latct  do  not  reflect 
i/p/i.0i  typing  lequirementk  ot  tweragc 
human  capability  —both  normative 
notions 

Whether  le^t  user*  rely  more  heavily 
on  ftoim^referenced  oi  on  criterion>re 
feren^ed  interpretations  of  test  pci  form 
ance^  ihey  stilt  must  rely  to  a  great  e< 
lent  on  judgment  in  setting  »tandards  or 
cutoff  kcores  In  a  Khool  system  expe 
lierKing  ^^cher  surplus,  for  example, 
the  accirditing  agency  might  qualify 
oiily  (hox  teAchei  apphcams  who  >coie 
above  the  2jth  j^ii-entile  on  a  lest  in 
times  of  a  teAchef  shortage  the  school 
system  might  lowet  the  standard 

A  mysterious  phenomenon  »  ihat 
many  teat.hers  and  parents  take  the  30lh 
peuentile.  or  the  mean,  as  the  implicit 
standard  of  adequate  performance 
They  will  bewail  the  fact  that  iittle 
Mana  oi  Fred  is  below  average  without 
stopping  to  think  that  half  the  children, 
by  derinition.  fiMve  to  be.  fn  fact,  it  is  a 
mikt;«ke  to  think  of  average  '  asrepre 
senting  a  single  Kote.  it  is  better  to 
ihinkof  average  as  a  range  of  scores 
encompassing  the  middle  thitd  of  the 
group 

Theie  are  many  different  procedures 
Ihat  educators  use  to  set  standards  ot 
cutoff  score^  These  vary  m  formality 
and  elaborateness  The  burden  is  on 
educators,  howevett  lo  make  ihe  stand 
ards  they  adopt  explicit  and  to  provide  a 
cleat  rationale  for  ihem  Thts  ts  of  para 
mount  importance  if  cutoff  scores  ate  to 
be  used  for  such  cruCia)  decisions  as 
gradual K}n,  promotion,  or  admission  to 
a  pioframof  study 

4  rrtr  de*etopfrs.  By  far  the  largest 
numbet  of  tests  are  those  developed  by 
individual  teacherk  TTie  critics  of  test 
ing  uiuA^ly  ovniook  this  fact^  For  every 
s.A.r  ,  triere  are  thousands  of  mtdietm 
and  final  exams  in  mathemalict  and  En 
glish.  for  evety  standardized  elementary 
reading  test,  thousands  of  dittoed  read 
ing  exercises  are  uied  in  ctastrooms 
Clasirotjm  tests  ^and  other  evaluations) 
are.  and  wtM  continue  to  be.  the  major 
factors  in  promotion,  graduation, 
le^ommendations  foi  furthei  education 
and  employment,  and  sludentk  self  ap 
pratsalsof  then  academK  fitness 

The  twc  major  types  of  outside 
groups  that  develop  and  supply  tests  are 


slate  departments  of  education  and  na> 
tionai  testing  agencies  (Educational 
Testing  Service.  American  College  Test 
ing  Program.  Psy«,holofical  Corpora-^ 
tion,  IfarcoUrt,  Brace.  Jovanovich. 
Houghlon-Miffltn,  CTB,NkOraw> 
Hill)  Sometimes,  states  and*  national 
agencies  wor^  togetfr^r,  especially  when 
>tate  departments  of  education  have 
limited  technical  or  technological 
resources 

In  the  case  of  achievement  tests,  those 
developed  and  used  to  evaluate  students 
at  rhe  local  level  and  those  selected  or 
imposed  from  outside  sources  should  be 
complementary  A  mandated  state  bastv 
kkilis  test  should  not  come  as  a  shock  to 
a  student,  if  the  state  test  ts  an  appro* 
priate  measure  of  school  iearning.  it 
should  look  like  the  exercises  students 
already  have  seen --frequently— in  their 
Khools.  A  liii  of  congruency  is  a  legttt 
mate  concern  of  education  criitcs 
Ftthei  schools  have  not  prepared  stu> 
dents  properly,  or  the  outside  test  is  an 
unfaii  reflection  of  schoolobjecttves 

in  the  case  of  aptitude  tests,  you 
would  not  expect  tests  developed  by  out> 
side  sources  to  beat  as  dose  a  relation^ 
shjp  to  the  tests  nornv'ly  used  m  Khoois 
(Teachers  simply  don  t  make  up  aptt 
tude  tests  )  This  is  not  a  fault  For 
example,  a  student  might  encounter  on 
an  aptitude  test  a  vocabulary  word  that 
IS  unfamiliar  What  we  fiop<  is  that 
from  an  accumulated  knowledge  of 
words  and  how  they  are  used,  ine  stu« 
dent  might  be  able  to  deduce  the  mean, 
ing  from  the  structure  of  the  word  and 
from  the  context 

By  now,  you  should  be  suitably  im> 
pressed  by  the  number  and  variety  of 
tests  that  can  be  devised  ffom  the  four 
classifications  There  are  ^ntenon  rej' 
ennced achievement  tests  thai  are  devel 
oped  by  /rot  Am  and  requite  students  to 
produce  the  answers  (this  category 
probably  characierues  the  largest  num> 
ber  of  educational  rests  given  and  taken 
in  the  world  J  There  are  a  tier  ton  rejer 
tnced.  muUtpte  ctiotcf  tests  that  ate  de 
V eloped  by  sjsie  depart menis  oj  edutrt 
iton  to  measure  achttvtmtnt  In  the  basic 
skills  Thete  are  norm-rtferenctd,  muh 
itpte  fhotce,  aptttude  tests  such  as  the 
ones  d.  igned  by  the  Eductttonst  Test- 
ing Sfrrtt  e  for  the  College  Boards  (Tests 
of  this  type  have  been  of  greatest  con 
cern  to  Khool  people  in  recent  years, 
probably  because  ihey  are  the  ones  over 
which  school  people  feel  they  have  the 
ieasi  direct  control  >  in  ihe  appropriate 
Circumstances,  each  type  of  test  can  be 
valuable  —Survtt  B.  Anderson 

7HI  AWmtCANSCMOOlSOAKOIOtKMAl 
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DEVELOPING 
A  TEST 


from  th«  XXD*  »  »Uftd#/d«t<J  ««»t  l»  Co«c«ty#d  to  th« 
tim«  H  ^»  *<Jmi«iHtf«d. <JMtn».ol  p»op»«  art  Iftvohtd, 
ttit  ipecUftiti.  t<3<l0rs.  rtvi#wtfi<  tt»ch*f».  awJ 
^oftisoft  «A  th«  hno*l»agt  Of  >kiU  lo  tr\9M»tt6 
Al  E<Joc«ttOA*l  Twtino  S^fvict.  d«v««op<no  *n  tr^tirtty 
«♦*  itil  J»kt»  a&oul  two  ytari.aftd  It  Uhti  «t>out  U 
n>^lM  »0*  twh  Qutition  W  P*>»  th/o«firi  «it  iW  ^ 
<3*»»JOp»T>4nt  *  ,  / 

St«t>ctofift^  tI*JT^^rv»tKJn$  ♦'vJ  vi.rHfr>g  Qo»itioh»  arc 
t»K»of<Jtoafity  C6fnp««i.  twt  not  myiUrlcu*  To  h**? 
»n  oiyjr luftdtofl  iht  poctis.  h«f«  »ft  its  hiflhftohtv 

1.  Dclining  ErfMCAtioMi  Ob]«ctiv«ft 

Tht  d#Crt»Oft  to  C0ft»tfu<(  *  ttit  o<  partKuUf 
■•pnt«*<j*«  Of  achi»v<mtftt»  u»«atl)f  r«»«'ti  (rom  tht 
;Ko«»ii  oi  iKJucatw*  *f>o  >••  ihf  wch  * 

t«st  One*  Iht  de<i»}en  l»  madt.  ttit  d«v«foptf»  aiK 

•  Who  *m  Ut>t  Iht  ttsi  afxJ  lo*  wt>*l  pufpotti^ 

•  What  can  lt»t  tahtrs     tuPtcttd  to  know 
at>cut  Iht  f^tklT 

•  Ho«  ihovt**  tti!  taktfS     afclt  lo  vit  thaif 

>lftO*1«<Jflt'' 

•  What  kuyJs  ot  <}ut««>o»  sftoyVJ  b*  ">  th«  it>t 
*Aa  ho«  many  of  tach  ktmi'* 

•  Ho«  <oro  »rK>v>d  tr>«  ttit  btt 

•  Ma*d»»'Cuit»*>«uMtr'ttittb«* 

t.  Advisory  Committees 

At  tTS,  lh«>«  QwtitiOrt*  art  uwaify  aniMtrtd 
wtth  tha  htip  of  t<p«f I  tCf}%cti  01  tiamir^tf I  liom  an 
a«ioiith*vO««i'/ 

tach  Itttinfl  program  na»  its  owh  coovmltt*  of 
adviiof I  for  tiampi#,  th«  Ntti«n«i  Ttaehaf 
C»*m»r>atK>«>  aft  B«ing  ft*ttt<J  by  a  paott  of  25 
lt*df fi  in  ycf*o<A  admmiit(at>CA  and  tt«chtr 
*duCktK>n  M0rk>f>9  wim  CIS  uaM 


t.  QvtatiM  WritlAC 

•  Onct«p#ctJ>catlon«»>ii»*t>»«n«tabt»ih»<J, 
dKliloni  are  madt  oo  if»e  lypei  o*  qowtloflt  lo  oi* 
For  »undardiitd  Itit».J£TS  fnoH  IrtqutnUy  usts  tha 
otIectJvt.  rmjitiplt  choJct  fofmat.  aunoush  some 
itit»  alio  tnc(udt  ti»ay  qu«itions 

Advisory  commtttt**.  ou(s>dt  tiH'ti.  ar»d  6TS 
stall  wntt  tht  qutiMffS. 


Aa  Example 

TheCyctt  tegir^i' 
Wntt  tht  Itemi 


•  a**^  ««ir 
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4.  The  Prct«»t 

One*  <iu«Mion»  art  wntttn  thty  4r«  4d>T>irt«sttft4 
(0  «  SJmpt*  Qr<>vp>  i,fr^'\»t  th«  p«Oplt  ^or  whom  trv« 
!tst  4S  vnttndvO  Tht  0f9(9St  ttfl>  ttst  <9«vti«ptis 

■  Th«<]ittrCo*ty  0(  t«cn  4u«9C»0n 

■  Whtih«i  indifKJuJi  Qu49t  on*  Jr«  «m&>gi/OuS  0« 

■  V^htth«t  '^correct  JtMrnJUvt  aniwtrs  3hou)<j 

5.  Sensitivity  R2vicw 

Befoft^fy]  aittr  u>«  p/tttst  tjch  ittt  «> 
r*vi«W9<l  10  tnsurt  thJl  tri*  Qv«SI>Ons  fttl*ci  tn* 

m>r<o<(|its  «nd  MOtt«n  Ejcn  Its!  item  ts  to 
tnsyft  thjj  Jny  w^ftf  f>»ini«  or  <JiJcripl>OA  thJJ  mjy 


An  ExAmpIc 


Tfif  >«  iv*<]$mtnt$  «r«  trtiC^t  by  *  Mnsltuity ' 
ftvitvv«(s  who  jr«  esP^Ciiihf  trjmvO  to<0«ntify  and 
ttimiAjie  mJtertJi  thJt  <r</grit  &«  unfjir  04  ofttn»tvt  to 

4n>  group 

TKc  Fin«l  PK««c 

In  (ht  finji  ph«s«  itM  «in«ktr5  aruilyi*  tht  prtlttt 

<]>lftcuiry  10  rtftvct  lh«  SuDitct  mjttf r  jfvd  10  ;tst 
SP♦C■^C  >kitl»  A  prOp«c  distribul'On  of  conttrtt 
jccovnts  lot  ditftrtncts  m  sc^oo^  curr*cut«  4$  wtll 
«»  rtgionjt  (]iOertnct»  runWrtxn  ()itfir«r>c«$.  Jnd 
st«  «fvd  tthnlc  ditftrvrKts 

Allt(  tr)t  ttsi  (s  «»stmt}l*0.    is  rtvi«w*<)  by  omtf 
jp«CHtijts».commjtle«  m«mb*r>,  arvd  »Ofn«ttmiv  by 
outs«(}^  f  «perls  Etch  rtvtrMtr  answers  all  QwesltOAs 
in<)tp«fvdtntly  and  prtparts  «  UsI  of  cofrtct  answtrs 
vtfuch  IS  tr)tn  iccnpar^d  with  iri«  ir^ttndvd  Jn$wefS  to 
v*ii(y  agrtAintnt  Oil  th«  COfrvCt  JnSwtr  to  t'Ch 
qutstion  N«  lt*t  can  f«  t«  pittt  wntll  th«  r«rson 
rtsp«nslk>«  ctrtltlt*  Xt}»k  jI  least  Ihrtt  <}l((trtnt 
p«fXt  toav*  afrtt^^*  th«  ccrrKt  answtrs  to  tvtry 
Cutstkxi  > 

7h«  ttst  is  Ihtn  str)t  t«  tb«  tRt«mat  cvmmltttt  o< 
axaminara  Utt  rtvttw  goinf  It  ^tss 

7.  Test  V«1i;lity  And  Disclosure 

Th«  t«st  pr^paratXM)  P^OCtss  COfltlnutS  tvtn  alitt 
th»  test  has  b*«o  admift  sitftd  Cont'nu'og  rtwarch 
•s  necessary  to  tnswrt  (Mt  tht  tt^t  is  vaixJ-othatit 
<3o4s  th«  )0t>  )t  IS  de^iQn«<]  to  do 

Alrtf  th«  Itsi  IS  aorrlntsitrtd  but  &«lor*  final 
seoftng  taitts  plact^  prelimiqary  statistical  artaiys'S  ot 
each  ^uestioo  is  caifitd  out.  baMd  OA  Sfv«fal 
thousand  answtr  Sheets  The  rtsuMs  are  itvitAed 
qutstiO«vby4utstion  M  a  pfOOtem  ts  fov^^ 
coTf^cttvt  action,  Such  as  not  scoring  th«  qutstiOn  is 
taktrt  betO't  ftoal  SCOflftfl  itvj  $cO»t  ItpOftiftfl 

Accuracy  O*  >e'l  co**ttn|  >$  fo<t^er  strtftfllhtned 
by  feedbaCK  1(0^  stu<}tnts  to  Iht  ttst  centtf 
supervisor  alerting  test  admirust'atofS  lo  the 
possible  txisltrtct  0(  ambiguously  wOr<3ed  dtms 
Ihis  proctss  has  been  extended  th/ougrt  ttst 
d'tctosurt,  whiCh  enabitS  students  10  examine  the 
Outsi^oos  shd  answers  ante  theitst  has  been  O'vtn 
When  Itst  dtvalopment  er(0<s  come  to  dfiht  truOugh 
these  prOCtssts  appfOpnate  cori*<t(v«  action  is 
taken 

At  e^ery  stage  o*  the  process  ETS  does  alt  that  is 
posS'Mt  to  assure  the  accuracy  avy)  fairness  o< 
•ndrvKlual  test  cueslions  and  ine  «(air>inat>ons  as  a 
wMe  It  s  a  demanding  and  lime  consuming  process 

bvt  >t  s  worth  the  ellott  ETS  strives  to  set  high 
standar^Js  in  |h*  fietd  for  ^luarity  tests 

for  *yrthei  information,  contact  Informalion  O'viSipn 
ETS  frinceton.  NJ0«&4t 
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AttJivhoent  V 


Ihe  process  for  aallenging  a  Qoestion  on  an  CTS  T?st 


Ttest-Taker  Ingmtv  to  ETS 

T^st-takers  n^y  InqvJire  about,  a  question  cn  an  ETO  ad'sissions  test  in  several  ways: 

(1)       Speak  to  the  supervisor  at  the  testing  center,  will 

file  a  report  to  ETS  concerning  the  test  question  m  dispute 


(2) 
(3) 


Write  or  call  ETTS  iim«diately  after  the  test  ►explaining 
the  difficulty  encountered  with  t^*  particular  question 

write  or  call  ETS  about  a  disputed  question  after 
reviewing  the  test  questions  provided  the  , 
t^st-taXer  following  a-disclosed  test  adrinisjiratton 


Errs  Staff  Review  I 

Bach  inquiry  is  reviewed  ty  two  or  rore  ErrS  staff  Jpeirbers  v.i»  »iave 
Mx>r  responsibility  for  the  typ«  of  question  m  disjwte.  Additiorul 
reviews  by  subject  matter  specialists,  such  as  university  faculty  m  J>e 
relevant  Held,  are  also  frequently  obtained  —  depending  co  the  nature  of 
the  challenge. 

Errsjto^^r^M^  to  Test^TaXer 

A  letter,  either  explaining  the  question's  soundness,  f , 

a  flaw,  is  t>«n  mailed  to  the  test-taXer.  (If  a  Haw  is'  acknowledged, 

the  next  step  m  the  process  is  #8  below.) 

F>jrthor  Tt?st^aXer  Inquiry 

If  the  test-taker  is  not  satisfied  with  LTS'  response,  he  or  she  may 
write  Errs  again  to  continue  the  challenge. 

Additional  independent  Review 

Additional  reviews  of  the  disputed  test  question  are  obtained  fro^  a 
cocbination  of  university  faculty  and/or  other  !PP^^*?E?^^'^P^"i 
outside  ETC  (such  «?  secondary  school  teat^iers  for  the  PSAT  or  sat 
25  senior  BIS  staff  who  were  not  involved  ir  developing  the  test  in 
question.   Without  prior  knowledge  of  tr«  test  q^^ti^  or  correspond- 
eiv:e  reiated  to  it,  the  independent  reviewers  are  asked  to  select  an 
answer  to  the  question  and  justify  their  choice.  J*^*" 
given  the  correspondence  between  t^*  test-taker  and  ETS  and 
asked'  to  explain  in  writing  vhy  their  perceptions  are  or  are  not 
changed  by  those  arguT«nts. 
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,  A  second  letter  is  then  sent  to  the  test-taXer,  either  explaining 
the  argunents  in  defense  of  the  challer>ged  question,  or  acknowledg- 
^>ng  a  flaw.    (It)  date,  no  test-taXer  has  continued  a  challenge 
beyond  ETS*  second,  response. ^ 

7.  Appeal  Process  . 

In\the  event  that  a  test-taker  should  remain  unsatisfied  with 
Era'  second  resjixise,  an  appeal  process  has  been  included  in 
the\Droceduces  for  handling  test  question  inquiries  adopted 
joirifly  by  the  College  Board  and  ETS  relative  to  College  Board 
programs.    (ETS  will*  reconrtvend  to  other  test  sponsors  cctnpafable 
prxxedures  jhoo^^  . ) 

The  College  Boacd-ET§^  appeal  process  calls  for  a  judgment 
based  on  all  materials  related  to  the  case  by  a  three-member 
external  appeal  panel  chosen  by  the  chair  of  the  appropriate 
College^ Board  Academic  Advisory  Cormittee  (i.e..  Mathematics, 
Eiiglish),  Science,  etc.)  * 
\ 

8.  Possible  '.Outcomes 

If  a  test\taker's  challenge  is  substantiated  at  any  point 
before  scotes  are  reported,  corrective  action  is  taken  immediately, 
typically, \by  deleting  the  disputed  question  prior  to 
scoring  the  answer  sheets. 

If  a  flawed  ^question  is  discovered  after  scores  have  been 
reported,  a  <3e termination  is  made  by  the  test  sponsor,  with 
coosultation^frcm  ETS,  relative  to  cescoring  answer  sheets  and 
rereporting  s^(:ores.    Ihis  decision  may  vary  according  to  the 
testing  prcgram.    However,  considerations  affecting  the  derision 
include  fairness  to  students^  the  accuracy  of  measurement,  how 
the  test  is  used,^and  the  extent  of  ijnpact  rescoring  would  have 
on  test-takers  remaining  in  the  eidmissicns  decision-making 
process.    Flawed  questions  are  withdrawn  from  further  use. 

9.  Errors  are  Rare 

 ETS,  like  other  organizations,  is  not  perfect,   ^though  mistakes 

are  rare,  flawed  Questions  or  mistakes  sometimes  slip  through  the 
rigorous,  IS-nonth  process  that  is  used  in  developing  and  refining 
tests,    tout  of  5,695  questions  on  disclosed  tests  fron  Jan.  1980  to 
June  1981,  only  triree  were  found  to  be  flawed,  less  than  1/10  of 
1%.)   Whenever  an^rror  is  discovered,  corrective  action  is  taken 
proirptly  and  in  accordance  with  the  guidelines  stated  above. 


Prepared  by  The  Educational  Testing  Service,  July,  1981. 
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(Inciudc'S  AU  Alnintsttdtions) 
January  I,  1980  -  June  30, 

o  l.ir<30  inajority  of  lnc]uiricr»  about  tost  questions  for  all  six  pcogroM  is  (twxSc  by  test-takers 

Oiortly  oClcr  the  dtVainistcatlon  of  a  tost,  aivl  prior  to  the  receipt  oC  test  qtcstions  provitJcd 
l*y  tcit  disclosure. 

*  f 
•  o       0  very  small  portio".  of  the  1900  and  19QI  inquiries  were  received  as  a  resuilv-bf  test  disclosure. 

^"""^  GRCy^titjXfe  LSAT  SAT  lOCpO  PSAT 


( 1)  R(>ix>n'>  by  'Hjst 
Ontcr  Jjyporvisocs 

(2)  Direct  OfMUdcts  to 
ETfS  D(?ff>ro  Scores* 

(3)  Direct  Contacts  with 
UT^  After  Reiving 
TM-t  0>*stion5  4 


OJAT 
89 

11 


Tt>t-»1  Inquiri**» 


100 


Faulty  OK^r.tlons  Identified  tyi, 

CD  ^  0 

(2)  0 


20 


393 


136 


0 

I 


SAT 
107 


PSAT 
11 


TOTALS 
695 

61 
32 


7C8 


T«>t-iil 


10 


:^,^ir<ic  noTtx^r  ducj  to  multiple  ccrrionto  on  a  few  questions.  .        ^  » 

b\lw>3t  half  of  these  were  on       question  Much  contained  a  misprint;   tl>o  question  was  not  scored,  p 
.Includes  lotters  frcra  parents  anci  school  porsonnM.  "  J 

*rlaw«J  qo^'Jtions  identified  before  scores  are  fcporlcd  are  not  counted  in  scoring. 
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erJc 


JANUAIIV  1900  -  JUNU  1901 


lir>.  of  lt><;ts  tto.  of  Question';  Ito.  of  Jto.  ot  Flowed  ^  Disposition 

l>i£>clo$*xJ  *    Disclo*;cd  ^»?**.tiofvs  CXicsUoa'*.  '        .  Hoclo 


A(Hi»iVV»  'V       *  1,02% 


4 


3Bj 


I.^Ar  7  1,330  •!  *  IV»soorc<J  23/000 

,  « *  ortswoc  sheets 


c<>vir,o<l  22,000  oo 
flC0rc3.  0> 
CO 


230  0        ,  ,  1  IV'St    cd  030,000 

onowut  sheets; 
rcviseO  250,000 
scores. 


ltscorc<l  65,000 
«iuswer  sheets; 
rovisTKl  17,000 
r.cwes. 


r^score<l  930,000  , 
onswer  sheets; 
rovisod  209,000 
scores. 


SthlE  LECISIAHJRES  IN  WHICH  BILLS  10  RSGUIATE  AND  DISCLOSE 
ADMISSICNS  OR  OCCOPATIONMi  TESTS  HAVE  BEEU  INnODOCS) 


States  in  which  bills       States  In  which  bills  States  in  which  bills       States  in  which  legislation 

were  introduced  prior*       were  introduced  prior  were  introduced  for  requiring  disclosure  of 

to  1981  to  1981  but  which  did  first  i:iine  in  1981  test  content  has  passed 

not  consider  the  issue  * 

Trri981 


California 
Colorado 
Onnocticut 
Florida 
Illinois^ 
Indiana  ^ 
Louisiana 
tteryland 
(^saachusetts 
Minnesota 
Mississippi 
Missouri 
New  Jersey 
Nlw  York 
Chio 
^  Oklahoma 
Pennsylvania 
Fhode  Island 
South  Carolina 
Ttennessee 
Texas 

Washington 


Colorado 
Indian// 
Maryland 
Mississippi 
Olio  • 
Rhode  Island 
South  Carolina 
Ttennessee 
Texas 

Washington 


Alaska 
Arizona 
Georgia 
Oregon 

^  South  Dakota 


New  York 


•22 


10 


3/. 
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riAClIERS  COLLtOC    COLl'MlUA  1'M\IRn11Y 
NfcW  YORK    M  W  ^ORKIv**:* 


0»  >Cll.ivCf>   A.SD  FDOCATION 


,     ,  '  July  13,  1981 

CongressMn  Paul  Slaon 
Subcommittee  ion  Postsecondary  Education 
320  Cannon  House  Office  iJuilding 
Washington,  b.C.  20515 


Dear  Congcessman  Simon: 


I  am  writing  to  register  with  you  my  strong  opposition  to  a 
national  'truth-in-testin^'  law.  I  am  a  historian  of  education  at 
Teachers  College,  Columbia  University;  my  overriding  interest  as  an 
educator  is  in  the  quality  of  American  education.  I  see  no  valid 
legislative  purpose  to  be  served  in  the  enactment  of  federal  legislation 
regulating  educational  testing.  Such  a  law  would  be  an  intrusion  into 
the  educational  process  for  spurious  purposes  and  would  introduce  a 
federal  presence  where  none  is  needed, 

I  base  my  opposition  to  such  a  law  on  thi2  f9l lowing  facts: 

1)  Ko  col],ege  or  university  is  compelled  to  use  a  standardized 
admission  testr^  they  ask  prospective  students  to  take  such  tests  because 
they  want  to  know  how  they  perform  on  a  test  of  verbal  and  mathematical 
skills  and  how  they  compare  to  others  of  their  age  who  take  the  same 
test;  institutions  a^k  students  to  take  these  tests,  because  they  feel 
that  tn^  tests  are  a  useful  predictor  of  future  performance,  thus 
enabling  the  cpllege  tp^ jdetermi ne  Vhether  a  student  has  the  requisite 
skills  to  succeed  and  td.' place  entering  students  in  appropriate 
programs.  If  postsecondary  institutions  do  not  want  this  information  or 
do  not  trust  it',  they  do  not  ask  for  it.  > 

1 

2)  Test  scores  serve  a  useful  purpose  in  comparing  students  from 
different  secondary  schools  and  different  backgrounds.  Admissions 
officials  find  that  they  need  some  objective  measure  by  which  to  compare 
the  "all-A"  student  from  a  well-known  high  school  and  the  "all-A" 
student  frpm  ap  unknown  high  school;  because  of  the  well-established 
phenomena  of  grade  inflation,  college  admissions  officers  can  no  longer 
be  sure  that  a.  student  with  high  marks  is  actually  prepared  to  succeed 
in  an  academically  demanding  college  program. 

3)  few  st^udents  fail  to  get  into  the  college  of  their  choice,  and 
everyone  who  wants  to  go  to  some  college  can  get  in,  without  regard  to 
test  scores.  The  College  Board  polled  its  members  recently  and 
discovered  that  only  8  percent  of  the  nation's  postsecondary 
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institutions  were  compfjtltlve,  in  the  sense  of  having  more  applicants 
than  places;  34  percent  admitted  everione  who  applied,  regardless  ot 
their  previous  academic  experience;  and  the  remaining  58  percent 
accepted  everyone  who  met  thexr  requirements  (such  as,  having  a  high 
school  diploma  or  a  high  school  average  of  80).  In  the  last-named  group 
of  institutions,  everyone  or  almost  everyone  who  applied  was  admitted. 

4)  In  the  face  of  declining  numbers  of  college-age  students,  the 
traditional  admissions  "game"  has  virtually  been  reversed.  With  the 
exception  of  a  handful  of  elite  institutions,  colleges  are  now  in  the 
position  of  competing  for  students,  instead  of  students  competing  to  get 
into  college. 

5)  Test  scores,  in  short,  keep  no  one  out  of  college,  but  do 
provide  a  useful  piece  of  information  that  is  helpful  in  matching 
students,  and  institutions  and  xn  diagnosing  student  strengths  and 
weaknesses. 

6)  One  of  the  hidden  Purposes  of  "truth-in-testing"  legislation  is 
to  disrupt  the  process  that  makes  standardization  of  test  questions 
possible.  The  reason  that  a  standardized  test  is  reliable  is  because  the 
questions  on  it  are  used  and  reused,  which  makes  it  possible  to  know 
whether  the  test  item  contains  any  cultural  bias  or  whether  it  is  flawed 
m  ways  not  immediately  apparent;  a  sub.itantial  part  of  present  tests 
consists  of  questions  that  are  being  tried  out,  without  counting  on  the 
test-taker's  score.  If  test  items  were  disclosed  every  time  a  test  were 
administered,  it  would  make  the  process  of  test-construction  more 
expensive  and  less  reliable. 

Most  important,  it  seems  to  me,  is  the  question  of  why  federal 
legislation  should  be  written  which  would  interfere  with  the  standards 
and  criteria  of  postsecondary  institutions.  Behind  the 
"truth-m-testing"  drive,  I  believe,  are  well-meaning  people  who  would 
like  to  ban  standardized  testing  altogether.  What  they  would  really  like 
to  ban  IS  the  competition  to  get  into  a  few  highly  select  colleges  an^ 
universities.  Common  sense  suggests,  however,  that  this  competition  will  ^ 
exist  whether  it  is  based  on  standardized  testing  or  on  individual  tests 
administered  by  each  institution  that  has  more  applicants  than  places 
available.  Common  sense  also  sugge&^s  that  this  is  not  an  appropriate 
ar*»na  for  f<*d<»ral  legislation. 


Yours  truly. 
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Forgetting  the  Questions 

The  Problem  of  Educational  Reform 

DIANE  RAVITCH 

IT  uoiLDBLDiFficLuT  TO  FIND  a  sustained  period  of  time  in  our  histor>' 
when  Americans  felt  satisfied  uith  the  achievements  of  their  schools. 
From  the  early  nineteenth  century  on,  it  h<«jis  been  coniniunplace  to  find 
a  fairly  consistent  recitatiun  uf  complaints  abuut  the  Iunn  state  uf  learn- 
ing, the  poor  training  of  teachiers,  the  insufficient  funding  uf  education, 
the  inadequacies  of  school  buildmgs,  and  the  apathy  uf  the  public.  The 
temptation  exists  tu  attribute  the  concerns  of  the  19SOs  tu  this  strain  of 
despair  about  the  historic  gap  between  aspiration  and  reality  ,  this  sense 
that  schi>>ols  ha\e  always  and  will  always  fall  short  of  their  mission.  But  it 
*  would  be  wrong  to  do  so,  not  only  because  it  would  encourage  unwar- 
ranted complacency,  but  because  the  educational  problems  of  the  pres- 
ent are  fundamentally  different  from  those  of  the  past. 

One  important  difference  is  that  so  much  of  the  past  agenda  of  edu- 
cational reformers  has  been  largely  fulfilled.  In  one  sense,  the  educa- 
tional enterprise  is  the  victim  of  its  own  successes,  since  nev\  problems. 
Iiave  arisen  from  the  long-sought  solutions  fo  eaJier  problems.  Idealistic 
reformers,  eager  to  *n. prove  the  schools  and  to  extend  their  promise  to 
all  children,  sought  the  apprupnate  lever  of  change.  //  uidy  teachers  had 
college  degrees  and  pedagogical  training,  if  only  teachers  would  band 
together  to  form  a  powerful  teachers'  union,  if  only  there  were  federal 
aid  to  schools,  xf  only  all  children  were  admitted  tu  school  regardless  of 
race  or  national  origin,  if  only  all  students  of  high  ability  were  admitted 
to  cuL'tge,  if  only  colleges  could  accommodate  everyone  who  wanted  to 
attend,  if  only  students  had  more  choices  and -fewer  requirements  in 
their  course  work,  if  only  schools  were  open  to  educational  experimenta- 
tion, tf  only  there  were  a  federal  department  o/  education. . . .  The  "if 
only"  list  could  be  extended,  but  the  point  should  be  clear  by  now.  All 
these  "if  onhes"  have  been  put  into  effect,  some  entirely  and  others  at 

ODIANE  RA\'1TCH.  ^ssucjatt-  professor  of  h»stor>  and  education  at  Teachers  College. 
Columbia  tnivers»l>,  is  the  author  of  Hie  Creai  Sclux/t  V>'qts.  Sen  York  City,  1805- 1973 
and  The  Hex.isujnisti'  Revised  A  Cnttque  of  the  Radtcal  Aiiai^k  on  iht  SJiooh  She  is  cur 
rent!)  at  work  on  a  hi<:tor>  of  American  education  since  1945 
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least  partially,  and  rarely  have  the  results  been  equal  to  the  hopes  in- 
vested. 

In  reality,  many  present  complaints  are  reactions  to  hard-won  re- 
forms of  the  past.  Though  the  educational  preparation  of  teachers  is 
more  extensive  than  ever,  at  least  when  measured  by  degrees  and  years 
of  formal  schooling,  the  education  of  teachers  is  still  a  subject  of  intense 
criticism.  The  realization  has  dawned  in  man>  quarters  that  a  credential 
from  a  state  unuersity  or  a  school  of  education  is  no  guarantee  that  its 
•bearer  knows  how  to  teach  or  what  to  teach,  loves  teaching  or  loves 
learning.  Nor  are  today's  critics  delighted  b>  the  undeniable  power  of 
teachers'  unions.  True,  the  unions  have  used  their  political  clout  to  im- 
prove teachers'  salaries  and  \o  win  vastly  enlarged -federal  education  ex- 
penditures, but  unionization  has  not  pVoduced  the  educational  changes 
that  some  of  its  advocates  had  anticipated.  Similarly,  the  sense  of 
achievement  that  shuuld  have  fullowed  the  removal  of  racial  barriers  to 
higher  education  quickly  gave  way  %o  concerns  about  social  strati- 
fication, vocationcihzation,  and  declining  quality.  The  reforms  of  the 
1960s  were  effective,  though  not  in  the  way  that  reformers  had  hoped 
Now  everyone  who  wants  tu  gu  to  college  can  go  to  5ome  college,  though 
not  necessarily  that  of  his  first  choice.  By  1980,  at  least  one-third  of  all 
institutions  of  higher  education  admitted  everyone  who  applied,  more 
than  one-half  accepted  most  or  all  of  those  who  met  their  qualifications, 
and  less  than  10  percent  were  "competiti\e,"  that  is,  accepted  only  a 
portiun  of  qualified  applicants.  As  college  enrollments  decline,  the  num- 
ber of  competitive  colleges  will  grow  fewer.  Curricular  reforms  have 
broken  down  the  coherence  uf  the  liberal  arts  curriculum,  both  in  high 
school  and  cullege,  so  that  students  have  a  wide  degree  of  choice  and  few 
requirements.  And  a  federal  department  of  education  has  at  last  been  es- 
tablished, though  with  what  benefits  or  burdens  for  schools  and  children 
it     too  soon  to  say. 

Yet  having  won  so  many  victories,  «;ome  of  truly  historic  dimension, 
American  education  is  still  embattled,  still  struggling  to  win  public  sup- 
port and  approval,  and,  perhaps  wofse,  still  struggling  to  find  its  own 
clear  sense  of  purpose.  Paradoxically,  the  achievements  of  the  recent 
past  seem  to  have  exhausted  the  usually  ready  stock  of  prescriptions  for 
school  reform  and  to  have  raised  once  again  the  most  basic  questions  of 
educational  purpose. 

Like  other  major  institutions  in  our  society,  the  schools  are  contin- 
ually judged  by  today  *s  demands  and  today  s  performance,  and  no  credit 
IS  extended  by'  clients  or  critics  for  yest^irday's  victories.  \Vhich  is  as  it 
should  be.  School  criticism,  as  I  noted  earlier,  is  nothing  new.  Behind 
any  criticism,  however,  are  assumptions  about  what  schools  should  do 
and  can  do.  and  criticisms  have  shifted  as  assumptions  about  thejoals 
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and  potentialities  of  schools  have  changed.  Since  the  early  nineteenth 
centur),  the  tenor  of  school  criticism  has  been  essentially  optimistic,  no 
matter  how  despairing  the  critic,  his  working  assumption  has  been  that 
schouls  are  valuable  institutions,  that  the>  have  within  them  the  power 
to  facilitate  great  social,  moral,  and  political  regeneration,  and  that  more 
money,  or  more  public  concern,  or  better  teachers  could  extend  the 
promise  of  schuuling  to  everyune.  If  more  people  had  more  schooling, 
critics  have  contended,  and  if  schools  were  amply  financed  and  well 
staffed,  there  v^ould  be  enormous  benefit  to  the  individual,  the  society, 
the  economy,  and  the  body  politic.  With  relatively  little  dissent,  Ameri- 
cans have  believed  in  schooling — not  because  of  a  love  of  the  hickory 
stick  and  the  three  Rs,  or  (as  some  latter-day  critics  would  have  it)  be- 
cause of  the  schools'  abihty  to  make  children  docile  workers,  buTbecause 
Americans^are  deeply  committed  to  self-improvement  and  the  school  is 
an  institutionalized  expression  of  that  conhmitment. 

Participation  m  formal  schooling  has  grown  sharply 'in  recent  de- 
cades. The  proportion  of  seventeen-year-olds  who  graduated  from  high 
school  grew  from  about  50  percent  in  1940  Jo  about  85  percent  in  the 
late  l&TOs.  Similarly,  the  proportion  of  young  people  who  entered  college 
climbed  from  about  16  percent  m  1940  to  about  45  percent  in  i968,  at 
which  time  it  leveled  off.  In  no  other  country  in  the  world  does  partici> 
pation  in  formal  schooling  last  as  long,  for  so  many  people,  as  in  the 
United  States.  To  understand  why  this  broad  democratization  of  educa- 
tional participation  occurred,  as  well  as  why  the  J980s  began  on  a  note 
of  disillusionment,  it  is  useful  to  consider  some  of  the  expectations  we 
have  attached'  to  formal  schooling. 

Until  well  into  the  twentieth  century,  only  a  small  minority  of  Amer- 
icans attended  college.  College  was  not  only  expensive  but  exclusive, 
Many,  perhaps  most,  colleges  maintained  quotas  for  some  groups  (like 
Jews  and  Catholics/  and  excluded^others  altogether  (blacks)'.  After  World 
War  II,  more  than  two  million  veterans  attended  college,  crowding'and 
sofuetinics  overwhelming  America's  campuses.  The  QI  Bill  launched  the 
world's  first  experiment  in  universal  access  to  higher  education.  While 
most  veterans  did  not  use  their  benefits  to  attend  college,  Ihe  experience 
of  those  w'ho  did  benefited  the  individuals,  the  institutions,  and  the  econ- 
omy In  light  of  the  success  and  popularity  of  the  Gl  program,  the  con- 
viction that  college  should  be  a  right  rather  than  a  privilege  gained 
broad  support. 

Willie  demands  for  expanded  access  to  higher  education  grew  steadi- 
ly in  the  states  and  nation,  other  political  forces  combined  to  advance 
tile  role  of  education  as  a  weapon  against  poverty  The  notion  that 
knowledge  is  power  vvas  certainly  not  novel,  nor  was  the  very  American 
belief  that  schooling  is  an  antidote  to  crime,  poverty,  and  vice.  The 
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school  proniuters  of  the  earl>  nineteenth  centur>  repeatedly  argued  that 
schuuhng  would  give  people  the  means  to  improve  themselves  and 
thereby  break  the  cycle  yf  poverty.  During  the  early  1960s,  this  tradi- 
tional rhetunc  was  given  new  life  by  scholars  and  policymakers.  Educa- 
tional programs  burgeuned  as  an  integral  part  of  the  federal  govern- 
ment's war  on  poverty.  Jacob  Riis  had  written  in  1892,  **the  more 
kindergartens,  the  fewer  prisons",  in  1965  Lyndon  Johnson  predicted 
that, the  lives  of  children  in  the  Head  Start  summer  program  would  be 
spent  ^'productively  and  rewardingly,  rather  than  wasted  in  tax-sup- 
ported mstitutiuns  or  in  welfare-supported  lethargy."  The  hope  of  elimi- 
nating poverty  and  inequality  provided  the  major  rationale  not  only  for 
Operation  Head  Start  but  for  general  federal  aid  to  cducatioii  as  well. 

By  the  tune  the  period  of  educational  expansion  reached  a  high  tide 
iu  the  middle  lOGUs,  much  was  expected  by  a  variety  of  publics.  It  was 
hoped  that  more  education  would: 

•  Reduce  inequality  among  individuals  and  groups  by  eliminating  illiter- 
acy and  cultural  deprivation.  , 

•  Improve  the  ecunumy  and  ecunumic  opportunity  by  raising  the  na- 
tion's supply  of  intelligence  and  skilh 

•  Spread  capacity  for  personal  fulfillment  by  developing  talents,  skills, 
and  creative  energies. 

•  Prove  to  be  an  uplifting  and  cuilizmg  influence  in  the  nation's  cultural 
life  bv  broadly  diffusmg  the  fruits  of  liberal  education. 

•  Reduce  alierMtiun  and  mistrust  while,  building  a  new  sense  of  commu- 
nity among  people  of  similar  education  and  similar  values 

•  Reduce  prejudice  and  misunderstanding  by  fostering  contact  among 
diverse  groups. 

•  Improve  the  quality  of  civic  and  political  life. 

These  hopes  and  eApectations  were  a  heavy  burden  for  the  schools  to 
bear  Perhaps  predictably,  they  did  not  accomplish  all  that  was  asked  of 
them  Most  of  the  pruUemi.  that  were  laid  at  the  schools'  doors  remained 
just  as  problematic  years  later  (and  some  critics  would  argue  that  the 
prov  ision  of  more  schuoling  had  produced  the  opposite  effect  in  every 
instance  Poverty  and  inequality  did  not  cease,  their  roots  were  else- 
where, and  the  schools  ^vere  nut  able  tu  cure  deep-seated  social  and  eco- 
nomic ills.  While  the  disadvantaged  received  more  scliooling,  so  did  the 
advantaged.  Many  poor  youths  entered  the  middle  class  by  using  educa- 
tion il  oppurturuty,  but  others  remained  as  poor  as  their  parents.  The 
value  of  a  high  school  diplijma  declined  not  only  because  its  possession 
became  nearly  universal  but  als6,  and  most  important,  because  high 
school  graduates  were  nut  necessarily  literate^ — mainly  because  of  the 
well-intended  effort  to  keep  as  many  youths  m  school  for  as  long  as  pes- 
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sible  and  to  denv  no  one  a  diploma,  regardless  of  his  educational  devel- 
opment. Society's  investment  in  education  prubabl>  did  spur  economic 
development,  but  it  did  nut  prevent  the  emergence  of  skepticism  about 
the  desirability  of  economic  growth,  in  fact,  it  was  precisely  among  the 
educated  [dnd  the  advantaged)  that  economic  growth  became  suspect 
because  of  its  association  with  the  bureaucratization,  centralization,  and 
depersonahzation  of  modern  economic  life.  It  is  impossible  to  gauge  the 
effects  of  increased  schooling  on  popular  culture  orliigh  culture.  Televi- 
sion, which  insaruLl)  seeks  the  largest  possible  audience,  undoubtedly 
has  more  power  to  ^hapc  popular  culture  than  schools  do  (a  mixed  bless- 
ing. Since  television  disperses  both  sitcorn  pap  and  major  cultural  events 
to  mass  dudienceS/.  Participation  in  popular  culture  and  high  culture  has 
surelv  been  broadened,  vet  it  is  arguable  whether  the  quality  of  either 
has  been  ulcvatt^d  during  recent  decades.  Nor  is  it  possible  to  demon- 
strate that  increased  educational  participation  has  ehminated  distrust 
between  groups  or  contributed  to  a  new  sense  of  community.  On  the 
Contrary,  educational  institutions  have  become  settings  for  expression  of 
miht<int  particularism  alung  racial,  religious,  ethnic,  sexual,  cultural*  and 
lui^mstic  lines.  \'cry  likely  the  differences  among  groups  have  been  ac- 
ctr.tuateJ  in  the  past  twenty  years.  But  again  it  would  be  difficult  to 
hold  the  schools  directly  responsible  for  these  trends.  More  likely,  it  ap- 
pears* the  schools  are  the  stage  on  which  such  issues  are  acted  out  rather 
than  the  cause  of  their  appearance.  Xor  can  the  schools  claim  to  have 
improved  the  quality  of  political  life,  since  political  participation  has 
waned  along  with  public  regard  for  political  institutions.  But,  once 
again,  it  was  riot  the  schools  that  were  responsible  for  the  apparent  ebb- 
ing of  CIVIC  commitment  and  the  surge  of  political  apathy,  nor  could 
they  even  serve  as  a  cuunterforce  against  si^^h  attitudes.  The  same  atti- 
tudes of  distrust,  skepticism,  hostility,  ana  ^^^athy  eroded  the  schools' 
own  status  m  the  social  order.  The  same  confusions  that  pervaded  the  so- 
cial atnt^jsphere  also  pervaded  the  schools.  If  they  failed  to  leach  citizen- 
ship, it  was  at  least  in  part  because  teachers  and  parents  were  confused 
abc^ut  what  a  good  citizen  was  and  whether  "citizenship"  could  be 
taught  vMthout  imposing  a  partisan  interpretation.  In  short,  a  society 
that  IS  Confused  and  contentious  cannot  look  to  its  schools  to  straighten 
thiiij^s  out,  for  the  schools  will  reflect  the  same  confusion  and  contention. 

In  retrospect,  it  was  folly  to  have  expected  the  schools  to  transform 
society  or  to  mold  a  new  kmd  of  person.  The  schools  are  by  nature  lim- 
ited ifiStitutions,  not  total  institutions.  They  do  not  have  full  power  over 
their  students'  lives  ^evcn  total  institutions,  like  prisons*  have  discov- . 
ered  the  difficulty  of  shaping  or  reshaping  the  lives  and  minds  of  those 
thov  fully  control  .  Schools  are  not  full)  independent  in  their  deahngs 
with  students,  they  are  interrelated  \vith»  and  dependent  on,  families, 
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churches,  the 'media,  peer  groups,  and  other  agencies  of  influence.  Nor 
can  schools  be  considered  as  if  they  were  machines,  all  operating  in  the 
same  predictable  manner.  Teachers  vary,  administrators  vary,  students 
vary,  communities  vary,  and  therefore  schools  vary.  The  schools,  being 
complex  human  institutions  composed  of  actors  with  different  goals,  dif- 
ferent interests,  and  different  capacities,  cannot  be  treated  as  if  they 
were  all  interchangeable. 

As  It  became  clear  that  more  schooling  would  not  provide  any  magi- 
cal solutions,  the  utupian  hopes  once  focused  on  the  schools  dissipated. 
Having  briefly  been  the  repository  of  grand  and  even  grandiose  dreams 
of  human  betterment*  the  schools  became  a  scapegoat  for  all  the  wide- 
ranging  problems  they  had  failed  to  solve.  Having  revealed  that  they 
v^ere  but  fallible  instruments  of  social  change  and  that  any  change  they 
promoted  would  oi^ly- be  incremental,  the  schools  became  the  object  of 
rage  and  scorn.  The^  were  portrayed  as  intractable,  bureaucratic,  even 
malevolent  barriers  to  social  change.  But  just  as  it  was  unrealistic  to  be- 
lieve that  the  schools  had  the  power  to  remake  society  by  molding  those 
who  passed  through  tl|eir  doors,  it  was  equally  unrealistic  to  assert  that 
they  were  powerless^^  meaningless,  superfluous  institutions  with  no  pur- 

rc-olher-thao-tlie^are  and  feeding  of  their  own  employee> 
Nonetheless,  when  the  dream  of  a  school-led  social  revoluu.n  faded, 
school  criticism  shifted  in  tone.  The  voices  of  liberal  critics— those  who 
believed  that  men  and  ^^men  of  goodwillmight  work  together  to  im- 
prove schools  by  using  this  program  or  that  curriculum— diminished  to 
mere  whispers.  They  were  drowned  out  by  critics  who  believed  that  only 
radical  changes  in  teaching  or  in  governing  schools  could  "save"  them; 
bv  those  who  believed  that  the  public  schools  were  beyond  redemption 
and  ought  to  be  replaced  by  "fiee"  schools,  and  by  those  who  advocated 
the  abolition  of  compulsory  schooling  and  the  "de-schooling  '  of  society 
For  a  time  in  the  late  1960s  and  early  1970s,  bookstore  shelves  fairly 
bulged  with  apocalyptic  predictions  about  the  imminent  demise  of  school- 
ing One  book,' playing  on  the  then  current  phrase  "God  is  dead,"  was 
titled  School  h  Dead  While  some  of  the  writing  of  this  period  contained 
sharp  and  telling  portraits  of  insensitive  teachers  and  uncaring  bureau- 
crats, others  gave  vent  to  undisguised  anti-intellectualism  in  their  attacks 
on  academic  "standards,  discipline,  science,  and  rationality  In  thg  larger 
culture— and,  alas,  especially  in  academic  institutions— a  great  revival 
seemed  to,sweep  the  land,  casting^aside  "old"  doctrines  of  deferred  grat- 
ification, structured  learning,  and  professionalism  while  espousing  mysti- 
cism. Eastern  religions,  the  Qccult,  astrology,  and  whatever  else  prom- 
ised to  touch  <the  spontaneous,  untrained  inner  spirit. 

These  trends  had  curricular  and  programmatic  consequences.  In 
colleges,  students  demanded,  and  usually  won,  the  abolition  of  course  re- 
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quirements,  the  adoption  of  pass-fail  grading,  the  de-emphasis  of  com- 
petition and  tg^ing,  and  extensive  choice  in  selecting  their  own  pro- 
grams of  sti(3y.  As  requirements  for  admission  to  college  were  relaxed, 
high  schools  soon  succumbed  to  many  of  the  same  pressures  that  had 
changed  the  colleges,  course  requirements  were  eased,  new  courses 
proliferated,  academic  standards  dropped,  homework  diminished,  and 
adults  generally  relinquished  their  authority  to  direct  student  learning 
At  all  levels,  both  in  college  and  high  school,  educational  administrators 
•  reduced,  to  the  extent  possible,  the  schools*  role  as  in  loco  parentis  To 
some  extent,  this  period  of  student  assertiveness  and  adult  retreat  was 
the  uducatiOiial  side  of  the  movement  against  the  war  in  Vietnam,  which 
provoked  >outhful  revolt  against  authority  in  many  parts  of  the  society 
and  the  culture.  But  even  after  the  war  ended,  there  remained  a  linger- 
ing hostility  to  science,  technology,  and  reason — as  though  these  were 
the  root  causes  of  the  hated  war. 

As  the  1980s  opened,  it  appeared  that  this  wave  of  anti-intellcctual- 
isrn  fjad  spent  itself,  for  complaints  about  the  schools  suggested  entirely 
different  concerris.  The  uell  publicized  decline  in  Scholastic  Aptittide 
Tc*>l  \SAT/  scores  created  a  context  for  worrying  about  a  national  deteri- 
oration in  the  quality  of  education.  Not  that  the  SAT  scores  were  impor- 
tant in  themselves,  but  the>  provided  a  sense  of  a  pattern-in  the  carpet 
that  had  nut  previously  been  definable.  For  several  years  college  officials 
had  reported  a  steady  increase  in^  the  number  of  freshmen  who  read 
p<K>rly  and  wrote  atrociously,  the  phenomenon  of  remedial  reading?  and 
rcnicdial  writing  classes  spread  throughout  higher  education,  even  to 
elite  mUitutions.  The  apparent  explanation,  at  first,  was  that  so  nriany 
ncu  students  from  pour  families  had  begun  to  attend  college,  but  analy- 
tht  SAT  drop -showed  that  the  score  decline  continued  long  after 
iU  Sucju  economic  profile  of  the  college-going  population  had  stabi- 
lised Bits  and  pieces  of  evidence  from  other  sources  began  to  fit  to- 
Rrthtr  OlFier  standardized  measures  of  academic  ability  reported  score 
'Whncs  paralleling  the  SAT's.  National  newsmagazines  discovered  a 
writing  crisis  and  a  literacy  crisis.  Educational  malpractice  suits  were 
by  disgruntled  parents  because  their  children  had  received  a  high 
''-ol  diploma  in  spite  of  being  "functionally  illiterate.**  The  Council 
*  ■  iuMc  Education,  a  lonely  voice  for  liberal  education  since  its  found- 

'i'f^  IO>S.  found  itself  back  in  the  educational  mainstream,  while  still  a 

'"N  voice  for  liber  J  education.  Demands  for  minimum  competency 
•-i'*  V  ,  rncd  to  spring  up  spontaneously  in  almost  fevery  state,  ihouu}^  ^^^^ 

*        'jrj;anization  existed  to  promote  or  coordinate  the  movement 
'M.cern  for  educational  standards  spread  in  the  middle  1976s.  do- 

^  'I  testing  grow — not  only  minimum  competency  tests  for  hijih 
^'  '  '  C-^duation  but  tests  at  critical  checkpoints  in  the  lower  grades 
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and  tests  for  would-be  teachers.  Reaction  agauiSt  these  demands  was  not  • 
long  m  coming.  The  assault  upon  standardixed  testing  was  led  by  con- 
sumer activist  Ralph  Nader  and  the  National  Education  Association.  Na- 
der released  a  lengthy  attack  on  the  credibilHv  9f  the  SAT,  the  rnosl 
widely  used  college  admission  test,  and  lobbied  successfully  in  New  York 
Stale  and  elsewhere  for  passage  of  a  *'truth'in-testing"  law. 

While  it  did  gene'':ite  controversy,  the  dispute  over  testing  was  su- 
perficial, for  tests  uere  neither  a  cause  of  nor  a  remedy  for  the  under- 
lying malaise  in  American  education.  Nearly  all  the  educational  con- 
troversies of  the  19T0^wliether  over  bilingualism  or  sex  education  oj  . 
testing  or  open  admisbiuns  or  busing— dealt  with  some  aspect  of  the  edu-  , 
cational  process  that  was  of  great  importance  to  sop*e  constituency,  but  ^ 
none  directly  raised  these  questions.  UTiat  do$»<t  mean  to  be  an  edu-  . 
cated  persorl?  Wliat  knowledge  is  of  most  worth?  Are  the  graduates  of  , 
uur  schools  edu^^ated  people? 

The  very  absence  of  such  questioning  suggests  a  failure  in  educa 
tional  thmkini;.  Educators  and,  most  especially,  educational  policy- 
makers have  fallen  inti;  the  habit  of  analyzing  school  issues  almost  en- 
tirely in  sociological  and  economic  terms.  In  recent  years  it  has  been 
customary  to  think  of  schooling  as  a  quantifiable  economic  good  to  be 
distributed  in  accordance  w  ith  principles  of  equity  or  in  response„to  po- 
litical demands.  The  sociological-economic  perspective  h^s  come  to 
dominate  educational  discussion  and  has  informed  public  policy  With- 
out douht  It  has  coritnbuted  to  necessary  changes  in  patterns  of  school- 
ing, by  redirecting  resources  m  a  fair  manner  and  by  opening  up  access 
to  educational  opportunities.  But  the  functionalist  perspective  became 
dysfunctional  when  it  crowded  substantive  educational  concerns  off  the 
policymakers*  agenda,  when  the  desire  to  keep  student^  in  school  was 
unaccompanied  by  interest  m  what  they  would  lea.n  while  they  stayed 
in  school.  What  1  am  suggesting  here  is  not  a  conflict  between  the  func- 
tionalist perspective  and  the  educational  perspective,  but  the  danger  of 
analyzing  the  schools  through  only  one  of  the  two  prisms  There  has 
t)een  a  fairly  pe/sistent  tendency.  1  would  argue,  to  neglect  the  role  of 
schools^  educational  institutions,  to  treat  them  as  sociological  cookie, 
•cutters  without  regard  to  the  content  of  their  educational  program 
When  I  consider  why  this  is  so.  I  conclude  that  there  are  several  possible 


explanations.  '  J 

First,  the  sociological  perspective  has  become  dominant  because  it 
relies  on  quantifiable  data  that  are  accessible.  It  is  far  easier  to  gain  in- 
formation about  years  of  educational  attainment  and  socio;economic 
status  than  it  is  to  ascertain  thp  conditions  of  learning  m  any  given 
school.  Educators  cannot  agree  on  how  to  ascertain  the  educational  cli- 
mate or  even  on  what  should  be  learned  Thus  it  becomes  irresistible  to 
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deal  uith.  *perhaps  even  becume  the  captive  of,  data  that  are  both  avail- 
able and  measurable. 

Second,  tjie  suciulugical  perspective  is  a  useful  adjunct  to  the  concept 
of  the"j>clit-»ol  a.s  d  tool  of  social  refornj.  B>  checking  on  who  is  in  school 
dSkd  for-liuvv  nuiuy  years,  and  on  how  their  social  background  relates  to 
their  choice  of  occupation,  we  can  atttnipt  to  monitor  how  educational 
resources  are  allocated  and  whether  schooling  is  contributing  to  social 
progress.  While  it  is  neither  new  nor  unusual  to  regard  the  school  as  a 
h  vtr  4>f  social  reform- ft  is  unusual  and  perhaps  unwistj  to  see  the  school 
^okhj  as  a  tool  of  social  reform  and  soldy  as  a  resource  tu  be  redistrib 
uted  One  cunscque^cc  is  that  the  schooKs  diploma  is  confused  with  the 
learning  tl^at  it  is  supposed  to^rcpresent.  In  recent  years  policv  makers 
have  sought  tu  equalize  educational  attainment  ^>ear^^  schooling) 
without  regard  to  the  quality  of  education.  This  is  like  putfing  people  on 
a  diet  of  ei^Ltciu  hundred  calories  a  da\  without  caring  whether  they 
arc  c  .isuming  junk  food  or  nutritious  food.  Years-of-schooling,  or  a  di- 
ploma, has  been  treated  as  an  end  m  itself.  Thus  we  have  seen  courts  re- 
quire s(.h«iul  districts  to  present  a  diploma  to  students  who  could  not 
mt  et  ininirnum  state  standards  of  literacy,  as  if  it  was  the  diploma  itself 
thiv  net'ded  rather  than  the  learning  that  the  diploma  is  supposed  to  sig- 
nify When  schuul  ref<irinrrs  in  the  nineteenth  century  advocated  uni- 
versal education  as  a  wav  of  improviiig  society,  they  meant  a  broad  dif- 
fusion of  kfiovvleJge  and  wisdom,  not  a  broad  diffusion  of  diplomas. 

Third,  educational  anaI>sLs  have  relied  on  the  sociological  perspective 
because  it  is  easier  to  raise  the  levef  of  educational  attainment  than  it  is 
to  raise  the  level  of  educational  quality.  Staying  in  school,  not  dropping 
out,  and  getting  a  diploma  represent  a  clear,  unambiguous  goal  that 
everyone  can  understand  without  quarreh  As  ^oon  as  school  officials  be- 
gin to  define  what  should  be  taught  and  learned  during  those  vears,  dis- 
agreements arise  which  are  best  settled  by^ making  the  schools  all  things 
for  all  people. 

Fiii  these  reasons  and  others,  educational  policymakers  have  tended 
to  view  schooling  as  an  instrument  to  achieve  some  other  goal,  only 
rarelv  as  an  end  m  itself.  To  the  extent  that  they  do  so,*the>  [ob  school- 
ing of  the  very  attnbutes  that  give  it  power.  If  a  young  man  or  woman 
Jias  a  hmh  school  diploma  buf  can  scarcel)  read  or  write,  then  the  di- 
ploma worthless.  When  a  diploma,  either  at  the  high  scliool  or  college 
level,  represents  a  certificate  of  time  served  but  not  of  the^vstemat|c  de- 
velopment of  intelligence  and  skill,  then  it  is  difficult  to  know  why  it 
should  have  any  inherent  value.  And  of  course  it  does  not: 

An  educational  critique  of  schooling  would  have  as  its  starting  pcint, 
1  believe,  the  idea  that  the  essential  purpose  of  schooling  is  to  develop 
the  puwers  of  intelligence,  thinking,  reflecting,  obscrv  mg.  imagining,  ap- 
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preciatirig,  questioning,  and  judging.  Be>ond  that,  schooling  has  many 
additioryil  purpuses  and  serves  m^ny  additional  purposes,  both' for  the 
student  and  fur  societ).  Educational  literature  teems  with  lists  of  the 
man\  \va>s  in  which  sch^^uls  sliuuld  meet  individual  and  social  needs.  But 
the  schools'  first  purpose  is  to  ci^f^j^ge  and  guide  each  person  in  the 
cultivation  otintelligeiiJe  and  the  development  of  tajents,  interests,  and 
abilities.  Schools  do  rnauv  other  things  as  well;  they  may  provide  food, 
social  seriTces,  ps>chological  ser\ices,  medical  care,  and  career  guid- 
ance. But  iiu  matter  huw*welLorJiow_poorlv  they  fulfill  these  functions, 
the-sohools  must  bcjudged  in  the  first  instance  b\  how  well  the\  do  those 
things  that  oiilv  they  can  do.  We  expect  the  schools  to  teach  children 
command  of  the  fuiidamejital  skills  tha^  are  needed  to  continue  learn 
ing— in  particulJtgtthe  ability  to  read,  write,  compute,  spbak,  and  listen. 
Uncc  the\  have  Mnmand  uf  these  skills,  they  should  progress  through  a 
curnculum  designed  to  eiil.arge  their  powers.  Such  a  curriculum  would 
contain,  for  ever>  student,  hiitor\  and  social  studies,  language  and  litera- 
ture, mathematics*  science,  and  the  arts.  Students  need  to  learn  these 
skills  and  disciplines  in  schoul  because,  except  for  those  rare  individuals 
v\;ho  can  educate  themselves  w  ithuut  a  teacller,  they  are  unlikely  to  have 
another  chance  to  do  so.  -s.  ,  ^ 

The  scJ-iools  are  responsible  boTlrforl)re\erving  a  sens^of  the  past 
and  for  pru\idmg  the  abilit)  to  tlimk  about^  and  function  in, <the,  present 
and  the  future.  More  than  any  uther  educational  agenc\,  they  ought  to 
have  an  intelligent  understanding  of  the  inexorable  connection  between 
past,  present,  and  future.  Certainly  there  is  disagreement  about  the 
meaning  of  the  past  and  how  it  relates  to  th  present  and  the  futurg,  and 
awareness  of  such  disagreenientjs  often  invoked  to  justify  educational 
aimlessness.  Rut  m^xb  of  what  seems  to  be  dissensior^  is  a  chimera,  dem- 
ocratic  debate  pught  not  to  be  confused  |ith  chaos,  hor  should  {3lural- 
istic  politics  be  confused  with  anarch).  E4ucation -proceeds  from  wddyt 
shared  values,  and  we  do^  in  fact,  have  v)idely  shared  values  We  may 
not  agree  about  how  democracy  is  to  be  achieved  and  about  whether  we 
have, too-much  or  too  httle  of  it,  but  few! would  question  the  idea  tbat 
-each  person  has  the  right  as  a  citizen  to  ^participate  in  the  shaping  of 
public  issues.  We  believe  in  the  idea  of  selfrgovernment  and  in  the  great- 
est possible  involvement  of  ciluens  as  vojers,  as  v.olunteers  in  commu- 
nity otganuatiuns.  asvmembers  of  mterest|groups,  imd  as  spokesmen  for 
different  views.  While  w5  may  differ  over  particular  educational  issues, 
there  is  general  support  for  the  idea  that  sqhooling  is  a  necessary  mecha- 
nism for  achieving  society's  goals  to  prepare  the  younger  generation  to 
be  thoughtful  utuen^*  to  enable  each  pQi^on  to  appreciate  and  <^0"^"b~^ 
ute  to  tRe  culture,  to  parpen  the  intellec  ual  and  aesthetic  sensibilities' 
for  lifelong  enjoyment*  to  develoi):reacf\neis  fof  the  educational,  occupa- 
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tjonal.  and  professional  choices  thai  each  person  uill  confront,  to  kindle 
a  icrisc  ot  responsibility  for  others  and  a  sense  of  integrity,  toHeach  chil- 
ly dren  how  tu  lead  and  how  tu  follou,  and  to  acquaint  \  oung  people  u  ith 
the  best  models  of  achievcnrient  lu  e\er)  field  while  encouraging  them  to 
strive  to  realize  their  own  potential,  * 

If  these  are  \Mdel\  shared  educational  aims,  and  I^^elieve  thev  are, 
then  none  of  them  should  be  left  to  chance.  The  curriculum  should  be 
•designed  so  that  every  student  has  the  fullest  opportunity  to  develop  his 
puwcrb»  iiitelhgeriLe.  interests,  talent,  and  understanding.  Every  s^tudent 
needs  to  know  hou  tu  form  and  formulate  his  own  opinions  To  d(j  so/he 
must  learn  how  to  read  criticall),  how  to  e\ahiate  arguments,  l|ow^"to- 
weigh  e\ide!ice,  and  how  iij  reach  judgments  on  his^own.  Every  stjident, 
i'j  understand  the  world  in  which  he  will  be  a  participant,  sho^^ld  be 
kn«A\h'di;eahIe  about  histor>,  should  master  son.c  otlier  language  as  well 
,  as  his  own.  should  discover  the  .pleasures  of  literature*  especialK  its 
^  power  to  reach  across  time  and'Ct/ltures  and  to  awaken  our  sense  of  uni- 
\ersalit\  sh'>uld  stud>  suence  anditechnolog) ,  both  as  a  citizen  who  w  ill 
bt*  asked  to  comprehend  uniip\i;S  issues  and  as  an  indivKlual  who  must 
with  constant*  chanut'^  Sin^4  we  belie\e  that  everyone  sho»'ld  be 
equalK  c«»ncerned  abotit  the  problems  of  our  societ>»  then  we  must  be-. 
Iie\e  that  everyone,  every  student,  should  be  schooled  m  a  way  that 
meets  hfs  need  to  kfiow  historv.  science,  mathematics,  language,  the  arts, 
literature,  and  so  oi.  And  vet  it  is  not  siniplv  on  the  grounds  of  utility, 
relevance,  and  pf.litical  value  that  the  case  for  liberal  education  rests 
Wo  do  not  Ufx-d  to  know  ho^v  to  read  Shak(?speare.  we  can  be  good  citi- 
zens_.^vS^o'ut  an\  knowledge  of  Athenian  civilization,  even  though  our 
'  'concept  of  citizenship  is  ba.ed  on  the  very  period  oi  which  we  are  igno- 
rant We  m.usl  conceni  ourselves  with  the  survival  of  histor\,  philo$oph>, 
literature,  and  those  other  disciplines  that  ina>  lack  immediate  utility 
because. without  them  ours  would  be  an  inteliectually  impoverTshed  and 
^puUualh  illiterate  civilization. 

To  some  people,  all  tins  is  so  self-evident  that  it  ought  not  be  neces- 
sary to  plead  for  the  value  of  an  education  of^substance  and  content  Yet 
It  IS  necessary,  because  of  the  widesprcad  disarrav  in  high  school  and  col- 
lege curricula,  in  the  face  of  chartges  that  have  occurred  in  the  past  de* 
L\u\r  uT  so.  manv  edticators  seem  unable  to /emember  how  to  justif)  or 

 tW«'.i4tU>r-diampion  liberal  edueation.  Tho-pr^^position  that  all  students 

sh<iuld  be  subject  to  curricular  requirements  that  define  the  essentials  of 
a  '4ood  education  has  beconie  controversial,  rather  than  a  starting  point 
m  de-fmrnu  ihv  natun-  i>f  a  good  curriculum. 

(  f>nfronted  with  ctiiifiutiiig  den.toiidiJr^^nt  those \vho  want  reduced 
rt'fiuir' mf  iits  and  those  who  want  curricular  substance,  manv  schools 
Lav^  rt-MiKed  the  dilemma  bv  rec!ueinu  requirement  while  expanding 
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electives.  Thus  students  may  lake  histor>  courses  to  meet  their  minimal 
graduation  requirement,  but  mav  choose  history  courses  that  are  h'ttle 
more  than  classes  in  current  events.  Or  the>  ma>  meet  their  English  re- 
quirement by  reading  popular  fiction,  mystery  stories,  and  science  fic- 
tion. There  is  no  harm  in  what  is  included,  from  the  perspective  of  a 
eral  education,  what  is  unfortunate  is  the  vMde  bod>  of  knowledge  that  is 
excluded  when  course  proliferation  and  lax  requirements  are  joined  to- 
gether. Professors  regularly  encounter  students  who  are  ignorant  of  any- 
thing that  happened  before  the  Civil  War  as  well  as  anything  that  hap- 
pened, or\vas  \sntten,  outside  the  United  States.  They  ma>  have  heard 
of  Plato  and  Aristotle  in  a  survey  course,  but  the>  have  never  read'any- 
thing  written  by  either  and  have  onl>  a  dim  notion  (usually  wrong)  of 
what  the>  "stood  for."  Mention  Dickens,  Tolstoy,  Conrad,  or  Melville, 
and  they  have*  heard  of  them  too,  but  the>  *'didn*t  take  that  course.  " 
Some  professors  who  teach  literature  have  been  astonished  to  find  stu- 
dents who  know  nothing  of  m>tholog>  or  the  Bible,  allusions  to  Job  or 
Icarus  must  be  explained  to  those  who  have  no  Intellectual  furniture  in 
their  minds,  no  stock  of  literar)'  or  historical  knowledge  on  which  to 
dtaw  beyond  their  immediate  experience.  In  a  recent  issue  of  Common- 
weol,  J.  M.  Cameron  soberly  observes  that  if  Freud  attended  school 
todav,  he  might  not  be  able  to  think  up  the  Oqdipus  theory  because  he 
would  not  have  enough  m>tholog>  in  his  head  to  do  so.  We  seem  now  to 
turn  to  television  or  the  movies  to  teach  the  histor^  and  literature  that 
were  neglected  in  school.  To  permit  Liov\  ledge  to  be  fragmented,  as  we 
have,  bv  serving  it  up  cafeteria-style,  with  each  perSon  choosing  whether 
to  be  minimally  literate  or  to  be  a  specialist,  contributes  fo  the  diminu- 
tion and  degradation  of  the  common  culture.^ 
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AMERICAN  COUNCIL  ON  EDUCATION 
ONE  OUPONT  CIRCLE 
WASHINGTON.  O  C  2009* 


o^riCKo^TMc^NKsioiNT  <i  '  August  20,  1981 


The  Honorable  Carl  0,  Perkins 
Chairman,  Conmittee  on  Education  and  Labor 
U.  $.  House  of  Representatives 
Washington,  0;  C.  20510 

Dear  Kr.  ChairnianJ 

On  behalf  of  the  Anerican  Council  on  Education,  representing  over  1,400 
colleges,  universities,  and  the  higher  education  associations  listed  below  we 
hereby  request  that  this  letter  be  included  in  the  hearing  record  pertaining  to 
HR  1662,  The  Educational  Testing  Act  of  1931.    As  organizations  whose  members 
include  nearly  all  of  the  colleges  and  universities  in  the  nation," we  are 
troubled  bv  this  proposed  legislation  and  concerned  about  the  impact  its 
enactment  would  have  on  the  admissions  process  at  colleges  and  universities. 

We  recognize  that  faculty,  students,  parents,  and  ethers  have  a  genuine  and 
'  legitimate  interest  in  the  nature  and  use  of  thft  standardized  tests  that  play  a 
role  in  the  admissions  process  eit  many  higher  education  institutions.  During 
the  past  four  decades,  such  tests  have  proven  to  be  useful  at  many  institutions 
in  assessing  students'  potential  for  completing  undergraduate,  graduate,  and 
professional  programs  of  study.    In  many  instances,  test  results  have  been  es- 
pecially helpful  to  students  who  attended  schoolSf  and  colleges^not  well  known 
to  admissions  cotrmittees  and  to  those  whose  prior  educational  work  did  not  re- 
flect their  full  potential  for  further  study. 

At  the  outset  we  wish  to  make  it  clear  that  while  acknowledging  the  in- 
terests of  students  and  others  in  the  nature  and  use  of  such  tests  and  con- 
curring with  some  of  the  stated  goals  of  the  proposers,  we  believe  that 
Congress  should  not  enact  any  legislation  at  this  time.   Portions  of  HR  1662 
are  unnecessary  in  that  they  simply  codify  the  current  practices  of  most  test- 
ing programs  and  make  no  significant  changes  or  improvements.    Further,  the 
proponents  of  HR  1662— which  would  require  the  disclosure  of  test  questions  and 
answers  after  each  test  administration—have  not  demonstrateU  the  need  for  this 
major  change  in  test  program  procedures  on  the  basis  of  demonstrated  educa- 
tional benefits  to  students,  on  a  definitive  analysis  of  relative  costs 
and  benefits  to  students  or  institutions,  or  on  well -documented  instances  of 
improper  or  harmful  past  practices.    Finally,  the  portions  of  HR  1652  that 
require  test  agencies  to  make  public  all  studies  conducted  on  behalf  of 
individual  colleges  would  either  impose  unwarranted  costs  on  colleges  and 
universities  or  severely  limit  the  ability  of  colleges  to  develop  admissions 
procedures  that  best  serve  the  needs  of  both  'students  ^and  institutions. 

Historically,  Congress  has  shown  an  admirable  reluctance  to  legislate 
natters  at  the  heart  of  education  and  curriculum.    College  admissions  pro- 
cedures (inducting  the  evaluation  of  test  results)  are  an  outgrowth  of  and  a 
reflection  of  the  mission  and  goals  of  each  institution;  the  information  re- 
quired from  each  student  applicant  properly  reflects  the  curriculum  and 
requirements  of  the  institution  and  the  educational  program  to  which 
application  for  admission  is  made.   The  subject  of  the  proposed  legislation  is 
an  educational  matter  and  properly  the  province  of  the  faculty  of  each 
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institution.    Although  the  proposers  disclaim  any  intent  to  interfere  with 
admissions- procedures,  it  is  our  .view  that  legislation  which  makes  testing  a 
more  costly  process  or  which  may  affect  the  usefulness  of  test  results  to 
colleges  and  universities  does  in  fact  interfere  with  adraissions.  Furthertnore, 
the  history  of  legislative  and  regulatory  practices  raises  fears  that  this  step 
threatens  not  only  interference  with  one  factor  in  the  admissions  process  but 
makes  all  others  vulnerable  to  further  regulations. 

The  enactment  of  legislation  in  any  area  not  previously  subject  to  legis- 
lation suggests  the  existence  of  an  undesirable  and  Intolerable  condition  that 
can  and  must  be  remedied  by  law.    Do  such  conditions  exist  in  the  area  of  edu- 
cational admissions  testing?   We  think  not  and  do  not  believe  the  proponents  of 
tne  bill  mmhfore  you  have  carried  their  burden  of  demonstrating  a  clear  need 
for  such  legislation, 

*  Today,  qualiflejl  students  have  greater  ac:ess  to  higher  education  in  the 
United  States  than  ever  before.    More  than  90  percent  of  the  stiidpnts  currently 
seeking  admission  to  undergraduate  study  are  admitted  to  the  coirege  ot  their 
first  choice;  more  than  95  percent  are  admitted  to  some  college.    As  the  number 
of  18-year  olds  declines,  more  aqd  more  undergraduate  institutions  can  be  ex- 
pected to  use  test  results  for  inclusive  purposes  to  help  identify  and  admit 
all  students  able  to  complete  undergraduate  programs  of  study  rather  than  to 
exclude  those  who  appear  less  lively  to  do  so.    At  the  graduate  and  profes- 
sional levels,  most  institutions  have  already  recognized  the  desirability  of 
broadening  their  student  bodies  and  have  achieved  diversity  through  vigorous 
programs  of  affirmative  action,  special  academic  assistance,  and  multiple  cri- 
teria for  admissions.    This  has  occurred  in  the  absence  of  legislation 
concerning  the  use  of  admissions  tests. 

hR  1662  prescribes  specific  items  of  information  about  each  admissions  test 
that  must  be  provided  to  students  when  they  register  for  the  examination.  This 
provision  is  unnecessary,  in  our  judgment  all  the  relevant  information  i$ 
alrea^dy  provided  to  students. 

The  sponsors  of  admissions  tests  regularly  provid::  Information  about  the 
nature  of  standardized  tests  and  their  content.    The  disclosure  of  test 
questions  and  their  correct  answers  is  now  an  operational  policy  of  many  major 
test  sponsors.    Those  test  agencies  which  have  found  it  possible  to  dQ'so^have 
already  instituted  the  disclosure  of  test  materials  throughout  the  nation. 
Test  registration. booklets,  among  other  things,  include  information  about  the 
nature  of  these  tests,  the  Interpretation  of  test  results,  scoring  procedures, 
standard  error  of  measurement,  validity,  te^t  disclosure,  prwacy  of  scores, 
test-score  appeal  procedures,  and  special  services  for  handicapped  students. 
In  addition,  reports  and  statistical  data  about  testtakers,  test  revenues  and 
expenses,  where  not  confidential  or  precluded  from  release  by  a  contracting 
agency,  are  already  Available  to  interested  parties. 

No  persuasive  evidence  has  been  presented  to  suggest  that  test  agencies  are 
now  handling  student  test  s^ores  improperly.    To  the  best  of  our  knowledge,, 
test  results  are  currently  sent  In  identified  form  only  to  institutions  and 
agencies  designated  by  the  student— either  by  a  specific  request  or  by  a 
general  permission  applying  to  scholar<;hip  programs,  special  infojfmation 
services,  and  the  like. 
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It  IS  unwite  to  attempt  to  regylate  the  publication  of  research  results. 
Results  from  studies  of  test  validity  that  are  of  general  interest  and  applica- 
bility should  be  and  normaHy  are  published  and  widely  distributed.    Section  4 
of  HR  1662  seems  an  ineffective  and  objectionable  way  to  accomplish  this  end. 
The  requirement  that  researchers  associated  with  admissions  testing  programs 
publish  all  of  their  work  is  at  odds  with  conrionsense  and  standards  of  good 
scholarship.    Certainly,  distinctions  must  be  made  •between  preliminary  and 
final  reports,  between  memoranda  and  more  extensive  treatments  or  analyses; 
between  papers  prepared  to  stimulate  discussion  and  those  that  present 
conclusions  resulting  from  the  discussions. 

Each  year  more  than  1,000  studies  of«»test  validity  and  related  matters  are 
conducted  bty  or  on  behalf  of  individual  colleges  and  universities;  each 
involves  students  enrolled  at  a  single  institution  and  each  examines  the  use- 
fulness of  admissions  test  results  in  conjunction  with  other  relevant  infor- 
mation about  the  students  as  they  relate  to  indicators  of  program  completion 
and  achievement  at  that  institution.    Currently,  the  results  of  these  studies 
are  available  to  faculty  and  admissions  officeri>  at  that  institution  for  their 
use  in  developing  appropriate  admissions  procedures.    None  is  of  interest 
beyond  that  institution,  none  necessarily  has  relevance  for  students  at  other 
institutions.    Yet,  section  4  of  HR  1662  requires  that  all  studies  of  test  ^ 
validity  be  made  public  if  they  have  been  conducted  by  a  test  agency  on  behalf 
of  the  institution  or  if  they  have  used  data  obtained  from  a  test  agency. 

Individual  institutions  should  be  encouraged  to  conduct  such  studies.  The 
public  filing  requirement  of  section  4  of.  HR  1662,  however,  is  likely  to  dis- 
courage these  efforts.    The  test  agency  studies  prepared  for  an  institution 
consist  largely  of  tabular  material.    They  lack  the  interpretive  context  that 
IS  known  to  admissions  committees  and  therefore  would  be  either  unintelligible 
or  uninfonnative  to  other  readers.  It  would  serve  no  purpose  to  require  the 
puutication  of  such  studies. 

In  developing  test  questions  the  threats  of  ambiguity,- bias,  and  faulty 
reasoning  are  always  present—whether  the  wr'ter  is  a  teacher,  scholar,  or 
professional  item  writer.    All  test  agencies  conduct  a  review  of  admissions 
test  items  prior  to  their  first  use  with  students  in  order  to  minimize  the 
possibility  that  these  threats  to  test  validity  will  obscure  the  actual  abili- 
ties of  the  students.    The  review  conducted  by  persons  familiar  with  the  test 
content  and  skills  is  ar^  important  step  in  the  development  ot  quality  examina- 
tions, but  many  persons 'are  not  familiar  with  the  procedures  used  or  with  the 
qualifications  of  the  reviewers.    Perceptions  that  admissions  testiiig  programs^ 
are, shrouded  in  mystery  and  secrecy  could  be  changed  if  test  sponsors  prepared 
and  distributed  detailed  descriptions  of  the  review  process  used  in  developing 
their  tests.    The  prompt  move  to  correct  errors  on  national  exams  in  recent 
months  has  gone  a  long  way  in  further  installing  confidence  in  the  equity  of 
the  testing  system.    Test  agencies  might  give  consideration , to  the  more 
widespread  adoption  of  the  practice  of  involving  qualified  reviewers  nominated 
by  national  associations  of  teachers  and  faculty. 
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We  appreciate  the  opportunity  to  present  our  views  to  your  corrmittee  and, 
stand  ready  to  respond  to  any  questions  that  you  or  your  staff  may  have. 


Cordially, 


W.  Peltason 


The  following  associations  wish  to  join  in  this  statement: 

American  Association  of  State  Colleges  and  Universities 

American  Council  on  Education 

Association  of  American  Colleges 

Association  of  American  Universities 

Association  of  Catholic  Colleges  and  Universities 

Association  of  Jesuit  Colleges  and  Universiti'es 

Council  of  Graduate  Schools  in  the  United  States 

National  Association  of  Independent  Colleges  and  Universities 

National  Association  of  State  Universities  and  land-Grant  Colleges 


cc*   Mernbers  of  the  Committee 
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Amehican  Medical.  Association 


The  Hoiiorablc  Carl  D.  Perkins 

CooaUcce  on  Educadon  and  Labor 
2181  Rayburn  House  Office  Build ln$ 
Washington.  D.C.  20515 


RE:    H.R.  1662, 

"The  Educational  Testing  Act  of  1981" 


Dear  Hr.  Chalrnan: 

The  Aaerlcan  Medical  ^Association  takes  this  opportunity  to  register 
Its  opposition  to  H.R.  1662.    This  proposed  legislation  nandates  that  an 
individual  who  had  taken  a  standardized  test  that  was  adolnlttered  to 
'  5,000  or  nore  people  would  be  able  to  receive ^a  copy  of  the  teat,  the 
correct  answers,  and  his  or  her  answer  sheet.    In  addition.  Information 
concerning  the  Purpose  and  Intended ^se  of  the  test,  the  subject  matter 
of  the  exaalnatlon  and  what  It  purports  to  measure,  and  the  reliability 
of  the  exaa  would  be  provided  to  potential  test  takers. 

The  AMA  supports  the  elements  of  the  bill  that  would  help  establish 
requirements  to  Qxplaln  the  purpose  and  use  of  standardized  testing,  and 
that  would  allow  the  Secretary  of  Education  Statistically  to  analyze  the 
results  of  such  testing,  'the  A— Delation  is  concerned,  however,  that 
H.R.  1662  would  adversely  affect  the  quality  of  standardized  tests,  and 
\  ^  m  particular,  the  quality  of  the  Medical  Coll<ige  Admissions  Test  (MCAT) 
to  the  detriment  of  schools,  .students,  ahd  thft  public. 


One  of  the  major  problems  of  releasing  test  questions  It  the  neces- 
sity of  developing  new  qu«JStlons  for  subsequent  testing.    In  developing 
standardized  tests  that  are  designed  to  measure  narrowly  defined  oreas  of 
knowledge,  such  as  the  scientific  segment  of  the  MCAT,  the  poteudal  for 
the  creation  of  valid  questions  Is  not  nearly  as  extensive  as  exists  In 
devel>5plng  a  test  to  measure  general  knowledge  or  verbal  ability.  Fur- 
thermore, to  create  a  statistically  valid  question  for  a- standardized 
Lest    a  cocuaon  procedure  U  to  pretest  the  question  within  an  examination 
without  considering  the  answer  in  determining  the  test  taker  s  score. 
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The  disclosure  provisions  of  H.R.  1662  would  make  ic  impossible  Co  main- 
tain the  integrity  and  validity  of  test  questions,  including  the  pretest 
questions.    New  questions  would  have  to  be  developed  wlr.hout  the  cus- 
tomary pretesting,  and  this  could  adversely  impact  upon  the  validity  of 
the  examination  as  a  testing  device. 

While  the  AMA  is  not  involved  in  test  development  or  aduinistration, 
we  have  long  sought  to  encourage  rhe  highest  standards  of  medical  educa- 
tion.   Those  standards  can  best  be  met  by  students  who  are  qualified  to  • 
undergo  a  long  and  rigorous  course  of  medical  education.    Even  with  the 
variety  of  measuring  criteria,  it  is  difficult  to  evaluate  a  student's 
potential  for  academic  success  in  a  medical  education  program.  Admiscion 
to  medical  school  is  determined  by  many  factors,  and  not  based  solely  on 
the  basis  of  a  standardized  examination.    Other  factors  used  in  evalu- 
ating potential  medical  school  students  include  undergraduate  academic 
performance,  personal  interviews  and  faculty  recommendations.  Nonethe- 
less, testing  is  very  important  in  the  admissions  process  because'lt  is 
the  single  measure  that  is  independent  of  local  variables,  such  as  degree 
of  undergraf^uate  program  difficulty,  institutional  grading  practices  and 
standards^  and  the  academic  ability  of  the  applicant's  peer  group. 

Coupled  with  individual  judgment,  experience,  and  creativity,  a 
physician  must  utilize  scientific  knowledge,  observational  skills,  and 
problem-solving  ability  to  provide  medical  care  properly.    To  the  degree 
that  standardized  testing  can  aid  in  identifying  any  of  these  charac^ 
tcristics,  the  tests  do  serve  a  valid  purpose.    The  imposition  of 
specific  disclosure  requirements  could  make  it  extremely  difficult  to 
develop  and  administer  tests  that  will  be  effective  in  achieving  their 
objectives.    We  are  concerned  that  the  disclosure  requirements  could 
prove  deTr'imental  to  an  established  methodology  that  has  been  success- 
fully utilized  in  the  process  of  selecting  qualified  medical  students. 

We  urge  the  Subcommittee  not  Co  adopt  H.R.  1662.  ^ 


Sammons,  M.D. 
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THE  ASSOCIATION  OF  AMERIQW  VETERINARY  MEDICAL  COLLEGES 


July  24,  1981 


The  Honorable  Carl  D.  Perkins,  Chairman 
Subcommittee  .on  Elementary,  Secondary, 

and  Vocationrfl  Education 
Committee  on  Education  and  Labor 
U.S.  House  of  Representatives 
B-346-C  Rayburn  House  Office  Bldg. 
Washington,  D.C.  20515 

Dear  Mr.  Perkins*. 

Enclosed  is  a  statement  of  the  Association  of  American  Veterinary 
Medical  Colleges  on  H.R.  1662.   We  regret  that  we  could  not  request  an 
opportunity  to  present  our  views  at  the  hearings  of  your  subcommittee  and  the 
Subcommittee  on  Postsecondary  Education  on  July  21  and  22.^ 

Ssnce  we  are  vitally  concerned  with  this  matter,  we  would  appreciate 
having  our  statement  included  in  the  record  of  the  hearings.  We  wiU  also 
provide  it  to  the  members  of  both  subcommittees.  Thank  you. 


Sincerely, 


Earl  0.  Dickinson,  D.V.M. 
President 


Enclosure 
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^    .    The  Association  of  American  Ve\crinnri/  Medical  Colleges  appreciates 
this  opportunity ,lo  present  its  vie^^  on  il.1l.  1662,  the  "Educational  Testing 
Act  of  1981." 

"Standardized"  examinn.tions  arc  given  for  a  number  of  reasons.   A  few 
of  the  very  important  ones  ore.    (1)  to  establish  "norms"  and  identify  those 
who,  for  whatever  reason,  are  at  the  extremes,  (2)  to  provide  soma  long- 
term  and  continuing  basio  for  comparisons  wl*idh  fuay^be  u§eful  in  evaluating 

^        *  .  ' 

the  total  system,  (3)  to  identify  "areas"  pf  strength  a^id  weakness  in  the 

examiijces  both  individually  and  collectively,  and  (4)  to  provide  another  element 
in  the  process  used  for  selection    Adr.iissions  groups  need  nil  the  help  they 
con  get  in  nioking  sound  judgments  on  selections  to  highly  competitive  programs, 
ano  licensing  boards  must  detcrfninc  competency  to  pe.form  and  render  reliable 
scxviwCj  to  the  consuming  public.  „In  a  purely  academic  setting,  the  educational 
v^uc  of  providing  feedback  on  cxamiraitions  has  proponents  and^opponents, 
but  in  that  settrng  there  is  general  iccognition  that  such  pioecdures  do  have 
cducationfil  value.    However  "Standardized  Testing"  as  ci^^bntly,  conducted, 
v;hethcr.  it  be  for  entry  to  the  university  or  for  professional  licensure  decisions, 
has  different  objectives.   The  state  and  national  dimensions  of  these  examina- 
tions also  imply  an  entirely  different  set  of  circumstances  than  that  for  an 
examination  in  a  given  course  in  a  given  educational  institution,  and  detailed 
feedback  ]s  not  essential.! 

Specifically,  the  Assoei(tion  of  American  Vetcrihary  Medical  Colleges 
speaks  against  the  proposed  legislation  because: 

(l)    We  .arc  not  convinced  that  such  proposals  would  solve  any  ills  that 
»        are  pereeive(?  as  current^  existing.   In  fact,  such  legislation  would 
be  complicating  and  counterproductive  to  the  overall  objectives  of 
standardized  testing  as  currently  practiced.  * 
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(2)  The  body  of  knowledge  is  extensive  ofid  sampling  is  essential.  As 

major  and  important  coneepts  are  tested  for  in  examinations,  new 

« 

test  iXems  w6uld  tend  toward  tl»e  trivial  if  questions  and  answers 
were  routinely  published.  , 

(3)  Flexibility  would  be  greatly  reduced.   Students  now  have  ah  oppor- 
^     tunity  to  take  a  number  of  examinations  in  varied  locations  at 

various  times.  .  For  example,  the  Voterinary  Aptitudq  Test  (VAT)  is 
currently  offered  5  times'  per  year.  There  would  bo  a  move  to  * 
many  fewer  offerings  per  year  and  in  the  iristanee  of  VAT  probably 
*  to  onee  per  year. 

(4)  The  impact  wouid  be  inversely  proportional  to  the  size  of  the 
group  affeeted.    For  example,  most  high  sehool  students  in  the 

-    United  States  take  the  SAT  and/or  ACT  test»  and  there  is  a 
relatively  low  development  eost  per  stCftfent  as  compared  with 
those  tests  for  mansj,  n^any  fewer  examinees,  e.g.,  human  medicine 
and  MCAT  and  veterinary  medicine  and  VAT  where  the  development 
cost  would  increase  significantly*    *     -        '  i  .  ' 

"(5)    There  would  be  a  great  waste  of  professional  time  in  the  redundancy 
of  new  examination  construction,  detracting  from  tlic  ijj)ility  to 
evaluate,  analyze,  and  improve. 
(6)    Tlie  tendency  to  produce  a  "levelling  effect"  in  test  performance 
is  a  grave  concern,  since  the  advantages  of  innate  ability  and  . 
concerted  study  effort  on  a  broad  front  would  tend  to  bo  negated. 
Fairness,  objectivity,  aiid  capriciousness  arc  not  in  contention  as  these 
arc  fundamental  and  obvious  concerns  of  socllty.    Examinees  need  to  know 
the  nature  and  use  of  examinations  and  to  be  assured  that 'lest  scores  accur- 
ately reflect  performone^.   Feedback  on  ureas  of  strength  and  weakness 
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should  be  QveilDblc.   Wc  believe  testing  6ervic(*'s  are  sensitive  to  these  matters 

Qnd^flre  i?ot  just  the  money-mongers  some  try  to  moke  then,  out  to  be. 

However,  the  profit  motive  is  as  real  in  providing  serviees  as  It  is  in  selling, 

hard  mejj|Qndise,  and  the  free  enterprise  r.ystem,  if  |t  is  to  obtain,  eannot 

K  battered  and  beat  by  the  very  hand  that  it  feeds. 

Evaluation  is  as  fundamei»tal  to  the  edueational  system  as  the,  jury  is  to 

the  judicial  system.    An  examination,  whieh  is  an  evaluation  deviee,  is  an 

exercise  to  determine  a  per.«;on*s  knowledge,  tibility,  and  qualifications  in  a 

/ 

prescribed  area  which  may  be  rather  broad  or  rather  limited  Jn*  scope.   If  a 
person  has  both  the  questions  or  problems  and  the  answers^thcre  is  in  effect 
no  examination,  and  the  fundamental  objective  of  the  whole  proccss—cvalua- 
tion— IS  negated.   That  the  system  is  iniptrfect  is  recognized  and  admiltcd, 
but  so  is^hc  political  system,  the  judicial  system,  or  ar{^othcr  system 

devised  by  imperfect  p'cople.   ^cforQ  the  systeni  is  radically'|^anipulatcd  it 

\ 

should  be  understood* as  it  is  being  used  and  with  the  full  rcc<)s^nitioD  of 
what  radical  changes  will  accomplish.  \ 


As  participants  and  educalors  in  a  health  profession  field,  we  support 
the  concept  of  standardized  testing.^  Concurrently  !t  should*  be  emphasized 
that  sucli  tests  arc  not  the  only  criterion  used  in  arriving  at  judgment 
decisions  which  must  be  made.  Rather,  test  results  arc  combined  with  other 
acadcfiiic  and  sociological  data  to  provide  a  breadth  of.  input  iff  helping  to 
evaluate  ability  and  motivation.  Discriminating  elcmcr\ts  need  to  be  honed 
and  refined  and  not  blunted  or  made  more  diffuse. 

The  Association  of  American  Veterinary  Medical  Colleges  can  sec  no 
benefit  to  students,  the  general  public,  edueational  institutions,  or  the  ' 
educational  testinji:  "industry"  from  this  bill,  and  we  question  whether  "the  bill 
wouiJ  have  the  effects  claimed  by  its  proponents.    We  believe  it  is  necessary 
•to  reject  this  bill  in  order  to  preserve  the  systems  of  graduate  professional 
Admissions  as  they  now  exist. 


THE  EDUCATIONAL  TESTING  ACT  OF  1981 


.   WEDNESDAY,  NOVEMBER  4,  1981 

*  ' 

House  of  Representatives,  Subcommittee  on  Elemen- 
TARv;  Secondary,, AND  Vocational  Education,  Joint- 
ly With  the  Subcommittee  on  Postsecondary  Edu- 
cation, Committee  oK.Education  and  Labor, 

-Washington^^D.C^ 


The  subcommittee  met,  pursuant  to  Adjournment,  at  10:00  a.m., 
in  ro%m  2175,  Rayburn  House  Office  Building,  Hon.  Ted  Weiss  pre- 
siding. 

Members  present:  Representatives  Weiss,  Erdahl,  Craig,  Wil- 
liams, and'Kildee. 

Staff  present:  John  F.  Jennings,  counsel;  William  Blakey,  coun- 
sel; and  Nancy  L.  Kober,  legislative  specialist. 

Mr.  Weiss.  We  will  commence  and  if  everyone  will  take  their 
seats  we  will  proceed. 

Let  me  at  the  outset  indicate  that  as  usual  there  are  more  things 
happening  around  here  than  there  are  members  to  do  them.  As  a 
result  with  King  Hussein  and  the  Budget  Committee  hearings  and 
so  on,  our  other  members  will  be  drifting  in.  Indeed,  the  chairman 
of  the  Postsecondary  Education  Subcommittee,  Mr.  Simon,  has  to 
be  at  a  suddenly  called  meeting  of  the  Budget  Committee  and  he 
will  probably  not  be  able  to  be  here  this  morning  but  asked  that 
his  opening  statement  be  entered  into  the  record  and  that  will  be 
done  at  this  stage  of  the  proceeding  without  objection. 

[Opening  statement  ofChairman  Simon  follows:] 

Opening  Statement  of  Hon.  Paul  Simon,  a  Representative  in  Congress  From 

THE  St.\te  of  Illinois  and  Chairman  of  the  Subcommittee  on  Postsecondary 
'  Educatio^n  ^  ^ 

This  past  summer,  the  Subcommittee  on  Elementary,  Secondary,  and  Vocational 
Education  and  the  Subcommittee  on  Postsecondary  Education  held  2  days  of  joint 
hearings  on  the  Educational  Testing  Act  of  1981  (H.R.  1662)  intruduced  by  Congress- 
man Ted  Weiss  of  New  York.  Interest  by  this  body  in  the  issue  of  Truth  in  Testing 
began  wifh  the  introduction  of  the  Truth  in  Testing  Act  of  1979  (H.R.  3564)  by  Mr. 
Gibbons,  our  colleague  from  the  Stale  of  Florida.  Many  of  us  have  participated  in  a 
numbej:  of  hearings  throughout  the  years  so^that  wc  could  become  fully  aware  of 
,  the  issues,'  and  the  pros  and  cons  related  witlj  the  enactment  of  test  disclosure  legis- 

lation at  the  national  level.  •  ,  . 

The  joint  hearings  that  we  held  this  past  July,  focused  on  testimony  regarding  the 
ffeld  of  test  and  measurement;  how  tests  are  utilized;  changes  occurring  in  the  area 
of  testing;  and,  experience  test  takers  of  standardized  tests  have  had.  We  have 
heard  the  amount  of  time  entailed  in  the  development  of  tests,  the  manner  in  which 
institutions  of  higher  education  utilize  standardized  tests  for  admissions  purposes, 
and  what  test  scores  on  standardized  tests  like  the  SAT  mean  to  students  and  par- 
ents applying  to  college  for  the  first  time,  ,      ,.  r 

Interest  continues  in  the  issues  of  test  disclosure  and  the  nature  and  quality  of 
standardized  tests  among  legislators,  the  public,  the  testing  industry,  and  those  in 
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the  education  field.  In  September,  the  California  Legislature  enacted  a  test  disclo- 
sure bill.  The  Law  School  Admission  Council  has  announced  that  beginning  in  1982 
the  LSAT  will  be  modified  to  deemphasize  mathematical  sRills  and  provide  a  writ- 
ing  sample.  An  articile  in  the  New  York  Times  in  which  this  announcement  ap- 
peared and  a  later  article  in  the  Chronicle  of  Higher  Education  also  touched  on  the 
steps  being  taken  to  examine  the  utilization  of  alternative  modes  of  assessment  for 
admissions  to  institutions  of  higher  education. 

In  an  attempt  to  gather  further  data  and  allow  for  public  input  as  to  the  direction 
this  body  should  take  in  regards  to  the  Truth  in  Testing  issue,  we  have  invited 
Gregory  Anrig,  the  president  of  the  Educational  Testing  Service  and  Dr.  Philip 
Rever,  the  director  of  the  American  College  Testing  Service  to  provide  testimony  re- 
garding their  policies  with  regard  to  disclosure  and  provide  their  views  on  the  pend- 
.ing  legislation.  We  also  have  here  present  today,  Ms.  MariAnn  Austin,  representing 
State  Senator  Kenneth  LaValle  of  New  York  to  present  testimony  on  the  test  disclo- 
sure legislation  enacted  in  New  York.  In  additfbn,  John  A.D.  Coopef,  president  of 
th/&  Association  of  Medical  Colleges  is  present  to  discuss  his  organization's  experi- 
ence with  test  disclosure  and  their  filing  for  an  injunction  prohibiting  the  enforce- 
ment of  the  New  York  statute  against  the  MCAT. 

estiinoay^that.thesa.experts^in^theJield  of  testing.  and- legislation- wilf-pro- 
vide  us  today  will  assist  us  in  our  deliberations  regarding  H.R.  1662. 

Mr.  Weiss.  As  Sponsor  of  the  legislation  which  is  our  topic  today, 
I  again  want  to  express  my  appreciation  to  both  subcommittees  for 
conducting  these  hearings.  Previous  hearings  on  the  Educational 
Testing  Act  of  1981  have  been  instrumental,  I  think,  in  shaping  the 
debate  on  the  issue  of  open  testing  as  well  as  precipitating  much  of 
the  activity^hich  has  occurred  in  the  field  of  standardized  testing 
since  this  legislation  was  introduced  in  1979.  I  am  certain  that  the 
te'stimony  we  receive  today  and  tomorrow  will  showjthe  continued 
importance  of  public  discussion  of  accountability  and  fairness  in 
standardized  testing.  - 

Since  congressional  hearings  began  on  this  topic  in  July  1979, 
indeed  5ince  the  adoption  of  legislation  in  the  State  of  New  York 
that  same  year,  nothing  short  of  a  minor  revolution  has  occurred. 
Major  testing  agencies  have  revamped  their  procedures  for  disclos- 
ing some  information  on  standardized  exams  and  this  has  height- 
ened public  concern  about  these  test  groups.  Perhaps  more  impor- 
c'tantly  a  fundamental  shift  seems  to  be  underway  in  the  attitude 
test  takers  everywhere  bring  to  their  standardized  adhiission  test. 
No  longer  are  test  takers  routinely  blocked  from  obtaining  infor- 
mation which  might  be  both  helpful  and  educational.  These  tests 
now  are  finally  being  made  subject  to  the  public  scri(|tiny  they  de- 
serve. 

The  real  measure  of  the  distance  traveled  can  perhaps  be  seen  by 
the  fact  that  ir  1957  students  were  not  permitted  to  even  know 
their  test  scores,  which  were  reported  blindly  to  colleges  and  uni- 
versities. And  until  1980  students  were  unable  to  see  their  own  test 
sheets.  Now  at  least  one  major  testing  agency  has  decided  that  all 
test  takers  should  receive  their  test  sheets,  a  listing  of  correct  an- 
swers and  the  test  questions  as  a  niatter  of  course.  This  testing 
agency,  the  Law  School  Admissions  Council,  and  others  which  have 
implemented  limited  disclosure  policies  should  be  commended.  Yet 
in  hearings  held  earlier  this  year  there  was  widespread  agreement 
that  most  of  the  changes  made  by  testing  agencies  since  July  1979, 
would  not  have  occurred  had  it  not  been  for  legislative  and  con- 
gressional involvement. 

I  continue  to  welcome  suggestions  and  observations  on  H.R.  1662. 
The  experience  with  open  testing  statutes  in  New  York  State  and 
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elsewhere  hab  bhown  that  some  refinements  may  well  be  appropri- 
ate in  that  bill. 

Let  me  conclude  by  noting  tha£  the  issue  we  are  addressing  in 
this  round  of  hearing  is  fundamentally  the  same  issue  we  focused 
on  when  the  hearings  began  in  1979,  insuring  that  testing  agencies 
are  held  appropriately  accountable  to  the  millions  of  students  they 
serve  each  year. 

We  have  four  important  witnesses  scheduled  for  this  morning. 
They  will  be  questioned  as  members  of  the  panel  deem  it  appropri- 
ate and  then  we  will  have  a  second  set  of  hearings  starting  tomor- 
row morning  at  9:30. 

The  first  witness  who  we're  pleased  to  welcome  is  the  new  presi- 
dent of  the  Educational  Testing  Service,  Mr.  Gregory  Anrig. 

STATEMENT  OF  GREGORY  ANRIG,  PRESIDENT,  EDUCATIONAL 
TESTING  SERVICES 

Mr,  Anrig.  Mr.  Chairman  and  members  of  the  subcommittee,  I 
am  deeply  grateful  for  the  privilege  of  appearing  before  your  com- 
mittee today.  I  would  have  to  confess  that  as  I  rounded  the  corner 
and  came  down  the  hall  today  and  saw  the  guards  and  the  TV 
lights  and  crowds  of  people  out  there  I  said,  ''My  God,  they  didn't 
tell  me  it  was  going  to  be  like  this."  I  was  pleased  to  find  out  that  I 
was  deferring  that  privilege  to  the  King  of  Jordan  and  hope  that 
our  hearings  will  be  less  eventful  than  that  one  obviously  is  going 
to  be. 

My  name  for  the  record  is  Gregory  R.  Anrig,  and  I  am  president 
of  the  Educational  Testing  Service.  I  appreciate  very  much,  Mr. 
Chairman,  your  opening  comments  in  which  you  recognize  the  re- 
sponsiveness of  test  organizations  over  the  course  of  the  last  couple 
of  years.  I  too  believe  they  have  been  responsive.  I  also*believe  and 
wish  to  recognize  that  these  hearings  have  served  a  worthy  purpose 
in  prompting  and  guiding  that  responsiveness^  and,  Mr.  Chairman, 
I  recognize  that  you  yourself  had  a  very  important  roll  in  that  and 
would  like  to  be  sure  to  acknowledge  that. 

I  have  only  held  the  position  of  president,  of  the  Educational 
Testing  Service  since  September  1  of  this  year.  That  autocratically 
means  Tm  an  expert  in  testing  by  definition,  but  I  would  have  to 
confess  that  only  for  two  months  have  I  been  so.  In  appointing  me 
president,  the  ETS  board  of  trustees  selected  a  person  whose  entire 
professional  life  has  been  in  public  service  at  the  local.  State,  and 
Federal  levels  of  government.  My  two  predecessors,  as  you  know, 
the  first  came  out  of  higher  education  and  was  in  effect  a  builder, 
Henry  Chauncey.  My  second  predecessor,  my  immediate  past  pred- 
ecessor, was  an  expert  and  a  Scholar  in  testing  and  has  grown  up 
really  through  the  testing  organizations  both  college  board  and 
ETS.  In  contrast  to  that,  for  the  last  8V2  years  Tve  served  as  com- 
missioner of  education  for  the  Commonwealth  of  Massachusetts. 

My  selection  as  ETS  president  reflects  the  judgment  of  the  board 
of  trustees  about  where  Educational  Testing  Service  is  as  a  private, 
not-for-profit  educational/organization  and  where  it  will  be  head- 
ing. This  judgment  also  reflects,  to  some  degree,  the  trustees'  view 
of  the  future  of  educational  testing  in  America  generally. 
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I  am  committed  to  public  service,  the  kind  of  public  accountabil- 
ity you  called  for,  and  the  fundamental  principle  of  equal  educa- 
tional opportunity.  My  actions  in  each  of  these  areas,  because  Tve 
been  a  public  official,  are  a  matter  of  public  record.  A  record  on 
which  I  stand  proudly,  and  can  be  attested  to  by  any  member  of 
the  distinguished  Massachusetts  delegation  to  the  House  of  Repre- 
sentatives. 

I  don't  shy  from  public  accountability.  I  welcome  it.  It  has  been 
and  is  my  position  that  anything  has  the  potential  to  affect  the  life 
chances  of  youths  and  adults  should  be  subject  to  reasonable  public 
accountability.  I  believe  that  includes  educational  testing. 

As  education  commissioner  in  Massachusetts,  I  testified  in  1980 
before  the  Massachusetts  Legislature,  it  may  surprise  you,  Mr. 
Chairman,  in  favor  of  a  so-called  truth-in-testing  bill  on  behalf  of 
the  State  board  of  education.  But  I  want  to  point  out  that  that  tes- 
timony was  conditional.  It  was  my  position  then  and  that  of  the 
State  Board  of  Education  that  public  accountability  in  educational 
testing  was  best  achieved  by  voluntary  action  of  testing  organiza- 
tions. We  urged  them  to  take  the  kinds  of  actions  which  subse- 
quently they  have  taken.  As  one  with  long  experience  in  the  devel- 
opment and  carrying  out  of  law,  I  feel  that  a  democratic  society 
should  legislate  only  that  which  is  absolutely  necessary. 

The  question  before  your  distinguished  subcommittees  of  Con- 
gress and  before  oganizations  which  conduct  educational  testing  is 
hovi;^  best  to  achieve  public  accountability  in  educational  testing  in 
general,  and  specifically  whether  greater  government  intervention 
is  necessary  to  accomplish  this  end. 

I  felt  it  was  important  that  I  used  the  privilege  of  appearing 
before  this  joint  hearing  today  as  an  opportunity  to  present  an 
answer  to  that  question.  To  assure  you  that  my  testimony  repre- 
sents the  corporate  position  and  committment  of  Educational  Test- 
ing Service,  I  recommended  and  on  October  6,  1981  the  ETS  board 
of  trustees  unanimously  approved  a  trustee  policy  on  public  issues 
which  I  am  .proud  with  your  permission  to  submit  for  the  record 
today  as  the  basis  for  my  testimony  which  follows. 

What  you  will  find  newest  and  what  I  will  describe  is  the  willing- 
ness of  the  ETS  board  of  trustees  and  the  new  ETS  president  to 
raise  these  actions  to  the  level  of  corporate  policy  commitment,  to 
directly  involve  the  board  of  trustees  itself  as  the  final  accountable 
.  body  for  ETS,  and  to  invite  outside  examination  both  of  our  oper- 
ations and  of  our  data. 

This  policy  grew  out  of  intensive  discussions  among  the  trustees 
and  among  the  senior  staff  of  ETS.  Although  I  consulted  with  rep- 
resentatives of  each  of  our  client  boards  in  developing  tne  recom- 
mended policy,  I  wish  to  make  clear  that  my  testimony  today  rep- 
resents only  the  corporate  position  of  Educational  Testing  Service. 
Other  organizations,  including  our  client  boards,  have  presented 
and  will  present  their  yiews  independent  of  the  position  I  take 
today. 

The  "issue  of  accountability  before  us,  in  my  judgment,  is  not 
"truth''  in  testing.  My  review  of  the  many  arguments  advanced  in 
the  debates  of  the  last  several  years  demonstrates  very  clearly  to 
me  that  no  sides  irr  these  debates  had  a  patent  on  truth.  The  real 
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issue  is  openness  in  testing  as  the  chairman  has  expressed  in  the 
opening  statement.  ^  ' 

I  believe  it  is  possible  to  achieve  openness  in  testing  voluntarily, 
without  Government  intervention,  and  ETS  commits  itself  firmly 
to  that  principle. 

Openness  in  testing  requires  taking  a  position  in  the  public's  in- 
terest, having  standards  for  this  position  by  which  you  are  willing 
to  be  judged,  having  a  vyay  to  enforce  those  standards,  and  creating 
a  means  to  review  and  report  publicly  upon  these  actions  in  a 
manner  that  has  credibility. 

As  my  first  action  after  taking  office  on  September  1,  I  recom- 
mended that  we  voluntarily  take  such  actions  to  demonstrate  our 
commitment  and  to  do  so  not  by  presidential  decision  but  by  formal 
policy  of  our  governing  board.     .  '  ,  . 

On  October  6  the  ETS  board  of  trustees  formalized  its  support  for 
the  principle  of  openness  in  admissions  testing  by  official  vote.  Spe- 
cifically, the  trustees  endorse  the  recent  actions  taken  on  release  of 
tests  and  test  answers  by  the  college  board,  the  graduate  manage- 
ment admission  council,  the  graduate  record  examinations  board, 
the  law  school  admission  council  and,  the  TOEFL  policy  council, 
that  is  the  test  of  English  as  a  foreign  language.  Further,  by  vote  oF 
the  ETS  trustees,  those  actions  and  commitments  are  incorporated 
as  policy  'for  ETS  in  its  services  for  the  respective  boards  and  will 
govern  ETS  in  the  administration  of  those  test  programs. 

Openness  in  testing,  however,  and  I  think  this  is  important  for 
us  to  be  clear  on,  involves  far  more  than  just  test  disclosure.  ETS, 
therefore,  also  has  adopted  as  policy  the  public  interest  principles 
proposed  for  discussion  2  years  ago  by  ETS  and  the  major  admis- 
sions testing  boards  with  which  we  work,  and  I  submit  a  copy  today 
for  the  record  if  the  Chair  approves. 

These  public  interest  principles  affirm  our  commitment  to  the 
rights  of  test  takers  in  admission  testing  programs:  The  right  to 
know  what  is  in  the  test,  to  have  fair  and  bias-free  test,  to  receive 
accurate  test  scores,  to  have  access  to  tests  reg&rdless  of  handicap 
or  other  special  circumstances,  to  be  informed  about  what  the  tests 
and  their  scores  mean,  to  be  protected  in  the  privacy  of  informa- 
tion about  themselves,  to  the  promotion  of  proper  test  score  use. 

In  adopting  the  public  interest  principles,  I  believe  we  are  the 
first  national  testing  organization  to  raise  these  principles  from  the 
level  of  discussion  to  the  level  of  corporate  policy  commitment.  I 
know  and  you  know  that  the  ETS  position  which  I  have  just  stated 
requires  specific  standards  if  that  general  commitment  is  to  have 
real  meaning.  We,  therefore,  have  developed  a  very  comprehensive 
set  of  principles  and  policies  to  govern  ETS  tests  a'nd  services.  They 
have  been  tested  as  guidelines  which  are  now  by  trustee  vote  in  Oc; 
tober  of  this  year  to  be  called  the  ETS  standards  for  quality  and 
fairness,  which  I  also  submit  for  the  record.  The  ETS  standards  for 
quality  and  fairness  are  designed  to  insure  that  our  products  and 
services  measure  up  to  clear  and  strong  specifications  in  the  areas 
of,  accountability,  protection  of  privacy,  product  accuracy,  test 
quality,  responsible  use  of  test  results,  and  research  and  technical 
assistance.  These  standards  are  fully  consistent  with  and  in  many 
respects  exceed  the  current  joint  testing  and  measurement  stand- 
ards of  the  American  Psychological  Association,  the  American  Edu- 

4uj 


^|^(]]9M70   20 


396 


cational  Research  Absociation  and  the  National  Council  on  Mea- 
surement in  Education.  As  you  know,  Mr.  Chairman,  those  are  the 
three  -groups  which  are  recognized  nationally  for  standard  setting 
in  the  area  of  tests  and  measurement.-  .     .  . 

ETS  will  hold  itself  accountable  to'  these  demanding  standards 
and  the  board  of  trustees  has  committed  our  organization  formally 

^°With°  regard  to  enforcement  of  these  standards,  ETS  has  devel- 
oped and  implemented  a  comprehensive  audit  process  to  assure 
that  all  testing  programs  adhere  to  the  ETS  standards  for  quality 
and  fairness.  These  audits  will  revie>v  each  ETS-developed  testing 
program  at  least  once  every  3  years,  a  process  already  begun.  The 
audits  will  be  conducted  under  specific  oversight  by  the  president 
and  general  oversight  by  the  ETS  trustee  committee  on  public  re- 
sponsibility, and  I  m  already  carrying  out  my  responsibilities  in 
that  area  If  a  testing  program  does  not  meet  these  standards,  1 
pledge  ETS  to  work  diligently  with  the  program  sponsor  to  bring 
the  test  into  compliance  with  the  standards. 

The  trustee  committee  on  public  responsibility  has  been  charged 
by  the  ETS  board  of  trustees  to  prepare  and  publicly  issue  on  an 
annual  basis  an  accountability  report  on  actions  taken  to  adhere  to 
the  ETS  standards  for  quality  and  fairness.  To  aid  the  trustee  com- 
mittee on  public  responsibility,  a  visiting  committee  ^ill  be  formed 
by  persons  from  outside  of  ETS  and  its  board  of  trustees  who  are 
knowledgeable  in  the  areas  addressed  by  the  ETS  standards  tor 
quality  and  fairness.  It  is  my  full  intent  to  include  on  the  v^isiting 
committee  persons  from  organizations  which  have  in  the  past  been 
critical  of  ETS.  That,  by  the  way,  is  old  practice  for  this  particular 
person.  Tve  always  felt  it  was  better  to  invite  them  in  than  to  hold 

them  out.  ,      ,  ^  v  ir 

A  series  of  actions  will  be  taken  to  broaden  access  to  li^lb  itseit. 
While  complaints  from  students  and  other  test  takers  currently  are 
responded  to  earnestly  at  ETS  and  Fve  been  very  impressed  by 
that,  the  process  for  responding  differs  from  one  testing  program  to 
another.  A  uniform  complaint  procedure  will  be  impleniented 
across  all  ETS-developed  testing  programs,  closely  coordinated  with 
each  of  our  client  boards  to  improve  the  way  we  can  respond  to  stu- 
dent complaints.  I  also  have  just  designated  an  ETS  student  con; 
cerns  coordinator  in  the  office  of  the  president  to  momtor  this  pro- 
cedure and  to  provide  communications  with  students,  ohe  is  a 
highly  competent  professional  staff  person  who  already  has  earned 
my  confidence  and  whose  office  is  next  to  mine  for  easy  access,  and 
she  also  I  might  add  participates  in  all  of  the  major  management 
planning  processes  of  the  organization.  It  will  be  her  job  to  assure 
that  student  concerns  both  are  advocated  and  brought  to  those 
areas  of  deliberation.  .  .     r  • 

Actions  have  been  initiated  to  increase  further  the  variety  ol  in- 
formation about  ETS  tests  available  to  individuals,  schools,  commu- 
nity agencies  and  institutions  of  higher  education.  These  wilJ  in- 
clude new  formats,  such  as  audiovisual  materials,  videotapes  tor 
public  and  cable  television,  and  handbooks  aimed  at  accurately  in- 
forming test  takers  and  the  public  about  standardized  tests,  the 
skills  which  these  tests  measure,  and  what  one  should  know  about 
taking  the  tests.  The  aim  of  these  materials  is  to  make  readily 
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available  to  all  students,  regardless  of  economic  3tatus,  high  qual- 
ity information  about  the  tests  developed  by  ETS. 

Finally,  the  trustee  committee  on  research  and  development  has 
been  working  as  late  as  yesterday  afternoon  to  broaden  and  sim- 
plify access  to  ETS-controlled  test  and  research  data,  consistent 
with  our  longstanding  commitment  to  protect  the  privacy  of  indi- 
vidual test  takers.  Recommendation  to  make  these  resources  more 
accessible  to  researchers  and  others  through  public  use  tapes  will 
be  presented  by  the  committee  to  the  board  of  trustees  in  April 
1981  and  I  anticipate  speedy  action  on  this  important  matter.  We 
intend,  also,  to^work  collaboratively  with  our  contracting  boards  to 
facilitate  easier  access  to  the  data  which  they  control  in  accordance' 
with  their  policies  in  this  area. 

The  five  elements  which  I  have  described  and  which  are  em- 
bodied by  corporate  vote  in  the  ETS  trustee  policy  on  publicJssues, 
demonstrate  our  commitment  to  openness  in  testing.  These  ele- 
ments— an  affirmative  position  on  such  openness,  standards  of  ac- 
countability, enforcement  of  these  standards,  public  reporting  and 
organizational  accessibility — can  and  will  be*  broadened  and 
strengthed  over  time,  in  close  collaboration  with  the  organizations 
which  contract  for  JETS  services.  We  commit  ourselves  to  that  goal. 

I  am  confident  that  such  voluntary  action  is  better  ihan  Federal 
legislation,  Mr.  Chairman.  I  don't  have  J:o  describe  to  you  and  the 
members  of  your  committee  the  reams  of  regulations,  forms,  and 
bureaucratic  guidelines  which  in  the  past  have  been  sired  by  legis- 
lation such  as  you  now  have  before  you  regarding  educational  test- 
ing. Legislation  of  this  type  inevitably  leads  to  greater  governmen- 
tal intrusion  into  education,  and  will  needlessly  increase  the  costs 
of  educational  testing  for  thousands  of  test  takers  and  their  par- 
ents who  are  your  constituents. 

The  goal  of  openness  in  testing  can  be  and  is  being  achieved 
without  further  legislation.  In  my  judgment  that  is  how  it  should 
be.  The  New  York  State  law  is  being  carried  out  diligently  by  ETS 
and  its  test  sponsors,  and  a  summary  of  these  actions  is  submitted 
for  the  record  with  the  Chair's  permission.  By  voluntary  decision  of 
the  respective  test  taking  boards,  the  basic  provisions  of  this  law 
have  been  applied  on  a  national  basis.  Further  legislation  such  as 
H.R.  1662  is  not  needed  or  warranted. 

To  those  who  fear  retrenchment  from  voluntary  openness  in  test-  . 
ing,  I  say  judge  ETS  and  others. both  by  our  words  and  our  actions 
now  and  in  the  future  and  act  accordingly.  Don*t  legislate  for  the 
future  to  remedy  problenis  of  the  past  which  largely  have  been  ad- 
dressed. Don*t  impose  regulation  on  the  entire  industry  when  the 
major  segments  of  that  enterprise  have  already  acted  voluntarily 
to  meet  the  major  goals  of  that  legislation.  If  there  is  retrenchment 
then  you  can 'act.  If  there  isn't,  why  act  at  all? 

EJTS  is  firmly  and  fully  committed  to  the  principle  of  openness  in 
testing.  To  advance  this  principle  for  the  future,  I  offer  a  challenge 
and  a  proposal.  I  urge  all  profit  and  nonprofit  testing  corporations, 
and  those  agencies  of  Government  which  test,  to  join  with  us  vol- 
untarily in  an  industrywide  "Code  of  Fair  Testing  '  for  educational 
testing  nationwide.  I  recommend  that  this  voluntary  .Code  of  Fair 
Testing  be  based  on  the  new  standards  now  being  developed  by  the 
American  Psychological  Association,  the  American  Educational  Re- 


search  Association,  and  the  National  Council  on  Measurement  in 
Education.  I  further  propose  that  a  panel  be  appointed  jointly  by 
these  three  associations  to  monitor  the  industrywide  Code  of  Fair 
Testing  and  I  commit  ETS  today  to  cooperate  fully  with  such  a 
panel. 

Thus,  in  addition  to  the  actions  which  Tve  described  affecting 
educational  testing  service,  the  educational  testing  service  board  of 
trustees  and  I  offer  to  join  other  testing  corporations  and  agencies 
in  a  national  effort  to  voluntarily  promote  openness  in  testing. 

In  the  2  months  I've  been  at  ETS  Tve  been  very  impressed  by  the 
people  who  make  up  the  organization  and  by  the  quality  of  services 
they  provide  to  individuals  and  to  institutions.  ETS  always  has 
stood  for  quality  and  equality  of  educational-opportunity  and  if  it 
didn't  I  wouldn  ^  have  gone  there.  It  is  dedicated  to  continuing  this 
tradition  in  the  challenging  years  ahead.  I  hope  my  testimony 
today  and  the  policy  position  of  the  ETS  board  of  trustees  make 
this  commitment  and  this  dedicatiofTCl^r  

I  thank  you,  Mr.  Chairman,  and  your  colleagues  on  the  subcom- 
mittee for  the  privilege  of  appearing  before  you  today.  I  shall  be 
glad  to  respond  to  your  questions. 

Mr.  Weiss.  Thank  you  very  much.  Commissioner.  Let  me  at  the 
outset  commend  you  as  the  president  pf  the  educational  testing 
service  and  tell  you  how  welcome  it  is  to  have  the  attitude  which  is 
implicit  throughout  your  testimony.  I  think  that  underlying  any 
possibility  of  success  in  this  or  any  other  endeavor  that  we  under- 
takejegislatively  is  the  attitude  of  the  people  who  are  involved, 
and  I  think  indeed  there  is  a  new  wind  blowing  and  I  welcome  it. 

I  also  want,  witliout  objection,  to  have  ^11  the  appendices  and  ex- 
traneous material  that  you  referred  to  ent^ed  into  the  record  so 
that  we  11  have  all  that  for  our  perusal  ^nd  for  any  others  who 
want  to  look  at  the  record  of  this  hearing.  - 

[The  information  referred  to  follows:] 
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Prepared  Statemknt  ov  Gregory  R.  Anrig,  President,  Educational  lESTiNa 

Service 

Mr.  Chairman: 

My  name  is  Gregory  R*  Anrig  and  I  am  Pr^ident  o£  Educational  Testing 
Service  (ETS) . 

I  have  held  this  position  only  since  September  1  of  this  year.  In 
appointing  me  President,  the  ETS  Board  o£  Trustees  selected  a  person  whote 
entire  professional  life  has  been  in  public  service  at  the  local,  state, 
and  federal  levels  of  governnent.    For  the  last  8  1/2  years,  I  have  served 
as  Commissioher  of  Education  for  the  Comnonwealth  of  Massachusetts* 

My  selection  as  ETS  President  reflects  the  judgment  of  the  ^oard  of 
Trustees  about  where  ISducational  Testing  Service  is,  as  a  private, 
not-for-profit  educational  organization,  and  where  it  will  be  heading. 
This  judgment  also  reflects,  to  some  degree,  the  Trustees'  view  of  <,the 
future  of  educational  testing  in  America  generally* 

I  am  committed  to  public  service,  public  accountability,  and  the 
fundamental  principle  of  equal  educational  opportunity*    My  actions' in 
each  of  these  areas  are  a  matter  of  public  record— a  record  on  which  1 
stand  proudly— and  can  be  attested  to  by  any  member  of  the  distinguished 
Massachusetts  delegation  to  the  House  of  Representatives* 
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-r"do~noL  bh^  £iuu  ^ublitf-«5€<Hmtjthiliiy..  I  welcome  It,  It  has  been 


and  is  ny  position  that  anything  that  has  the  potential  to  affect  the 
life  chances  of  youths  and  adults  should  be  subject  to  reasonably 
public  accountability,    I  believe  that  includes  educational  testing. 

As  Education  Commissioner  in  Massachusetts,  I  testified  in  1980  before 

t 

the  Massachusetts  Legislature  in  favor  of  a  so-called  "Truth-in-Testing" 
bill,  pn  behalf  of  the  State  Board  of  Education,    But  that  testlrtpny  was, 
conditional.    It  was  rty  position  and  that  of  the  State  Board  of  Education 
that  public  accountability  in  educational  testing  was  best  achieved  by 
voluntary  action  of  testing  organizations.    We  urged  them  to  take  the 
kinds  of  actions  which  subsequently  they  have  taken,    As  one  with  long 
experience  in  the  development  and  carrying  out  of  law,  I  feel  that  a 
deaocratlc  society  should  legislate  only  that  which  is  absolutely  necessary. 

The  question  before  your  distinguished  Subconiaittees  of  Congress  and 
before  organizations  which  conduct  educational  testing  is  bow  best  to 
achieve  public  accountability  m  educational  testing  In  general,  and 
speciflrally  whether  greater  government  intervention  is  necessary  to 
accomplish  this  end, 

I  felt  it  was  important  that  I  use  the  privilege  of  appearing  before 
this  joint  hearing  today  as  an  opportunity  to  present  an  answer  to  that 
question,    1^  assure  the  Subcommittees  that  my  testimony  represents  the 
corporate  position  and  commitment  of  Educational  Testing  Service,  I 
recommended  and  on  October  6,  1981  the  ETS  Board  of  Trustees  unanimously 
approved  a  Trustee  Policy  on  Public  Issues  (Appendix  A)  which  I  am  proud 
to  submit  for  the  record  today  as  the  basis  for  my  testimony  which  follows. 
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Ttiis  policy  grew  out  o£  intensive  discussions  among  the  Trustees  and 
among  the  senior  staff  of  E7S.    Although  1-  consulted  with  representatives^ 
of  each  of  our  client  boards  in  developing  the  recocunended  policy^  I  wish 
to  nake  clear  that  my  testinony  today  represents  only  the  corporate 
position  of  Educational  Testing  Service.    Other  organizations/  including 
our  client  boards^  have  presented  and  will  pfesent  their  views  independent 
of  the  position^  take^ today. 

The  issue  of  accountability  before  uS/  in  ny  judgment«  is  not 
'*truth*  in  testing.    Hy  review  of  the  many  arguments  advanced  in  the 
debates  of  the  last  several  years  demonstrates  to  me  that  no  sides  in 
th^se  debates  had  -a  patent  on  truth,    life  real  issue  is  openness  in 
testing. 


I  believe  it  is  i^ossible  to  achi^eve  openness  in  testing  voluntarily/ 
without  government  intervention^  and  BTS  commits  itself  firmly  to  that 
principle.  .  t 

Openness  in  testing  requires  taking  a  position  in  the  public 
interest/  having  standards # for  this  position  by  which  you  are  willing  to 
be  judged/  having  a  way  to  enforce  those  standards/  and  creating  a  means 
to. review  and  report  publicly  upon  these  actions  in^a  manner  that  has 
credibility.  \ 

< 

The  ETS  1x>sition.    On  October  6/  1981  the  ETS  Board  of  Trustees 
formalized  its  support  for  the  principle  of  openness  in  admissions  testing 
by  official  vote.    Specifically/  the  Trustees  endorse  the  recent  actions 
taken  on  release  of  tests  and  test  answers  by  the  College  Board,  the 
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Graduate  Management  Admission  Council,  the  Graduate  Record  Examinations 

*  * 
Board,  the  Law  School  Admission  Council  and  the  TOEFL*  Policy  Council. 

Further,  by  vote  of  the  ETS  Trustees,  those  actions  and  commitments  are 

incorporated  as  policy  for  ETS  in  its  services  for  the  respective  boards 

and  will  gov^'rn  ETS  in  ddmlnlstration  of  those  test  programs. 

Openness  in  testing,  however,  involves  more  than  ;5ust  test  disclosure. 
ETS  therefore  also  has  adopted  as  policy  the  "Public  Interest  Principles" 
(Appendix  B)  proposed  for  dlscusf Ion  two  years  ago  by  ETS  and  the  major 
admissions  testing  boards  with  which  we  work. 

H;ea^''Pu'blic  Interest  Principles"  affirm  our  commitment  to  the  rights 
pf  test-takers  in  admissions  testing  programs: 

—  to  know  What  Is  In  the  test 

—  to  have  fair  and  bias-free  tests 

—  to  receive  accufate  test  scores 

—  to  have  access  to  tests  regardless  of  handicap  or  other 
J.  special  circumstances 

—  to  be  Informed  about  what  the  tests  and  <Sheir  scores  mean 

—  to  be  protected  in  the  privacy  of  information  about  themselves 

—  to  the  promotion  "oT^oper  test  score  use 
-> 

In  adopting  the  "Public  Interes^  Principles,"  I  believe  we  are  the 
first  national  testing  organization  to  raise  these  principles  from  the 
level  of  discussion  to  the  level  of  a  corporate  policy  commitment. 


*Test  of  English  as  a  Foreign  Language 
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Standards  for  accountability,    Otie  ETS  position  which  I  have  just 
stated  requires  specific  standards  if  that  general  commitment  is  to  have 
real  meaning.    We  therefore  have  developed  a  very  cocnprehensive  set  of 
principles  and  policies  to  govern  ETS  tests  and  services.    Ihey  have  been 
tested  as  guidelines  which  are  now,  by  Trustee  vote  in  October  of  this 
year,  the  "ETS  Standards  for  Quality  and  Fairness"  (Appendix  C). 

The  "ETS  Standards  for  Quality  and  Fairness"  are  designed  to  ensure 
that  our  products  and  services  measure  up  to  clear  and  strong  specifications 
in  the  areas  of;    acccuntability,  protection  of  privacy,  product  accuracy, 
test  quality,  responsible  use  of  test  results,  and  research  and  technical 
assistance,    ^ese  Standard?  are  fully  consistent  with  and,  in  many 
respects,  exceed  tite  current  joint  testing  and  measurement  standards  of 

the  American  Psychological  Association,  the  American  Educational  Research 

a. 

Association  and  the  National  Council  on  Measurement  in  Educ^ation.  ETS 
will  hold  itself  accountable  to  these  demanding  standards  and  the 
Board  of  Trustees  has  committe^  our  organization  formally  to  do  so. 

Enforcement  of  standards.    CTS  has  developed  arid  implemented  a 
« 

comprehensive  audit  process  to  assure  that  all  testing  programs  adhere  to. 
the  "ETS  Standards  for  Quality  and  Fairness."    These  audits  will  review 
each  £TS-^ev|^jbped  testing  program  at  least  once  every  three  years,  a 
process  already  b^gun.    The  audits  will  be  conducted  under  specific 
^review  by  the  President  and  general  review  by  the  ETS  Trustee  Committee 
on  Public  Responsibility.    If  a  testing  program  dc/es  not  meet  these 
standards,  X  pledge  ETS  to  work  diligently  with  the  program  sponsor  to 
bring  the.  test  into  compliance  with  the  standards. 


^  i    .  ^ 

Public  reporting,    ine  Trustee  Comaittee  on  Public  Jlesponsibillty  has 

been  charged  by  th/ETS  Board  of  Taustees  to  prepare*  and  pubtlicly  Issue 

annually  *n. account ability  report  on  actions  taJcen  to  adhere  to  the  "ETS 

Standards  for  Quality  and  Fairness."    To  aid  the  Trustee  CoRinittee  on 

Public  Responsibility,  a  Visiting  Cowmttee  will  be  formed  of  persons 

f con  outside  ojE  ETs'and  its  Board. of  Trustees-- who  are' knowledgeable  In 

the  areas  addressed  by  the  "ETS  Standards  for  Quality  and  Fairness."  It 

is       intent  to  include  orf  the  Visiting  Coramittee  persons  froro  organizations 

which  have  in  the  past  been  critical  of  ETS. 

•"^        \  '"^  .  >  *       t  ' 

Openness  of  the  organization  and  its  Information.    A  series  of  actions 

will  be\aken  to  broaden  access  to  ETS  itself,    ville  complaints  from  students 

:  < 

and  other  test-takers  currently  are  responded  to  earnestly  at  ETS,  the    ^  | 
pcoceas  for  responding  differs  from  one  testing  program  to  another.    A   ^  ^ 
uniform  complaint  procedure  will  be^implemented  acr9ss  all  ETS-developed 

^testing  programs,  closely  coordinat^ed  with  each  of  our  client  boards,  to 
improve  the  way  we  can  respond  ,to  student  complain  s.    I  also  have  just 
designated  an  ETS  Student  Concerns  Coordinator  in  the  Office  of  the  ^ 

•  President  to  monitor  this  procedure  and  to  promote  canmunicatlon  with 
students.  ^  '     '  ,  ^  ^ 

Actions  have  been  initiated  to  Increase  further  the  variety  of 
information  about  ETS  tests  available  to  Individuals,  schools,  community 
.agencies  and  institutions  of  higher  education.    Itiese  will  Include  new 
formats  such  as  audiovisual  materials,  videotapes  for  public  and  cable" 
4L«levision,  and  handbooks  aimed  at  accurately  Informing  test-takers  and 
t^ie  public  about  standardized  tests,  the  skills  which  the^e  tests  measure. 
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and  what  one  should  know  about  taking  the  .tests.  Ihe  aim  of  these  materials 
is  to  make  readily  available  to  all  students /  regardless  of  econonic  status, 
high  quality  information  about  tests  developed  by  ETS. 

Finally,  the  'i^ustee  Committee  on  Research  and  Development  has-been 
working  to  broaden  and  simplil^  access  to  JETS-controlled  test  and  research 
data/  consistent  with  our  long-standing  coramitment  to  protect  the  privacy 
of  individual  test-takers.    Becocnmendations  to  make  these  resources  more 
accessible  to  res^archtfs  and  others  will  be  presented  by  the  Committee 
to  the  Board  ot  Trustees  in  April  1982  and  Z  anticipate  speedy  action  on 
this^ important  matter.    We  intend/  also,  to  work  collaboratively  with  our 
contracting  boards  to  facilitate  easier  acceTs  to  the  data  which  they 
control,  in  accordance  with  their  policies  in  this  area. 

Ohe  £ive  elements  which  Z  have  described,  and  which  are  embodied  by 

corporate  vote  m  the  ETS  Trustee  Policy  on  Public  Issues,  demons t^r ate 

our  commitment  to  openness  in  testing.    These  elements—an  affirmative 

position  on  such  openness,  standards- of  accountability,  enforcement  of 

these  standards,  public  reporting  and  organizational  accessibiUty— can 
•  «^  c 

:i 

and  will  be  broadened  and  strengthened  over  tijne,  in  close  collaboration 
with  the  organizations  which  contract  for  ETS  services.    We  commit  ' 
ourselves  to  this  goal. 

r  am  confident  that  such  voluntary  action  is  better  than  federal 
legislation.    Z  don^t  have  to  describe  to  your  SubcoTiiaittees  the  reams  of 
regulations,  forms,  and  bureaucratic  guideline^  which,^  m  the  past,  have 
been  sired  by  legislation  such  as  you  now  have  before  you  regarding 
educational  testing.    Legislation  of  this  type  inevitably  leads  to 
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greater  governmental  intrusion  into  education,  and  will  needlessly 
increase  the  costs  of  educational  testing  for  thousands  of  test-takers 
and  their  parents  who  are  your  constituents. 

Tht  goal  of  openness  in  testing  can  be  and  is  being  achieved  without 
further  legislation.    Ohat  is  how  it  should  be.    The  New  York  State  law 
is  being  carried  out  diligently  by  ETS  and  its  test  sponsors  (see  Appendix  D) . 
By  voluntary  decision  of  the  respective  test-governing  boards,  the  basic 
provisions  of  this  law  have  been  Jipplied  on  a  national  basis.  Further 
legislation  such  as  H.R.  1662  is  not  needed  or  warranted. 

To  those  who  fear  retrenchment  from  voluntary  openness  in  testing, 
I  say  judge  ETS  and  others  both  by  our  words  and  actions,  now  and  in  the 
future,  and  act  accordingly.    Don't  legislate  for  the  future  to  remedy 
problems  of  the  past  which  largely  have  been  addressed.    Pon't  impose 
regulation  on  an  entire  industry  when  the  roa^or  segments  of  that, enterprise 
already  have  acted  voluntarily  to  meet  the  major  goals  of  that  legislation. 
If  there  is  retrenchment,  then  act.    If  there  isn't,  why  act  at  all?  ^ 

A  Challenge  and  t  proposal.    ETS  is  firmly  and  formally  committed  to 
the  principle  of  openne^in  testing.    To  advance  this  principle  for  the 
future,  I  offer  a  challenge  and  a  proposal: 

—    I  urge  all  profit  and  nonprofit  testing  corporations,  and 
*  those  agencies  of  government  which  test,  to  join  with  us 
voluntarily  in  an  industry-wide  "Code  of  Fair  Testing"  for 
educational  testing  nationwide.  « 
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—  I  recoiunend  th*t  this  voluntary  •Code  of  F*ir  Testing*  be 
based  on  the  new  standards  now  being  developed  by  the 
American  Psychological  Association,  the  American  Educational 
Researd)  Association,  and  the  National  Council  on  Measurement 

'  in  Education. 

—  I  further  propose  that  a  panel  be  appointed  jointly  by  these 
three  associations  to  jaonitor  the  industry-wide  "Code  of 
Fair  Testing"  and  I  conanit  ETS  today  to  cooperate  fully  with 
such  a  panel. 

Thus,  in  addition  to  the  actions  which  I  have  described  affecting 
Educational  Testing  Service,  the  ETS  Board  of  Trustees  and  I  offer  to 
join  other  testing  corporations  and  agencies  in  a  national  effort  to 
voluntarily  promote  openness  in  testing. 

I  an  new  to  ETS.    I  have  been  very  impressed  by  the  copnitment  of 
the  people  who  make  up  the  organization  and  by  the  quality  of  services  • 
they  provided  individuals  and  to  institutions.    BIS  always  has  stood 
for  quality  and  equality  of  educational  opportunity  and  is  dedicated  to 
continuing  this  tradition  in  the  challenging  years  ahead.    I  hope  my 
testimony  today  and  the  policy  position  of  the  ETS  Board  of  Trustees  make 
this  dedication  clear. 

I  thank  you,  Mr.  Chairman  and,  through  you,  your  colleagues  on  the 
Subcofwaittees,  for  the  privilege  of  appearing  before  you  today.    I  shall 
^    be  glad  to  respond  to  your  questions. 
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DUCATIONAL  TESTING  3ERVICE 


PRINCETON.  N.J.  08641 


Board  of  Truateei  Policy  on  Public  Iiiuer 
(adopted  October  6,  1981) 


The  deb«te«  over  educ«tion«l  tetting  «re  p«rt  of  the  democratic 
proceii  in  the  United  States.  "The  Bo«rd  of  Tru«tee«  of  Educitionil 
'feiting  Service  h««  p«rticip«ted  vigorouily  in  the«e  deb«te«  «nd  h«« 
learned  fro«  them.    At  Tru«tee«  of  s  publicly  chartered  body,  the  Boird 
recognize!  it«  obligation  to  «erve  «nd  be  reipj^n^AVf^o  the  worthy 
purposes  which  led  to  the  estsblishnent  of  Ediicstion«l  Testing  Service 
thirty-four  yesrs  sgo. 

It  ir  the  Bosrd  of  Trustees'  intent  in  estsblishing  this  Policy  to 
nske  clesr  the  co|rporste  position  of  Educstionsl  Testing  Service  on 
nstters  which,  in  recent  yesrs,  hsve  been  the  subject  of  public  debate. 
In  tsking  this  sction,  the  Bosrd  is  spesking  only  jEor  Educstionsl  Testing 
Service  fo,r  w»vich,  by  Isw,  it  is  responsible  and  account sble. 

The  Bosrd  of  Trustees  r*sffir«s  its  position  thst  the  public  interest 
is  best  served  by  voluntsry  self-regulation  in  the  educstionsl  testing 
field,  subject  to  public  snd  aedis  scrutiny,  rsther  thsn  by  governinentsl 
regulstion  sdainistered  by  state  or  federsl  buresucrscies.    It  is 
position  thst 'governnentsl  regulation  should  be  used  ss  s  last  re 
only  when  responsible  Educational  bodies  fail  to  respond  ressonably  to 
legitimate  grievsnces  of  the  public. 

By  officisl  resolution  voted  on  October  6,  1981,  the  Bosrd  of  Trustees 
of  EdJcstionsl  Testing  Service  -fomialized  its  support  of  the  principle  of 
openness  in  adnissions  testing.    Specifically,  the  Board  supports  the 
fecent  sctions  of  the  College  Board,  the  Grsduste  Mansgeaent  Admission 
Council,  Che  Grsduste  RecordrExsminstions  Board,  the  Law  School  Admission 
Council  snd  the  TOEFL  Policy iCouncil  on  relesse  of  tests  snd  test  answers. 
In  tsking  this  position,  the  Bosrd  of  Trustees  incorporates  those  sctions 
a%  policy  for  Educational  Testing  Service  in  the  programs  it  conducts  for 
the  respective  boards.    We  commit  ETS  to  advance  further,  in  concert  with 
our  contrscting  bosrds,  the  principle  of  openness  in  testing. 
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Opcnncii  in  ceacins,  hqvever,  involvea  aore  Chan  teat  diacloaure. 
Th«  Board  of  Truaceea»  accinf  on  beha^lf  of  Educational  Teacing  Service, 
therefore  Cakea  Che  follovinf  acciona: 

•  Adopt*  aa  policy  for  Educational  Teating  Service  the  "Public 
Intereac  Principlea"  (attached),  originally  propoaed  for  public 
diacuaaion  on  Deceaber  30,  1979. 

•  Approvea  aa  policy  the  "ETS  Standarda  foe  Quality  and  Pairneaa" 
(attached).*    Theae.  atandarda  are  fully  conaiatent  with  and 
indeed,  in  vany  reapecta,  exceed  the  current  tetting  and  neaaureaent 
atandarda  of  the  American  Paychological  Aaaociation,  the  American 
Educational  Reaearch  Aaaociation  and  the  National  Council  on 
Heaaureaent  in  Education. 

•  Endoraea  the  proceaa  for  ayateaatic  auditing  by  ETS  of  all  teating 
prograaa'  it  conducta  to  aaaure  adherence  to  the  "ETS  Standarda 

for  Quality  and  Pairneaa."    Such  audita  are  performed  on  a  cycle 
ao  that  each  teating  prograa  ia  coaprehenaively  reviewed  at  leaat 
once  ev«ry  three  yeara»  with  particular  attention  to  proviaiona 
in  the  atandarda  to  proaote  proper  teat  uae  and  to  prevent  teat  biaa 


•  Directa  the  Truatee  Coaaittee  on  Public  Reaponaibility  to  prepare 
annually  an  accountability  report,  to  be  releaaed  publicly,  which 
it  responaive  to  public  concerna  and  evaluatea  actiona  taken  by 
Educational  Teating  Service  in  accordance  with  the  "ETS,  Standarda 
for  Quality  and  Pairneaa."    In  carrying  out  thia  reaponaibility, 
the  Coaaittee  will  be  aaaiated  by  a  Viaiting  Conaittee  of  peraona 
froa  outside  of  ETS  who  are  knowledgeable  in  the  areaa  addreaaed 
by  the  "ETS  Standarda  for  Quality  and  Pairneaa." 

•  Approvea  eatabliahaent  of  a  uniform  coaplaint  procedure  for  atudenta 
and  other  teat-taker^a  to  provide  ready  acceaa  to  Educational 
Teating  Service  for  atudent  grievancea  about  prograaa  and  aervicea 
provided  by  ETS.    A  Student  Concerna  Coordinator  will  be  deal'gnated 
in  the  Pceaident'a  Office  to  aupport  thia  procedure,  conault  with 
atudent  organisationa  and  otherwiae  proaote  coaaunication  with 
atudenta*    The  Board  recognicea  that  ETS  aervea  individuala  aa 

well  aa  inatitutiona  and  will  endeavor,  in  full  collaboration 
with  ita  .contracting  boarda,  to  reaolve  legitimate  grievancea 
about  prograaa  and  aervicea  provided  by  ETS.  » 


*  Formerly  only  adminiatrative  guidelinea  entitled,  "Principlea,  Policiea 
and  Procedural  Guidelinea  Regarding  ETS  Froducta  and  Servicea." 
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The  Board  of  Trusteca  further  encourages  openneis  m  testing  for 
arew  other  than  ad«issions  testing,  so  that  all  testnaker,  will 
have  full  and  open  tccett  to  lnfor.ation  about  the  purpose  tnd  content 
of  the  teata  they-take,  the  mejthod  of  icoring,  and  the  proper  uaea  and 
linitationa  of  the  teata.    ETS  will  work  collaboratively  with  contracting 
boarda  «nd  agenciea  to  promote  thia  objective. 

The  Board  of  Truateea  further  aupporta  wide  diaae«ination  to  achoola, 
inatitutiona  of  higher  education  and  co-unity  agenciea  of  new  "^""l' 
developed  to  help  atudenta.and  other  potential  teat-takera  underatand  the 
variety  of  teata  developed  by  Educat ional -Teat ing , Service.    Theae  will 
include  audioviaual  iwteriala,  videotapea  for  uae  by  public  and  cable 
televiaion,  and  handbooka  to  be  prepared  for  publication  by  the  College 
Board  anjby  Educational  Teating  Service.    "Hie  aiia  of  theae  oatcriala  la  ^ 
to  Make  readily  available  to  all  atudenta,  regardleaa  of  economic  atatua, 
high  quality  inforaation  about  teata  developed  by  Educational  Teating 
Serv  ice. 

It  ia  the  Board  of  Truateea'  intent  alao  ^o  broaden  acceaa  to  teat 
.  and  r^aearch  data  which  are  under  the  control  of  Educational  Teating 
Service.    The-Truatee  Cotnnittee  on  Reaeorch  and  Development  la  developing 
policy  recotraendationa  to  increaae  the  availability  of  thia  information. 
The  Board  expecta  to  act  upon  theae  recomoendat  lona  at  ita  April  l«2 
meeting.  .Further,  ETS  will  work  collaboratively  with  ita  contracting 
boarda  to  facilitate  expanded  acceaa  to  the  teat  and  reaearch  data  which 
they  control,  in  accordance  with  policiea  of  the  contracting  boarda.  At 
the  aaoe  time,  the  JJoard  of  Truateea  reaffirma  ita  long-atanding  coiwitment 
^    to  protect  the  individual  privacy  of  our  teat-tak^ra  m  the  releaae  and 
uae  of  teat  and  reaearch  data. 

Finally,  the  ETS  Board  of  Truateea  herewith  urgea  all  profit  and 
nonprofit  teating  corporationa  in  the  United  Statea  to  join  with  it  in.  , 
voluntarily  developing  an  induatry-wide  "Code  of  Fair  Teating    for  the 
development  and  adminiatrat ion  of  educational  teating  nationwide.  We 
recomoend  that  thia  Code  be  baaed  on  the  new  standard,  being  developed  by 
the  American  Paychological  Aaaociacion,  the  American  Educational  Reaearch 
Aj^aociation,  and  the  National  Council  on  Meaaurement  lA  Education.  We 
further  propoae  that  a  panel  be  appointed  jointly  by  theae  three 
aaaociationa  to  monitor  the  induatry-wide  "Cod/  of  Fair  Teating"  and  we 
cotamit  ETS  to  cooperate  fully  with  auch  a  panel.    Thua,  m  addition  to 
the  actiona  we  have  taken  on  behUf  of  Educational  Teating  Service,  we 
offer  to  jo'in  other  teating  corporationa  in  a  national  effort  to  promote 
openneaa  in  teating. 
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PUBLIC  INTEREST 
PRINCIPLES 

for  the  Design  and  Use  of 
Admissions  Testing  Programs 


By  resolution  dated  October  6,  1981,  the  Board  of  Trustees  of  Educational 
Testing  Service  formally  adopted  as  policy  for  ETS  these  Public  Interest  Princi- 
ples for  the  Design  and  Use  of  Admissions  Testing  Programs.  These  princi- 
ples were  originally  proposed  for  public  discussion  on  December  30, 1979, 
by  the  leaders  of  Educational  Testing  Service  and  four  other  organizations 
responsible  for  major  national  admissions  testing  programs.  They  address 
concerns  that  have  been  raised  about  the  design  and  use  of  standardized 
tests  in  admission  to  higher  education,  e.g.,  public  access  to  test  questions 
and  answers,  verification  of  scoring  procedures,  and  appropriate  use  of  the 
Information  derived  from  testing  programs.  Educational  Testing  Service 
strongly  supports  these  principles  and  is  committed  to  working  with  spon- 
soring groups  to  implement  the  principles  in  the  admissions  testing  pro- 
grams with  which  it  is  associated. 

Principles 

A  number  of  the  principles  enumerated  below  have  been  cornerstones  of 
most  testing  programs  for  some  years.  We  believe  it  is  important,  however, 
to  reaffirm  them  here  to  provide  a  fuller  view  of  our  beliefs  and  our  expecta- 
tions for  the  future. 

We  recognize  the  legitimate  interest  of  the  public  in  knowing  what  the 
tests  contain  and  their  efficacy  in  performing  their  intended  functions. 
Therefore,  we  will  implement  the  principle  of  publication  of  test  con- 
tent to  a  degree  limited  only  by  reasonable  safeguards  of  efficiency, 
cost,  quality,  and  the  educational  impact  of  the  programs. 

We  fully  support  the  principle  of  equity  and  we  will  continue  to  main- 
tain and  strengthen  credible  procedures  for  detecting  bias  and  eliminat- 
ing it  from  the  content  of  the  tests,  while  making  such  procedures  visi- 
ble to  the  public.  * 

We  recognize  the  need  for  routine  procedures  that  allow  the  test  taker 
to  arrange  for  verification  of  the  accuracy  of  the  procedures  determin- 
ing the  score  attributed  to  him  or  her.  ' 


1 

2 
3 
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A  We  believe  that  tests  should  be  readily  available  to  all  individuals, 
regardless  of  conditions  such  as  physical  handicap  or  religious  beliefs 
that  may  prevent  the  taking  of  exams  under  circumstances  that  meet 
the  converiience  of  the  majority. 

C  We  recognize  that  tests,  together  with  the  procedures  for  scoring  them 
^  and  reporting  the  results,  should  be  designed  to  provide^test  takers 

with  as  much  useful  information  as  may  be  feasible  about  the  specifics 

of  their  performance  on  the  tests.  ' 

^  We  reaffirm  the  right  of  individuals  and  institutions  to  privacy  with 
regard  to  information  by  and  about  them,  which  should  be  safeguarded 
from  unauthorized  disclosure. 

"7  We  recognize  the  need  to  formulate,  maintain,  and  publish  widely  prln- 
ciples  of  appropriate  use  of  scores  and  other  test  jpformation  derived 
from  testing  programs  and  to  be  alert  to  and  actively  discourage  mis- 
use. \  ^  - 

Q  We  recognize  that  both  the  institutions  making  use  of  test  scores  and 
the  test  takers  themselves  should  have  michanisms  through  which  to 
express  their  legitimate  interests  concerning  the  design  and  operation 
of  testing  programs  and  the  use  of  information  derived  from  them. 


Operational  Elements 

The  separately  constituted  and  governed  groups  sponsoring  testing  pro- 
grams may  choose  to  implement  these  principles  in  different  ways.  This 
probable  diversity  st^s  from  differences  in  .the  nature  and  purposes  of  the 
tests  m  the  several  programs  and  from  the  specifics  of  their  structure  and 
operation.  Examples  of  possible  approaches  include  the  following: 

-j  Each  prospective  examinee  should  be  able  to  receive  a  full-length  sam- 
pie  of  each  test,  similar  to  the  one  he  or  she  will  take,  with  the  [ntended 
ansvyers  and  with  instructions  for  self-acjniinistration  and  self-scoring. 

O  For  tests  given  to  a  sufficient  number  of  students  annually  to  support 
the  cost,  at  least  one  operational  form  of  the  test  should  be  published 
periodically,  in  addition  to  the  regular  sample.  A  specific  schedule  of 
publication  should  be  designated  for' each  program. 

O   Non  technical  information  about  the  testing  j)rogram  should  be  fur- 
nished  routinely  to  test  takers,  users,  and  the  general  public.  It  should 
.  include  a  description  of  what  each  test  measures,  the  error  of  measure- 
ment, how  the  scores  are  intended  to  be  used,  and  a  summary  of  the 
validity  of  the  scores  for  the  intended  uses. 
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A  A  technical  publication  should  provide  information  on  the  same  topics 
in  sufficient  depth  to  permit  professionals  in  the  field  to  assess  the  evi- 
dence and  the  accuracy  of  the  non-technical  summary. 

C  Studies  of  the  use  of  the  test  by  professionals  other  than  those  in  the 
sponsoring  or  administering  agency  should  be  actively  encouraged  and 
facilitated  by  provision  of  the  necessary  data  with  safeguards  for  indi- 
vidual privacy.  The  results  of  those  studies  should  be  published  in  regu- 
lar journals  and  also  incorporated  in  the  technteal  and  non-technical 
publications. 

The  test  sponsor  should  ensure  that  operational  forms  of  the  test  are 
independently  reviewed  before  they  are  given.  The  review  should  in- 
clude the  appropriateness  of  the  content  of  the  lest  and  in  particular 
should  seek  to  detect  and  remove  potential  racial,  cul^jral  or  sex  bias 
4  or  other  influences. extrinsic  to  the  characteristics,  skills  or  knowledge 
to  be  measured.  The  review  should  also  determine  that  the  operational 
form  is  fairly  represented  by  the  sample  test  already  distributed. 

y  Test  takers  should  have  the  pght  to  question  the  accuracy  of  scoring, 
administrative  procedures,  specific  questions  in  a  test,  or  allegations  of 
irregulanties  in  test  administrations.  Current  procedures  to  deal  with 
this  nght  should  be  reviewed  and  modified  if  necessary  to  ensure  a  fair 
and  prompt  response. 

We  hope  communication  of  these  principles  and  .operational  guidelines 
leads  to  greater  understanding  and  constructive  diafogue  about  the  impor- 
tant issues  surrounding  testing.  We  stand  ready  to  work  with  all  interested 
groups  in  discussion  of  the  policies  and  improvement  of  the  procedures 
under  which  testing  programs  are  conducted.  ■ 


\ 


.  415 


Appendix  C 


'  ETS  STANDARDS 
FOR  QUALITY 
AND  FAIRNESS  • 

Adopted  by  the  Board  of  Trustees  ♦  October  1 981 


'        Educational  Testing  Service  •  Princeton.  New  jersey 


416 

3 

PREFACE 


By  resolution  dated  October  6, 1981,  the  Board  of  Tiustees  of  Educational  Test- 
ing Service  provided  for  standards  for  quality  and  fairness  applicable  to  all  ETS 
activities. 

BE  IT  HtRlBY  WSOlVEO  that  the  Board  of  Trustees  of  the  Educational  Testing 
Service 

1.  Adopts  as  ETS  policy  and  approves  as  ns  Standards  for  Quatity  and 
FiVmess  the  principles  and  policies  previously  set  forth  by  ETS  manage- 
ment in  Its  publication  entitled  Principles,  PoUciqs  and  Procedural 
Cwdolines  Re^ardtn^  CIS  Products  and  Services, 

2,  Endorses  the  procedural  guidelines  developed  andpublished  by  man* 
agemeni  to  implemerit  these  principles  and  policies; 

^.  Directs  management  to  continue  its  program  of  monitoring  adherence 
^^to  the  procedural  guidelines  across  ETS  program^s  and  services,  to 
revise  the  guidelfnes  as  appropriate,  and  to  make  an  annual  report  to 
the  Board  regarding  such  efforts; 

4.  Authorizes  management  to  provide  for  alternative  procedures  which 
can  accomplish  or  hold  promise  of  accomplishing  the  principles  and 
polifi^^s  included  in  the  Standards  and  to  make  provision  for  small, 
now  or  specialized  programs  that  have  special  needs;  and 

S  Directs  the  Trustee  Committee  on  Public  Responsibility  to  prepare 
annually  an  Accountability  report,  to  be  released  publicly,  which  eval- 
'  uates  actions  taken  by  ETS  m  accordance  with  the  ETS  Srandards  hr 
QUiilityiindUifncss 

The  Standards  are  designed  to  ensure  that  ETS  products  and  services  meet 
demonstrable  ciiteria  with  respect  to  seven  areas  of  basic  importance: 
Accountability,  Confidentiality  of  Data,  Product  Accuracy  and  Timeliness, 
Research  and  Development,  Tests  and  Measurement,  Test  Use.  and  Technical 
Assistance,  Advice,  and  Instruction.  The  first  three  sections  of  the  Standards 
deal  with  issues  that  relate  to  all  ETS  activities:  the  responsibilities  of  ETS  to 
those  affected  by  its  activities,  the  rights  to  and  limitations  on  access  to  data 
collected  by  ETs.  and  /he  control  of  quality  and  performance  according  to 
commitments.  The  remaining  sections  concern  issue5  relating  to  ETS's  mA'm 
endeavors:  Research  and  Development,  Tests  and  Measurement,  Test  Use, 
and  Technical  Assistance,  Advice,  and  Instruction. 

The  Standards  are  drawn  from  particular  circumstances  and  needs  at  EIS  and 
reflect  its  objectives.  Because  of  tljeir  origin  and  purposes,  the  Standards  may 
not  hg  useful  to  orgamzations  whose  practices,  programs,  or' services  differ 
from  those  of  ETS, 
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The  Siandnrd$  are  implemented  by  ETS  management  through  procedural- 
guidelines  which  provide  more  detailed  and  specific  guidance  for  ns's  diverse 
prograijis  and  services.  These  procedural  guidelines  are  reviewed  and  revisod 
from  tmie  to  time  by  management  as  new  or  alternative  approaches  are 
developed.  Management  also  reviews  special  applications  that  are  necessary 
to  meet  the  needs  of  particular  programs. 

ETS  bel^|jves  that  the  Standards  contribute  significantly  to  the  quality  and  utility 
of  Its  products  and  services  for  clients  and  consumers,  ns  does  not  have  com- 
plete responsibility  or  authority,  of  course,  to  determine  how  the  Standards 
will  be  implemented  in  activities  for  which  policy  is  substantially  established 
by  a  sponsoring  group  or  mstilution  other  than  aS.  US,  however,  encourages 
and  assists  ihuse  groups  and  institutions  to  implement  the  Standards  as  their 
acrivUies  are  related  to  ns  products  and  services- 

m  reviews  ali  its  programs  regularly  to  assess  compliance  with  the  Standards 
as  pdft  of  iti  quality  assurance  effort.  To  assist  the  Trustees  to  ensuie  that  the 
Standards  are  interpreted  and  applied  according  to  their  spirit  and  purpose,  a 
ViMling  Committee  of  persuns  outside  ETs  who  are  knowledgeable  in  the  spe^ 
ciadzed  aspects  ot  the  Standards  has  been  authorized  by  the  Board  to  review 
periodically  the  tls  assessment  process.  Beginning  m  1<)82.  the  Commillee  on 
Public  Responsibility  of  the  tTs  Board  of  Trustees  will  issue  a  public  report 
annually  on  how  the  organization  is  meeting  these  Standards 

These  efforts  refleu  ^^ss  determination  to  hold  itself  accountable  to  highsiarv 
dards  ot  performance  in  order  to  safeguard  the  public  interest  and  the  interest 
of  individuals  using  its  products  and  servic  es. 

w 

October  1901  •         ^  ^ 


/ 


Gregory  R.  Anrig 
President 
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ACCOUNTABiLITY 


Principle  ' 

£75  ickno w/edges  re$pons/b''*'y  tot  the  effecttve  steviardship  of  its  resources 
to  the  New  York  Board  of  Regents  which  has  issued  its  corporate  charter,  to 
the  governing  boards  that  sponsor  and  set  policy  for  prograiDs  or  service*  in 
'  which  ij$  products  or  serv/ces  are  used,  to  the  individuals  and  committees 
that  advise  fT$  with  respect  to  appropriate  policy  fonts  programs,  to  the  insti- 
tuti^s  and  agenaes  that  use  f  rs  products  and  services,  to  persons  who  take 
f  rs  tests  (and  parents  or  guardians  of  minor  persons),  submit  data  for  use  by 
ETS  or  for  distribution  to  Others,  or  participate  in  research  and  development 
projects  conducted  by  CTS,  and  to  the  professional  associations  that  are  con- 
cerned with  educational  and  psychological  measurement  and  research 

Policies 

o 

A.  {IS  will  furnish  appropriate  information  to  those  to  whom  it  is  respuniible  so 
they  may  make  informed  independent  judgments  as  to  the  effectiveness  with 
which  £TS  exercises  its  stewardship. 

B  ns  will  seek,  consider  and,  as  appropriate,  act  on  the  views  of  those  who 
sponsor,  usC  or  are  affected  by  ErS  prograrns  and  services- 

^  ETS  will  seek  to  obtam.jjyj^i)ajli^ctivmes4D<ipQhc  qualifted_men^ 
and  worsen  who  are  riot  employed  or  retained  on  a  regular  basis  by  tii>  and 
who  are  drawn  from  appropriate  professional  disciplines,  major  philosophies 
and  points  of  view,  different  geographic  regions,  and  the  major  ethnic  group:* 
within  the  relevant  population.  ^ 

0.  ETS  will  support  the  activities  of  professional  associations  with  respect  to 
developing  and  implementing  professional  standards  or  codes,  making  avail 
aole  the  results  of  current  work,  and  fostering  peer  review  of  its  activities. 

Procedural  Guidelines 

1,  Information  should  be  provided  to  sponsoring  organizations  with  which 
has  contractual  relationships^ in  a  form  that  permits  evaluation  of  as  services 
in  term*;  of: 

a.  quality;  c,  costs;  and 

"b.  timeliness,       d.  responsiveness  to  legitimate  comments  Or  criticisms. 
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2  Procedures  should  be  established  to  facilitate  communication  with  sponsors 
;  by: 

a.  ineeimgai  least  annually  to  provide  mformaiion  and  to  receive  comments 
•on  matters  affecting  the  operations  with  which^hey  are  concerned; 

b.  defining  a  mutually  agreeable  process  to  be  used  to  transmit  comments 
from  sponsors  or  others  and  a  time  period  within  which  the  evaluation  of 
comments  will  b2  completed  and  reports  of  actions  to  be  taken  by  ETS  can 
be  expected;  and 

c.  making  available  periodic  opportunities  for  sponsors  to  express  opinions, 
judgments  and  counsel  concerning  their  afttiviiies  or  programs  directly  to 
as  officers  not,normaIly  responsible  for  such  activities  or  programs. 

3.  Procedures  should  be  established  for  making  available  technical  and  other 
information  about  £TS  products  and  services  to  users  so  that  they  may  eval- 
uate the  approf^iate  use  of  the  product  or  service  and  communicate  com- 
ments or  criticisms  to  ETS. 

4.  Procedures  should  be  established  to  communicate  with,  or  provide  informa- 
tion to,  persons  who  use  or  take  as  teto,  who  submit  data  for  use  by  as  or 
for  distribution  tp  others,  or  who  participate  in  research  and  development 
projects  conducted  by  ETS.  This  information  should  be  communicated  by  ETS 
or  the  sponsor  m  such  a  way  that  these  persons  may  understand  their  partici- 
pation with  respect  to: 

a.  the  identity  and  scope  of  the  sponsor's  responsibility; 

b.  the  nature  of  the  product,  service  or  research  by  which  they  are  affected; 

^  c.  the  way  in  which  the  product,  service  or  research  will  likely  be  ujed  by 
eBucaiionaVinstitutfons  or  ^niersTarid 

d.  the  channels  that  have  been  established  for  addressing  comments  or  criti- 
cisms to  ETS  or  to  the  sponsor  and  response  thereto. 

5.  Organizational  and  program  financial  information  should  be  recorded,  pro- 
cessed and  reported  in  accordance  with  generally  accepted  accounting  princi- 
ples and  under  appropriate  safeguards  to  insure  accuracy. 

6-  An  annual  report  that  provides  information  about  organizational  activities  and 
finances  should  be  published  by.ETS  on  a  regular  basis  and  made  available  to 
any  person  on  ^request.  Program  and  project  reports,  including  program  finan- 
cial information,  should  be  made  available  m  a  manner  consistent  with  con- 
tractual understandings. 
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7.  Requests  for  mformaiion  that  is  not  included  in  an  existing  publication'should 
be  considered  by  the  appropriate  sponsor  and  by  ETS.  If  its  disclosure  is  consis- 
tent with  applicable  law,  with  ETS  and  sponsor  policy,  and  with  contractual 
obligations  governing  confidential  or  proprietary  mformation,  the  information 
should  be  provided.  If  complying  with  a  request  for  information  results  in  a 
cost;o  ETS  or  a  sponsor  or  affects  the  normal  schedule  of  fulfilling  as  s  resporv 
sibilities,  ETS  may  provide  the  requested  information  in  a  reasonable  period  of 
time  and  at  an  appropriate  price  for  the  services  rendered.  Procedures  should 
i5e  established,  as  appropriate,  to^acilitate  responses  to  these  requests 

8.  Changes  m  federal  statutes,  regulations  and  case  law  that  affect  research  and 
development,  testing  programs,  or  advisory  and  instructional  services  should 
be  monitored  to  ensure  that  ETS  activities  and  operations  are  in  compliance  as 
relevant  federal  laws  or  rules  change.  Changes  m  other  statutes,  regulations 
and  case  law  should  be  evaluated,  as  appropriate,  forthe  same  purpose. 

9.  All  proposed  new  ets  activities  should  be  reviewed  by  counsel  for  compliance 
with  applicable  federal  law  and  state  law,  as  appropriate.  ETS  officers  and  staff 
should  direct  the  attention  of  legal  counsel  to  matters  that  might  affect  ETS 
compliance.  .  ^ 

10.  Advjce  should  be  sought,  where  appropriate,  from  men  and  women  drawn 
from  diverse  backgrounds,  interests  and  experience  (e.g.,  appropnate  profes- 
sional disciplines,  major  philosophies  and  points  of  view,  vanous  geographic 
regions,  and  major  ethnic,  handicapped  and  other  relevant  subgroups  of  the 
population  of  interest)  who  are  qualified  to  make  a  contribution  to  the  direc- 
tion and  substance  of  115  programs  and  who  are  not  employed  or  retained  on 
a  regular  basis  by  ETS. 

11.  Individuals  who  become  members  of  an  ETS  external  advisory,  review X)r  eval 
uation  committee  should  be  informed  about  the  results  of  the  committee's 
work  in  a  reasonable  period  ofjime. 

12.  A  reasonable  accommodation  should  be  made  with  respect  to  the  profes- 
sional  responsibilities  of  the  staff  m  order  to  pernoit  staff  members  to  attend 
professional  meetings,  to  contribute  to  the  development  of  professional  stan- 
dards or  codes,  to  participate  in  and  benefit  from  the  dissemination  of  infor- 
mation on  subjects  of  professionahnterest,  and  to  stay  abreast  of  current  con- 
cerns and  accomplishments  in  related  fields. 


13.  ETS  should  have  effective  procedures  for  peer  review  whenever  it  will  contrib- 
ute substantially  to  the  quality  of  ETS  work. 

14.  ETS  should  have  effective  and  equitable  procedures  for  handling  questions  of 
store  authenticity  ansing  m  connection  with  the  administration  of  tests 
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CONFIDENTIALIP^ 

Principle 

I  r>  recugniZfi  iha  n^ht  ut  mdtvidudfs  <ind  in}>UtuUun^  to  pn\aCY  with  f^^ard  to 
mtormation  iupp/ifd  by  <inc/  iibout  them  that  may  be  stored  in  data  or 
fvivanh  tilvi>  hvfd  by  ih  .md  thv  ^oncomttant  re^ponMity  to  safeguard 
information  m  it$  fifc$  from  unauthorized  disclosure 

Policies 

A.  m  wtll  ask  individuals  to  provide  informahon  about  themselves  only  if  it  is 
potentially  useful  to  those  individuals,  necessary  to  facilitate  processing  of 
data  or,  serves  the  public  interest  in  improving  understanding  of  human  perfor- 
mance. Insofar  as  possible,  individuals  should  be  informed  of  the  purpose  for 
which  the  information  is  requested. 

B.  The  fight  ol  individuals  to  privacy  regarding  information  about  them.that  may 
be  stored  m  the  data  or  research  files  held  by  £T5  extends  both  to  processed 
information,  such  as  scores  based  on  test-item  responses,  and  the  raw  data  on 

*,        which  the  processed  information  is  based. 

C.  £TS  will  protect  the  confidentiality  of  data  supplied  by  institutions  or  agencies 
about  themselves,  and  so  identified,  to  the  extent  that  such  confidentiality 
does  not  conflict  with  £TS's  obligations  to  individuals. 

D.  ET!>  will  not  collect  or  maintain  m  its  data  or  research  files  any  critical  informa- 
tion that  in  Its  judgment  cannot  be  protected  adequately  from  improper  dis- 
closure, 

E.  E^s  will  encourage  the  organizations  with  which  it  works  to  adopt  policies  and 
-procedures  that  adequately  protect  the  confidentiality  of  the  data  transferred 
bytfsTo  those  organizations, 


Procedural  Guidelines 

1.  Information  about  an  individual,  which  has  been  identified  as  such,  may  not 
be  released  by  ets  to  organizations  other  than  those  for  which  the  information 
was  collected  without  the  consent  of  that  individual.  A  written  exception  may 
be  made  in  the  case  of  research  studies  during  which  the  Committee  on  Prior 
Review  of  Research  has  determined  that  release  of  the  data  serves  a  public 
need,  that  there  is  no  satisfactory  and  reasonable  alternative  way  of  obtaining 
the  information,  that  the  recipient  researcher  will  use  the  data  in  appropriate 
ways  and  that  there  are  adequate  assurances  of  confidentiality. 
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2.  Information  about  an  institution,  which  has  been  identified  as  Such,  may  be  ^ 
released  from  eT5  only  in  a  manner  consistent  with  a  prior  agreement  or  with 
the  consent  of  the  institution  or  with  the  approval  of  the  cognizant  ns  officer 
arxJ  representative  of  the  appropriate  sponsor  (if  any). 

3.  An  individual  should  be  able,  on  payi^ent  of  a  reasonable  fee,  to  authorize 
the  disclosure  of  information  about  himself  or  herself  from  program  data  files 
held  by  LT3  to  any  appropriate  recipient,  provided  that  such  authorization  is  in 
writing  and  that  disclosure  is  not  inconsistent  with  other  ETS  or  sponsor  polf 
ci^s  and  6q£Si  not  violate  the  privacy  of  other  individuals.  Identification  of  the 
reguest^th rough  signature  and^data  file  number,  or  other  appropriate  meth- 

--'"od  should  Be  required  before  any  such  information  is  released. 

4.  In  an  emergency  and  when  it  is  to  the  benefit  of  the  individual,  an  authoriza- 
tion by  telegram  or  telephone  for  the  release  of  personal  data  3k«uld  be 
acceptable,  provided  that  such  authorization  includes  adequate  i.dentifying 
information  and  that  such  release  is  not  inconsistent  with  other  ETSprspbnSor 
policies.  By  pnor  agreement  with  theindividual,  authorization  by  a  designated 
agency  or  institution  should  also  be  acceptable.  In  such  instances,  the  individ- 
ual should  be  informed  that  the  disclosure  has  taken  place. 

5.  if  an  individual  is  not  competent  because  of  illness  or  other  considerations, 
inforrpation  about  that  individual  may  be  released  from  data  files  only  with 
the  consent  of  the  individual's  parent  or  legally  appointed  guardian 

6.  Unless  the  access  to  confidential  data  can  be  safeguarded,  ETS  should  not  par- 
ticipate in  any  time-sharing  network,  data  bank,  or  other  electronic  data  pro- 
cessing  or  storage  sysltrni  involving  units  outside  i'iS. 

7.  On  submission  of  appropriate  identifying  information  and  payment  of  a  rea- 
sonable fee,  an  individual  should  be  able  to  obtain  information  about  himself 
or  herself  in  tTyheld  data  files  for  the  following  purposes,  to  ascertain  the 
accuracy  of  personal  or  biographical  data  and  to  request  verification,  within  a 
reasonable  pp'iod  of  time,  of  test  scores  or  other  processed  information  from 
tests,  questionnaires,  or  school  records,  provided  such  release  is  consistent 
with  sponsor  policies 

8  Procedures  should  be  developed  for  systematiLally  eliminating  from  data  files 
information  that  is  judged  to  be  out  of  date  and,  hence,  of  minimal  value. 

9.  InfofTiation  ^rom  tr^held  program  data  files  provided  by  individuals  for  a 
designated  purpose  should  not  be  used  or  released  for  another  purpose  (such 
as  a  validity  study  or  research  project)  without  the  individual's  consent  except 
when  used  or  released  in  a  form  that  cannot  be  identified  with  the  individual 
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10.  ETS  should  refuse  to  provide  personally  identifiable  information  except  in 
accordarKe  with  these  guidelines  unless  served  with  a  subpoena  or  other 
court  order.  In  that  event,  ETS  should  make  appropriate  efforts  to  quash  or  nar- 
wwX\\e  subpoena  or  order  or  to  obtain  a  protective  order  to  minimize  the 
exftosure  of  personally  identifiable  information. 


11.  At  the  time  information  is  collected  and  to  whatever  extent  practical,  pro- 
grams should  inform  individuals  of  the  conditions  surrounding  the  release  and 
conndentiality  of  the  information  about  them. 

12.  Individuals  should  be  identified  in  ETS  research  files  only  by  code  numbers. 
Information^  linking  the  code  numbers  to  names  should  be  kept  in  a  secure 
location  only  as  long  as  necessary  for  purposes  such  as  follow-up  studies  or 
collating  new  data,  after  which  the  names  should  be  destroyed. 

13.  Every  organization  with  which  ETS  works  should  be  informed  of  the  confiden- 
tial nature  of  any  data  transferr^  by  ETS  to  tlwt  organization  or  collected  by 
the  organization  on  behalf  of  ETS  so  that  appropriate  procedures  can  be 
employed  by  the  recipient  organization  to  protect  the  confidentiality  of  such 
data. 


\ 
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PRODUCT  ACCURACY 
AND  TIMELINESS 


Principle 

The  accuracy  of  us  5  pr/nopa/ products  and  (he  Ome/zness  with  which  thevare 
made  available  are  important  Part^  of  the  responsibi/ity  tr5  has  undertaken 
with  respect  to  /ts  sponsors  and  the  diverse pub//c  it  serves 

Policies 

A.  ets  will  establish  standards  of  accuracy  and  timeliness  with  respect  to  each 
.  principal  product. 

'  B.  ET5  will  use  quality  controls  that  are  adequate  to  assure  that  its  standards  of 
accuracy  and  timeliness  are  met. 

C  ETS  will  make  realistic  delwery  commitments  and  reasonable  efforts  to  meet 
those  commitments. 

0.  ETS  will  sacrifice  the  timeliness  of  the  dehvery  of  information  if  the  def^ired 
accuracy  of  that  information  is  substantially  in  question. 

E.  ETS  will  seek  to  inform  those  adversely  affected  if,  subsequent  to  its  release, 
information  has  been  found  not  to  meet  ET>  standards  of  accuracy 

F.  ETS  will  seek  to  inform  those  adversely  affected  if  there  is  a  probability  that 
there  will  be  substantial  departure  from  ETS  standaids  of  timeliness  with 
respect  to  a  principal  product. 

Procedural  Guidelines 

1  Principal  products  should  be  identified  and  a  standard  of  accuracy  usinR  units 
of  measurement  appropriate  to  the  type  of  product  should  bo  established  for 
each. 

2  When  appropriate,  quality  control  should  include  an  adequate  and  indopen- 
dent  recomputation  and  a  visual  reexamination  of  ETS-processed  information 
based  on  an  appropriate  sample  of  cases  sufficient  to  identify  errors  withi  i  the 
limits  of  the  applicable  standards  of  accuracy.  ^ 
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3.  When  the  compuiahonal  naiure  of  the  information  is  such  that  it  is  impossible 
or  impractical  to  determine  the  accuracy  of  the  information  by  independent 
recomputation.  staff  members  who  are  technically  competent  to  do  so  should 
assessits"reasonabIeness"asa  part  of  quality  control. 

4.  There  should  be  a  quality  inspection  of  intermediate  products  when: 

a.  the  accuracy  of  variable  information  (e.g.,  parameter  data,  algorithms), 
verified  by  independent  reconiputation  or  assessment,  influences  the 
nature  of  an  [TS  process  or  computotion  and  is  critical  to  the  process  that 
generates  an  ET^  principal  product;  or 

b.  detection  and  correction  of  errors  would  facilitate  meeting  the  delivery 
commitment  on  the  pnncipal  product;  or 

c.  the  nature  of  the  principal  product  is  such  that  it  is  impossible  or  imprac- 
licaf  to  determine  the  accuracy  of  the  information  by  independent  compu- 
tation using  the  source  data. 

5.  Quality  control  for  principal  products  that  do  not  contain  processed  i;iforma- 
tiOn  (such  as  bulletins  of  information  or  test  books^should  include  inspection 
of  a  sample  pnor  to  release  of  the  product.  If  th^product  is  released  from  an 
outside  vendor  (e.g.,  outside  publisher)  or  a  sponsor's  agent,  quality  control 
should  include  inspection  of  those  components  of  the  principal  product  that 
contain  cntical  information  on  EK-prOvided  serv.ces. 

6.  Quality  control  of  information  given  in  letter  or  telephone  responses  should 
include  a  periodic  Qudit  of  a  sample. 

7.  Failure  to  meet  standards  of  accur,acy  and  timeliness  should  be  reported  to  a 
designated  ITS  staff  member  for  resolution. 

8.  A  pnncipal  product  that  does  not  meet  established  standards  of  accuracy 
should  not  be  released  until  appropriate  corrective  action  is  taken,  unless 
release  would  be  for  the  benefit  of  the  score  recipient  and  users  and  permis- 
sion to  release  is  given  by  the  cognizant  US  officer, 

9.  If  an  error  is  found  in  critical  information  already  released  by  CIS,  the  correct  ' 
information  Should  be  promptly  cistributed. 

10.  Process  cuntrul  methods  (o,g„  a  predefined  scliedule  including  a  delivery  date 
and  contingent)  procedures  for  dealing  with  volume  surge)  should  be  estab- 
lished for  the  production  of  each  principal  product  to  help  assure  its  delivery 
by  the  scheduled  delivery  date 

11  If  It  IS  likely  that  there  will  be  a  substantial  departure  from  Hs  standards  of 
timeliness  with  respect  to  a  pnncipal  product,  those  who  would  be  adversely 
affected  should  be  so  notified. 
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RESEARCH  AND  DEVELOPMENT  • 


Principle 


A  connn(Hng  ptogram  of  research  and  c/eve/opmen(  conducfed  /n  comp/wnco 
With  professional  sfandardi  vwth  rCipect  to  quahty  and  e(h/ca/ procedures 
necessary  to  ma/nM/n  the  high  qiu^hly  andsoc/a/  i/t///ty  0/  f  rs  confrjbvt/ons 
cdi/caf(On.  This  /nc/udes  bas/c  inqmy  to  increase  i/ndersfandmg  0/  educa- 
ttonal  processes  and  human  deve/opmen(,  eva/i/a(<ve  and  applied  research  in 
response  to  the  needs  of  the  educational  community,  and  research  and  devel- 
opment to  improve  in  products  and  services.  Publication  of  the  results  of  Sig- 
nificant £75  research  is  of  bcnof,t  to  tjb  and  the  process/on  because  perm/($ 
others  to  use,  build  upon  or  improve  £75  work 


Policies 

A,  ns  will  devote  appropriate  research  efforts  to  improving  educaiion  through 
the  discovery  .and  conceptual  integration  of  new  principles  and  understand- 
ing. This  research  will  be  aimed  at  extending  knowledge  of  the  learner  and 
learning  processes,  of  learning  environments  and  educational  treatments,  of 
educational  institutions  and  of  the  interacting  factors  that  influence  human 
development. 

B,  £TS  will  devote  appropriate  research  efforts  to  the  improvement  of  the  tech- 
nical quality  of  ETS  products  and  services.  Among  the  important  issues 
addressed  by  this  research  will  be  problems  of  test  development,  reliability, 
equating,  validity,  and  meaningfulness  of  interpretation. 

C,  ns  will  devote  appropriate  research  and  development  efforts  to  the  idenlifica^ 
tiun  of  needs  of  the  educational  community  and  to  the  creation,  improvement 
and  evaluation  of  instruments,  systems  and  programs  of  service  that  meet 
these  needs. 

0.  £TS  will  conduct  its  research  under  appropriate  procedures  that  protect  the 
rights  of  pnvacy  and  confidentiality  of  human  subjects  or  respondents 

L  £1S  will  follow  procedures  to  insure  that  ITS  research  is  of  high  quality  Stan- 
dards  of  quality  m  research  refer  to  such  matters  as  the  identification  of  rele- 
vant data,  the  choice  of  suitable  methods  of  collecting  and  analyzmg  data,  the 
logic  and  objectivity  ot  analysis  and  interpretation,  the  exploration  of  relation 
ships  between  research  problems  and  findings,  on  the  one  hand,  and  existing 
knowledge,  theories  and  methodologies  on  the  other,  and  the  thoroughness 
and  care  of  project  planning  and  management. 
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F.  ns  will  undertake  research  only  if  its  potential  benefits  cAj'iweigh  the  inconve- 
niences of  or  nsks  to  the  subjects  or  respondenis  who  are  involved. 

C.  ns  will  encourage  the  dissemirwtioni  of  full  accounts  of  tis  research  m  the 
usual  professional  forums  and  will  provide  internal  means  by  which  the  results 
of  ETS  research  can  be  puhtished. 


1.  To  maintain  the  quality  of  operational  programs,  ETS  should  engage  in  the  fol- 
lowing activities: 

a.  study  and  research  on  ihe  test  development  process,  including  systematic 
'  development  and  evaluation  of  new  item  types  and  approaches, 

b.  studies  to  determine  the  sources  of  significant  differentia!  performance  of 
sex,  ethnic,  handicapped,  and  other  relevant  subg(,oups  on  ns  tests; 

c.  periodic  evaluation  of  current  approaches  to  aptitude  and  achievement 
measurement  to  detormine  fairness,  validity  and  appropriateness  for  signif- 
icant subgroups  such  as  minorities  and  women; 

d.  research  related  to  reliability  theory  and  practice,  including  qiethods  of 
determining  the  reliability  of  classification  decisions;  .  _  - 

e.  study  of  the  equating  methods  presently  m  use  and  development  of 
improved  methods  as  limitations  in  the  applicability  of  the  present 
methodsare  observed;  and 

f.  research  to  advance  measurement  techniques  and  selection  and  classifica- 
tion models  relevant  to  fairness  and  validity. 

2.  Research  projects  should  be  undertaken  m  such  areas  as  learning  and  cogni- 
tion, personality  and  social  influence,  teacher  behavior  and  instructional  pro- 
cesses, socialization  and  human  development,  and  the  economics  and  sociol* 
ogy  of  education  as  a  means  of  improving  educational  policies  and  practices 

3.  Efforts  should  be  made  to  develop  instruments  and  programs  of  service  in 
areas  such  as  measurement,  institutional  and  program  assessment  and  evalua- 
tion, instruction,  guidance,  financial  ud,  certification  and  licensing,  and  tech- 
nology that  would  be  of  educational  and  social  utility. 

4.  Proposals  for  research  to  be  conducted  by  ers  and  involving  human  subjects 
or  respondents  should  be  considered  by  the  Committee  on  Prior  Review  of 
Research,  under  its  procedures  for  review,  to  verify.diat  proper  arrangements 
have  been  made  for  protection  of  the  welfare  and  rights  of  human  subjects. 


Procedural  Guidelines 
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5.  Researchers  should  not  conduct  research  projects  wahout  the  consent  of  sub- 
jects and  respondentsrin  the  case  of  young  children,  the  consent  of  parents  or 
a  legal  guardian,  or  of  appropriate  institutional  representatives,  should  be 
obtained. 

6.  Each  research  proposal  should  be  reviewed  by  one  or  more  persons  who  are 
competent  in  the  field  withm  which  the  proposal  falls.  They  should  be  satisfied 
that  professional  standards'of  quality  and  ethical  ^nduct  are  met. 

r.  Identifiable  data  should  be  released  from  ETs  to  researchers  other  than  those 
who  oiiginally  conducted  the  research  only  when  one  of  two  conditions  have 
been  met: 

a.  Consent  to  do  so  has  been  given  by  or  on  behalf  of  the  subjects  oTrespon- 
dents  or  by  these  who  have  given  consent  on  their  behalf;  or 

b  the  Committee  on  Prior  Review  of  Research  has  determined  that  release  of 
the  data  serves  a  public  need,  that  there  is  no  satisfactory  and  reasonable 
alternative  way  of  obtaining  the'lnformation,  that  the  recipient  researcher 
will  use  the  data  in  appropriate  ways  and  that  there  are  adequate  assur- 

\  ances  of  confidentiality- 

8.  After |he  data  collettjon  phase  of  a  research  project  h«is  been  completed,  sub 
ie*.is  s^puld  not  be  expected  to  provide  additional  data  for  a  follo\N?-up  study 
unless  such  participation  was  part  of  their  original  agreement  to  ^erve  as  sub^ 
jects,  or  t^ir  consent  for  follow-up  is  obtained  or  the  follow-up  study  has 
been  approv)^>d  by  the  £ts  Committee  on  Prior  Review  of  Research. 

9,  The  results  of  mi£»asure5  of  performance  based  on  experimental  situations  or 
le^s,  the  interpreti^tion  of  which  is,  therefore,  tentative,  and  whose  applied 
use  li  not  yet  supportable,  should  not  be  reported  to  subjects,  or  to  the  insti- 
tutions providing  the  ^<ibjects,  unless  there  is  relatively  little  danger  of  misin 
terpretation  or  misuse  qf  the  information  that  would  be  harmful  to  those 
individuals  or  institutions,  ^or  unless  the  use  is  part  of  a  feasibility  study  or 
experimental  condition.  $tif)ulatiOns  regarding  nonissuance  of  such  reports 
should  be  made  to  participants  in  advance  of  the  data  collection 

\^ 

10.  The  results  of  each  research  projec^t  undertaken  with  respect  to  a  particular  tis 
program  or  ser\ice  should  be  available  for  dissemination  unless  a  specific 
need  to  restrict  publication  to  protect  confidentiality  or  for  other  program  pur 
poses  IS  identified  pnor  to  the  begmnih^  of  the  project  and  made  know  n  to 
the  appropriate  individuals.  \ 

1.  The  Contracts  under  which  research  is  undertaken  for  agencies  or  institutions 
outside  crs  should  permit  publication  of  the  r<?sults  of  the  research  unless  a 
specific  need  to  protect  the  research  results  is  identified  prior  to  the  beginning, 
of  the  lesearch  and  made  known  to  the  appropriate  individuals. 
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TESTS  AND  MEASDREMENT- 
TECHNICAL  QUALITY  OF  TESTS 

This  sectton  which  deals  with  US  testing  activities  is  divided  into  seven  subsec- 
tions that  are  devoted  to  test  development,  test  administration,  reliability, 
scale  definition,  equating,  score  mterpretaiion.  and  validity. 

Principle 

//igh  s(anciarci5  o\  qu.i/»(y  .mci  fd/me^^  /n  <onj(aK(/ng,  administering,  fopor/ing, 
in(e/pfe(mg  onci  ev.i/u.i(inK  in  (e5(s  .ire  cen(r.i/  (o  f r^s  cm^^^^^i  'o  '^'"^"0" 
e«ecfive/y  .is  .in  educidond/  service  .ind  rese.irc/i  or^»^nizj(ion 

Policies 

A  [|s  will  Strive  to  develop  tests  m  which  the  attributes  measured,  procedures, 
followed,  and  criteria  used  will  be  unbi.ised  with  regard  to  a  heterogeneous 
group  of  examinees  and  appropriate  to  the  use'for  which  the  test  is  designed. 

B.  ITS  will  establish  standards  for  lesi-admin'istration  processes  that  minimize 
variations  in  test  performance  due  to  circumstances  or  conditions  not  relevant 
to  the  attnbutes  being  measured. 

C  Us  will  establish  for  its  tests  a  high  degree  of  reliability  (accuracy  of  me.isure- 
ment).  consistent  with  the  requirements  and  the  purposes  of  the  test 

a      will  develop  scales  for  reporting  scores  in  a  rational  fashion,  consistent 
t       with  the  requirements  and  the  purposes  '^f  the  test. 

E.  trs  will  provtdo  equating  systems,  when  appropriate,  for  the  perpetuation  of 
scales  for  reporting  scores  at  the  highest  level  of  precision  practicable 

F.  ns  will  make  available  to  sponsors,  institutional  or^agency  users,  and  exam- 
inees d.na  lor  interpreting  scores  on  m  tOsts  that  foster  appropri.ite  use  of 
those  scores. 

G  Recognizing  that  test  validation  is  a  responsibility  of  both  test  users  and  test 
developers,  ETs  will  encourage  and  assist  test  users  in  their  validation  efforts 
and  will  Itself  make  .available  tests  that  are  designed  to  meet  professionally 
acceptable  siarvJards  of  validitrprrrvKTed  the  use  of  such  tests  is  consistent 
with  the  pnmary  purposes  for  which  the  tests  were  developed 

H.  ns  will  adhere  to  appropriate  professional  standards,  such  as  those  published 
in  5Mnciards  o\  f(/(ica(rona/and/^yc/io/ogica/  fesfs  and  Pr/ncip/os  /or//K»  Va/i- 
(/anon  .in</  U^e  a/  Ter  ^o/)ne/  5e/ec(ion  Proc  cc/(i/es 


431 


Procedural  Guidelines:  Test  Development  ^ 

1,  Policy  and  substantive  contributions  to  the  test  development  process  should 
be  obtained  from  qualified  men  and  women  who  are  not  on  the  full  tmie  Staff 
of  ETS  and  wfio  are  drawn  from  diverse* backgrounds  and  appropriate  special 
ties  within  professional  fields  (e.g.,  various  kinds  of  institutions  and  programs, 
relevant  philosophies  and  points  of  view,  and  major  ethnic,  handicapped  and 
other  relevant  subgroups  of  the  f^g^ulation).  ^ 

2.  Appropriate  background  information  for  use  in  the  development  of  a  test 
should  be  documented  at  appropriate  stages  in  the  development  process  and 
includes  '  ' 

a.  the  purpose  for  which  the  test  IS  intended  to  be  used; 

b.  the  nature  of  the  population  that  will  take  the  test; 

c.  the/elevant  procedural,  firiancial  or  time  constraints  that  will  influence  the 
available  test  development  methods  and  their  likely  outcomes, 

d  for  achievement  tests,  the  kinds  of  curricula  for  which  the  test  is  designed, 
and 

e.  for  job  related  tests,  the  eterpents  in  training  or  employment  that  are 
related  to  performance  on  the  )ob. 

i.  for  each  (est,  specifications  should  be  developed  and  reviewed  by  a  process 
that  provides  information  from  the  following  perspectives* 

a«  Content  and  Skills -specifications  should  include  tKe  psychological,  educa 

lional,  or  other  domains  to  be  sampled,  the  relative  weight  to  be  given  tp 

each  domain,  the  appro priate        of  proficiency  to  be  required  within 

each  domain:  a  balance  with  respect  to  curricular  differences. 

*  • 

b.  Test  and  Item  Format-specifications  should  incli'de  the  item  (question) 
types  that  are  most  clearly  teiated  to  content  or  skills  to  be  measured,  the 
appropriate  level  of  language  or  reading,  requirements  regarding  clear  and 
comprehensive  directions  and  sample  items  or  the  need  for  a  sample  test, 
and  whether  freo-response.  multiple-choice  or  other  machmcscorable  for 
mats  can  be  used. 

c.  Psychometric-specifications  should  include  the  level  of  difficulty  of  the 
tost,  the  distribution  of  item  difficulties  (when  prete^ed  items  are  used), 
guidelines  for  evaluating  the  homogenetiy  among  items  within  a  test  and 
the  relationship  bei\seen  subtests  or  tests,  equating  requirements,  number 
of  items  and  time  allotted. 

{\.  Sensitivity-specificaiions  for  tests  should  require  material  reflecting  the 
cultural  backgrour^d  and  contributions  of  women,  minorities,  and  other 
subgroups,  specifications  should  also  require  a  balance  c'  positive  conno 
latiog^  if  negative  connotations  are  made  in  any  references  to  these 
groups. 
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4.  Except  for  tests  designed  to  measure  rate  of  perforhriance,  the  number 
of  Items  in  a  test  that  has  a  specified  time  limit  should  be  <;hosen  so  that  time 
IS  not.  a  decisive  factor  m  performance,  at  least  for  the  large  majority  of 

*  examinees.  \, 

5.  Subject  matter  and  measurement  speciaiisis  familiar  with  the  purpose  of  the 
lest.and  with  the  characteristics  of  the  intended  population  should  review  the 
test  iiqms  for  accuracy,  content  appropriateness  and  the  adequacy  with  whi<:h 
|he  items  sample  the  domain  ^ 

6.  The  individual  items  in  a* lest  should  meet  appropriate  technical  standards 
•  su'  h  as  those  contained  m  the  manuals  for  i^em  writers  used  m  the  l<?st  devei- 

o'/nient  -irea. 

7.  Individual  test  items,  and  the  test  as  a  syhole,  should  be  reviewed  to  eliiTrjnate 
language,  symbols  0/  coniem  which  are  generally  considered  potentially 
offensive,  inappropriate  for  major  Subgroups  of  the  test-taking  populati6.n  or 
serving  to  perpetuate  any  negative  attitude  svhich  may  be  conveyed  tosvard 
Ihese  subgroups.  No  item  in  any  test  should"  include  svords,  phrases  or 
description  that  is  generally  regardedas  biased,  sexist  or  racist  (e.g..  demeao- 
ing  modifiers  and  stereotypes).  * 

8  The  Items  in  a  test  should  be  reviewed  by  editorial  specialists  for  clarity,  accu- 
racy, consistency,  and,  when  appropriate,  for  conformity  with  standard  edi- 
jtoria!  style. 

9.  tests  should  contain  clear  and  complete  directions  Enough  sample  problems, 
should  be  provided  m  test-piogram  publications  so  that  the  exaBimee  can 
understand  the  nature  of  the  task  and  the  test  taking  procedures  Where  there  • 
IS  a  need  to  provide  a  general  orient^^tion  to  testing,  as  svhen  testing  young 
}  childr(Vi.  pracnce  teMs*included  either  m  descnptive  material  or  at  the  time  of 
te^tadmintstration-shouldbeused. 

\0  The  typography,  directions,  and  arrangement  of  items  m  the  lest  booklet 
should^faciliiatelhe  task  of  test  takers.  When  appropriate,  tests  should  be 
made  available  to  handlc^oped  individuals,  such  as  sight-deficient  candidates, 
through  tapes,  readers  or  special  printing. 

11  Methods  should  be  employed.to  evaluate  the  appropriateness  of  items  before 
their  operational  use  m  a  prbgram  or  before  the  reporting  of  scores  Appropri- 
ate methods  include  pretesting,  orolimmafY  ifem  analysis  (using  the  fust  oper- 
ational use  of  Items  as  an  opportunity  to  identify  inadequate  items)  or  careful 
review  of  the  results  of  administenng  similar  items  to  a  similar  population  In 
assessing  the  appropriateness  of  items  before  ^It^ir  operational  use.  efforts 
should  be  made  to  include  r^present.Ttive  s<jffiples  of  the  operationai  test- 
taking  population.  ^ 
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12.  The  operational  use  uf  each  test  shouki  be  followed  by  systematic  item  anal- 
yses using  tippropnale  criteria  and  by  test  analyses  Ihese  analyses  should 
include  reliability,  intercorrelaiions  of  sections  or  parts,  and  speededness. 

13.  Studies  relating  item  performance  to  subgroups  should  be  carried  out  for  new 
or  substantially  revised  tests  when  there  are  adequate  jala  concerning  iuffi 
cient  samples  of  large  subgroups  whose  education  and  experience  may  be  dif 
ferenl  from  the  majority  of  examinees. 

14.  The  specifications  fur  tests  in  ongoing  programs  should  be  reviewed  for  itie 
vance  and  appropriateness  before  each  new  form  is  created,  ns  staff  and 
iidvisers  should  consider  whether  changes  m  the  field,  discipline  or  curricula 
require  a  revision  of  the  specifications. 

15  When  major  changes  are  made  in  test  specificaliuns,  consideration  should  be 
given  to  the  implications  of  such  changes  for  score  comparability  and  whether 
It  IS  necessary  to  change  the  lest  name  or  otherwise  communicate  to  those 
who  mlerprOt  test  scores  that  comparisons  with  earlier  tests  may  be  inap- 
propriate. 

<^ 

16.  When  test  torms  are  used  for  a  number  of  years  m  a  program,  they  should  be 
renewed  periudtcally  for  iheir  appropriateness.  The  frequencysof  such  review 
should  be  determined  by  the  amount  of  change  occurnng  m  the  population  ot 
test  takers  or  the  subject  matter  domain.  Test  forms  ,hat  are  found  to  be  out 
dated  should  be  revised  or  withdrawr>  from  use. 


\ 
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Procedural  Guidelines:  Test  Administration 

1.  Information  should  be  made  available  to  prospective  examinees  and  (in  some 
programs,  to  parents  or  guardinrw  as  well)  in  advance  of  the  test  administra- 
tion with  respect  to  the  following,  as  appropriate: 

a,  the  purpose  of  the  test  and  what  it  measures; 

b.  the  nature  of  the  test  items  (including  samples  of  typical  item  types). 

*  c,  the  relevant  instruction's  for  taking  the  lest,  including  instructions  for 
guessing,  changing  answers,  and  strategy  involving  speed  and  accuracy  in 
taking  the  test; 

d.  identification  requirements  and  the  consequences  of  not  having  identi- 
fication; 

e.  the  consequences  of  misconduct  by  the  test  taker, 

f.  background  and  experience  relevant  to  test  performance, 

g  the  location  of  test  centers,  the  test  dates  and  special  testing  arrange- 
ments that  can  be  made, 
h  the  procedures  for  registenng  for  the  lest  and  changing  the  centers, 
I  the  structure  ot  test  fees  and  fee  waivers: 

I  special  arrangements  available  for  administenng  tests  to  handicapped 
individuals; 

k.  the  reporting  of  scores,  ^ 

rproce3ures  for  canceling  test  scores  by  the  candidate  and  reasons  why  tTS 
or  the  sponsor  of  the  test  might  cancel  scores,  and 
m.  the  procedures  for  registenng  complaints. 

Program  publications  should  be  reviewed  for  language  or  descnptions  gener- 
ally regarded  as  biased  and  offensive.  F or  example,  the  exclusive  use  of  mas- 
culine pronouns  should  be  avoided  as  should  the  implication  that  all  persons 
in  a  given  category  (for  instance,  examinees,  supervisors,  counselors,  or  teach- 
ers) are  either  females  orlmales  (unless,  of  course,  the  category  is  logically 
resuicted  to  members  of' a  single  sex).  Illustrations,  examples  and  practice 
Items  in  tesi-informaiion  publications  should  represent  males,  females,  minor- 
ity and  majonty  groups.  And  individuals  in  ways  that  indicate  respe  :  and 
awareness  of  valuable  contributions 

J.  The  lacihties  at  whtch  tests  \te  administered  should  be  places  that  are  conve- 
nient fo'  ;he  majority  ot  examinees,monsegregated  and  comfortable  At  least 
portions  of  those  facilitte'^  should  be  accessible  to  and  responsive  to  the  needs 
of  handicapped  individuals 
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4.  should  enliii  lusl  cenler  iupervisors  and  suiff  ^Uh  denionslraied  sensmviiy  17 
lo  ihe  aniicipaled  sex  and  elhnic  composilion  of  ihe  examinee  group,  based 

on  prior  experience.  When  appropriate,  persons  affihaied  with  insmuirons 
attended  by  significant  numbers  of  those  examinees  should  be  included: 
^  Minority  group  supervisors  and  or  proctors  should  be  employed  and  test  sues 
should  be  located  m  minority  communities  whenever  appropriate  and 
feasible.  } 

f: 

5,  Test  cer>ter  supervisors  and  staff  spOuld  be  lamili«ir  with  the  procedures  for 
administering  a  standardized  test  an(|  should  be  provided  with  a  description  of 
the  testing  program,  a  descrrption  of  the  candidate  population,  and  specific 
instructions  for  administering  the  test.  Instructions  concern  such  subjects  as 
ihedulwfs  of  test  supervisors,  associate  supervisors,  and  proctors,  the  receipt, 
stor.ige  and  return  ol  lest  supplies,  the  admittance  of  examinees  to  the  testing 
rooms,  the  distribution  of  test  materials,  procedures  to  be  followed  in  admin 
istering  tests  to  Iwndfcapped  individuals,  procedures  to  be  followed  in  in 
stances  of  suspected  cheating,  procedures  to  be  followed  m  other  cases  of 
candidate  misconduct,  and  procedures  to  be  followed  in  case  of  emergency. 

0  lest  perftjrmarict»  can  be  altected  by  the  psychological  atmosphOro  of  the  test 
ing  center  Test  supervisors  should  be  informed  of  this  and  instructed  to  take 
measures  tu  avoid  an  adverse  situation.  For  example,  test  supervisors  should 
be  instructed,  when  it  is  appropriate  and  feasible,  to  have  minority  as  well  as 
majority-group  persons,  women  as  well  as  men,  read  test  directions  and  to 
roc ogni/e  questions  from  examinees  following  an  impartial  procedure 

7  trs  should  provide  the  test  center  supervisor  with  directions  to  be  read  aloud 
to  examinees  before  the  test  begins  These  directions  should  include  informa 
tion  relating  to  procedures  for  marking  answer  sheets,  timing  of  test  sections, 
strategies  for  guessing,  time  and  duration  of  test  breaks  and  examinees  use  of 
.  unauthonzed  aids,  lest  supervisors  should  check  to  see  that  examinees  under 
stand  their  task  and  the  procedures  to  be  followed, 

8.  Reasonable  efforts  should  be  made  to  eliminate  opportunities  for  examinees 
lo  attain  scores  by  fraudulent  means  by  slipt^lating  requirements  for  identifi 
cation,  assigning  examinees  to  seats  and  requirrcg  appropriate  space  between 
s»  Its 


«i  Appropriate  procedures  should  be  applieo  alter  the  test  administration  lo 
identify  scores  ot  questionable  authenticity,  to  resolve  issues  of  authenticity 
and  to  provide  lur  prompt  reporting  of  questioned  scores  found  to  be 

,  authentic. 

!(>>  A  systeinatK  prograni  lor  observing  test  administrations  should  be  conducted 
by  trained  ti>  statf  members  or  other  qualified  individuals,  to  review  the  test 
u>g  procedures  with  the  test  supervisors,  to  ensure  appropriate  testing  condi 
lions,  to  ensure  adequate  mairilenan<  e  ot  test  secunty  at  the  test  centers  and 
lo  relay  questions  and  concerns  from  the  field  to  the  appropriate  Us  office. 
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11  Testing  programs  should  have  detailed  procedures  for  investigating  and 
resolving  examinees  complainti  of  irregular  test  admimslraiiori  score 
reporting. 

12  Comments  and  suggestions  should  be  solicited  from  supervisors  by  Such 
means  as  the  Supervisor's  Comment  Sheet  and  meetings  of  supervisors  to  pro- 
vide eiS  staff  with  information  to  improve  future  administrations. 

13  Supervisors  should  bo  required  to  record  and  report  to  £TS  information  on 
irregularities  (such  as  mistiming,  defective  materials,  power  failures  and  cheat- 
ing) so  that  in  can  evaluate  the  possible  effect  of  such  occurren9JS  on  exam- 
inees' test  performance. 

14.  An  individual  who  has  taken  a  test  should  be  provided  information  that  will  be 
helpful  in  interpreting  scores  on  that  test. 
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Procedural  Guidelines:  Test  Reliability 


19 


1.  When  test  scores  are  reported  to  institutional  or  agency  users  or  to  individual 
examinees,  information  about  the  reliability  of  the  test  should  be  documented 
and  should  include: 


a.  a  reliability  coefficient  and  an  overall  standard  error  of  measurement  (sev 
era!  indices  may  be  provided  if  more  than  one  method  of  assessing  reliabi! 
ity  has  been  used,  altemate^form  mformation  should  always  be  provided  if 
available); 

b.  standard  errors  of  measurement  for  score  regions  if  decisions  about  indi- 
viduals are  made  in  those  score  regions  and  if  the  overall  regions  and  the 
Overall  standard  error  are  judged  inappropriate; 

c.  the  formula(s)  used  to  estimate  reliabslity  and'or  appropriate  references, 

d.  a  lusiification  of  the  method(s)  used  to  assess  reliability, 

e  a  specification  of  the  major  sources  of  measurement  error  accounted  for  m 
the  reliability  analysis; 

f  a  specification  of  the  time  interval  between  testings  if  alternate-form  or 
test-retest  reliability  is  used; 

g4  the  number  of  observations,  the  mean  and  standard  deviation  of  the  an^'; 
SIS  sample  (ranges  or  averages  are  acceptable  in  cases  where  the  reliability 
information  is  derived  from  several  samples), 

h.  speedcdness  data;  and 

t.  correlations  of  subscores  within  the  same  test  or  battery  of  which  the  test 
is  a  part. 

2.  If  reporting  any  of  the  reliability  information  required  under  Guideline  1  is 
inappropriate,  the  reasons  should  be  stated  in  appropriate  program  docu- 
ments and,  if  possible,  alternate  information  about  consistency  should  be 
provided. 

3.  Efforts  should  be  made  to  provide  reliability  information  in  an  appropnate 
form  to  the  examinees  to  whom  the  scores  are  reported. 

A.  The  method(s)  used  for  assessing  reliability  should: 

a,  take  into  account  the  most  common  sources  of  error  generally  considered 
significant  for  test  interpretation  (e.g.,  guessing,  instability  over  time,  item 
arxi  content  variation,  and  rater  inconsistency);  and 

b  be  appropriate  to  the  nature  of  the  test,  in  order  not  to  seriously  over  or 
underestimate  reliability. 


o 
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Procedural  Guidelines:  Scale  Definition 

1.  Raw  score5  on  a'test  or  subtest  (including  percentages  of  questions  answered 
correctly)  should  not  be  reported  by  i\S  for  individual  examinees  or  in  sum- 
mary form  for  groups  of  examinees  except  under  either  of  the  following  cir- 
cumstances: 

a.  when  It  IS  anticipated  that  only  one  edition  of  the  test  will  be  offered  for 
use  in  the  foreseeable  future  or  it  is  demonstrated  by  appropriate  empirical 
procedures  that  raw  scores  on  all  the  editions  to  be  compared  are  inter- 
changeable; or  when  raw  scores  on  that  test  edition  will  not  be  compared 
directly  with  raw  scores  on  another  test  edition;  or 

b.  when  reported  in  conjunctieo  with  a  scaled  score  and  m  a  context  thatsup* 
ports  appropriate  interpretation,  such  as  when  a  copy  of  the  test  itself  is 
available  or  when  individual  or  group  responses  to  individual  items, 
depending  on  whether  individual  or  group  performance  is  being  assessed, 
are  available. 

2  If  a  test  or  test  battery  yields  multiple  scores  for  an  individual  and  scaled 
scores  are  to  be  used  directly  (e.g.,  without  reference  to  norms  tables)  in  inter- 
pretmg  performance  profiles,  the  scales  should  be  normatively  defined  and 
each  should  be  defined  with  respect  to  the  same  population. 

3.  When  different  tests  m  a  program  are  taken  by  different  examinees  whose 
scores  are  to  be  directly  compared,  the  scales  for  the  tests  should  take  into 
account  possible  differences  among  the  groups  of  examinees  who  take  the  , 
various  tests, 

4.  Established  scales  should  not  be  redefined  except  under  compelling  circum- 
stances. If  a  scale  is  to  be  substantially  redefined,  the  numerical  values  should 
.be  changed  substantially  to  minimize  the  possibility  of  confusion  between  test 
results  expressed  on  the  revised  scale  and  results  expressed  on  the  original 
scale.  An  exception  to  this  guideline  may  appropriately  occur  if  the  test  in 
question  IS  one  of  a  set  of  tests  for  which  a  single  range  of  numerical  values 
(e.g.,  20-80)  IS  used  and  the  scales  for  other  tests  in  the  set  have  not  been 
redefined- 

5.  Scale  properties  that  affect  score  interpretation  and  use  should  be  described 
m  program  publications  available  to  the  examinees  and  to  institutional  or 
agency  users. 

6.  Technical  manuals  and  interpretive  publications  for  institutional  or  agency 
score  users  end  examinees  should  indicate,  m  larfguage  appropriate  to  the 
audience,  whether  a  distributively  based  scale  is  intended  to  be  normative  or 
nonnorm'ative.  If  it  is  intended  to  be  noimative,  the  group  should  be  described 

7.  Whenever  a  normatively  defined  scale  no  longer  conveys  useful  normative 
information,  all  published  descriptions  of  the  scale  should  be  changed 
accordingly. 
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8.  Program  publications  should  caution  score  recipients  (users  and  examinees)  21 
that  scores  received  on  different  tests  that  are  reported  on  scales  that  are  sim- 
ilar in  appearance  may  not  be  equivalent. 

Guidelines  9  through  14  apply  only  to  scales  established  after  guidelines  ,1-8  were 
published  on  August  1, 1977,  /  ,  ' 

9.  If  a  scale  is  to  be  distnbutive.  the  choice  between  a  normative  and  nonnorma 
tive  distributive  scale  should  take  into  account: 

a.  the  extent  to  which  normative  interpretation  with  reference  to  a  particular 
population  will  be  appropriate  and  useful  for  all  examinees  who  take  the 
test  and  for  all  purposes  for  which  the  scores  are  intended  to  be  used^ 

b.  the  probable  time  period  during  which  the  normative  information  con 
\         veyed  by  the  scores  will  continue  to  be  descriptively  appropriate,  and 

c.  the  feasibility  of  identifying  and  testing  a  suitable  group  of  examinees  on 
which  to  base  a  normative  scale. 

s. 

10.  The  thuice  between  a  distnbutive  and  nundistributive  scale  should  take  into 
account  the  use  for  which  the  test  was  intended  and  to  which  the  test  is  likely 
to  be  put 

11.  Ha  scale  is  to  be  defined  ;vi!h  relerenco  to  standards  of  performance,  the  basis 
fur  establishing  the  standards  should  be  determined  empirically  or  ratiunally 
rather  than  arbitrarily. 

12.  The  conventional  grade  ur  age-equivalent  score  (the  grade  or  age  for  which  a 
particular  score  is  the  average)  should  nut  be  used  to  establish  the  score  scale 
for  a  test  or  system  of  tests.  This  type  of  score,  as  it  typically  has  been  derived, 
should  be  avoided  altogether  as  a  basis  for  reporting  test  perform'ance.  How 
ever,  the  grade  (or  age)  for  which  a  particular  scaled  score  on  a  test  is  the  aver 
age,  referred  to  here  as  a  grade  (age)  level  indicator''  to  distinguish  it  from  the 
conventional  grade-equivalent  (age^equivalent)  scor.e,  may  be  reported  to 
help  in  score  interpretation,  if  the  practices  customanly  followed  in  deriving 
and  presenting  grade-equivalent  (age-equtvalent)  scores  are  modified  in  accor 
dance  with  trs  cntena  that  obviate  the  technical  interpretive  problems  thai 
grade^equivalent  (age-equivalent)  scores  create, 

1 )  The  ihuite  ul  a  scale  should  lake  into  account  tl>e  likelihood  of  confusion  with 
other  widely  used  scales. 

14.  In  establishing  the  number  of  distinct  scale  values  to  be  reported,  considera 
tiun  should  be  given  to  the  relative  importance  of  the  need  to  avoid  errone- 
tjiis  disuiictions  among  individuals  (by  reporting  different  Scores  for  individuals 
whose  true  scores  are  the  same)  and  the  need  to  maintain  distinctions  that,  on 
the  average^  will  be  correct  (by  reporting  different  scores  for  groups  of  mdivid  . 
uals  whose  average  true  scores  are  different). 
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22      Procedural  Guidelines:  Equating 

1.  Adequate  equating  should  precede  comparisons  of  the  test  performance  of 
two  or  more  individuals  or  groups  on  nonidentical  items  or  sets  of  items  such 
as  test  offerings  m  which  successive,  or  alternate,  forms  are  used  inter- 
changeably. 

2.  Statistical  methods  selected  for  equating  should  be  used  only  under  circum- 
stances that  are  consistent  with  the  assumptions  under  which  the  methods 
have  been  developed. 

3.  In  regular  and  continuing  testing  programs  that  are  available  to  users,  inte- 
,  grated,  long-range  systems  of  equating  the  scores  on  all  successive  editions  of 

the  test  should  be  used  and  described  in  technical  publications. 

4.  For  those  tests  that  are  offered  for  institutional  use  (as  distinguished  from 
externally  administered  tests  offered  m  testing  programs)  of  which  only  a 
limited  number  of  forms  are  available,  equating  of  new  forms  should  be  based 
on  specially  designed  studies  m  which  examinees  or  groups  of  examinees  are 
selected  by  an  appropriate  sampling  procedure  to  take  the  alternate  forms  x)r 
alternate  sequences  of  forms. 

5.  When  test  forms  are  equated  with  the  use  of  common  (anchor)  items,  the  psy 
chological  task  of  taking  those  items  (represented,  for  example,  by  the  direc- 
tions, the  context  of  the  items  and  the  speededness  of  the  part  of  the  test  m 
which  the  Items  appear)  should  be  the  same  for  all  exammees. 

6.  When  the  common  items  used  for  equating  are  not  representative  of  the  tests 
being  equated,  the  groups  of  examinees  used  for  equating  should  be  as  nearly 
as  possible  equivalent, 

7/ln  the  continuing  testing  programs.  Statistical  Checks  (e.g.,  check  equating, 
special  scale-stability  studies)  should  be  employed  to  permit  regular  assess- 
ment of  the  precision  of  the  equating. 
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Procedural  Guidelines:  Score  lijterpretation 

1,  Etfective  tost  use  and  meaningful  score  interpretation  should  be  supported 
and  augmented  by: 

a,  the  development,  qf  appropriate  test  norms  based  on  administering  tests  to 
samples  from  a  defmed  population  svhen  there  is  a  reasonable  expectation 
that  a  large  proportign  uf  the  schools  or  other  units  selected  for  the  norms 
sample  will  agree  to  J)«ift*cipate;  or 

b,  a  rationally  developed  system  of  interpretation  shared  with'score  recipi 
ents  when  score  interpretation  is  not  developed  from  normative  data 

2.  Tests  offered  for  safe  and  described  by  tTS  as  standardized  tests  (as  disiin 
guished  irom  tests  olfered  m  testing  programs)  should  have  adequate  norms  . 
or  other  information  ioi  use  in  interpreting  test  results. 

3  When  test  norms  are  developed  by  administering  tests  to  samples  from  a 
defined  population,  the  resulting  norms  should  be  representative  oi  any  rele 
vanl  subgroiJ|>^ncludin)>  those  defined  by  sex  or  ethnicity,  in  proportion  to 
their  Irequency  in  Ihe  defined  population.  Such  subgroups  may  be  deliber 
alely  Ovor  sampled  foi  more  precise  estimation  of  the  statistical  characteristics 
of  the  populatio^i  by  procedures  that  take  over  sampling  into  account  Data 
on  the  proportions  in  the  Sample  and  m  the  population,  when  available, 
should  be  reported  in  an  appropriate  technical  publication 

4,  The  report  of  a  special  norms  study  Should  provide  information  on 

a.  the  sampling  design; 

b.  the  participation  rate  ot  institutions  or  individual  respondents  inthe  sample 

c.  charactenstics  of  the  participating  institutions  and  individuals, 

d.  weighting  Systems  used  in  preparing  norms,  and 

e  estimates  of  sampling  variability  along  with  an  acknowledgment,  when 
necessaiy,  that  such  estimates  do  not  take  into  account  biases  arising  from 
nonpartiCipatiOn 

5  When  descriptive  statistics  based  on  program  testing  (as  distinguished  from 
norms  based  on  special  norms  studies)  are  published,  the  following  guidelines 
sliould  be  used'  •» 

a  both  table  titles  and  descnptive  materia!  should  (nake  it  clear  that  the  sta  ^ 
tistics  are  based  on  examinees  or  participating  institutions  or  other  using 
agencies. 

b  the  descriptive  matenal  should  define  the  nature  of  the  group  by  identify 
in^  the  appropriateness  of  the  sample  and  the  factors  that  relate  the  back 
ground  of  the  group  to  test  performance,  and  by  acknowledging  explicitly 
that  the  sample  iS  self-selected; 
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c  when  possible,  reports  should  be  prepared  to  show  comparisons  of  data 
based  on  program  examinees  or  inshtuuonal  characterishcs  with  relevant 
data  on  variables  from  other  sources;  and 

d.  when  information  about  interpretive  data  is  prepared  for  different  user 
groups,  the  presentation,  whenever  practicable,  should  be  adapted  to  the 
needs  and  background  of  each  group. 

6.  When  norms  are  developed  from  program  testing,  tft^  age,  sex  and  ethnic 
composition  of  the  program  norms  group  should  be  described  whenever  such 
information  about  subgroup  membership  Is  Available..   .   

♦ 

7.  In  testing  programs,  descnptive  statistics  should  be  compiled  periodically 
from  a  sariiple  or  entire  population  m  order  to  monitor  the  participation  and 
performance  of  males  and  females  drawn  from  diverse  backgrounds,  interests 
and  experience  (e.g.,  major  ethnic  group,  handicapped  status  and  other  rele- 
vant subgroups  of  the  population  of  interest). 


8.  If  norms  intended  fo'  use  m  the  interpretation  of  individual  scores  are  pre- 
sented separately  for  males  and  females  or  for  members  of  specific  ethnic 
groups,  the  rationale  should  be  carefully  described.  Separate  norms  may  be 
justified  for  scores  used  primarily  for  guidance  when  access  to  thejexperiences 
needed  to  earn  a  high  score  is  clearly  related  to  subgroup  membership  and  a 
more  direct  index  of  access  is  not  available.  The  existence  of  score  differences 
between  subgroups  does  not  in  itself  justify  presentation  of  separate  norms. 

9.  Descriptive  statistics  prepared  separately  for  subgroups  of  the  relevant  test- 
taking  population,  but  not  intended  for  use  m  interpreting  individual  scores, 
should  not  be  presented  m  a  way  that  encourages  their  usefor  such  a  purpose. 

10.  Institutional  or  agency  users  and  examinees  should  be  informed  of  the  stan- 
dard error  of  measurement  of  a  score,  and  test  interpretation  materials  should 
point  out  the  limitations  of  test  scores  and  encourage  score  users  to  take  into 
account  the  possible  scores  a  test  taker  might  achieve  on  retestmg. 

U.  Staitstital  data  used  m  score  interpretation  should  be  revised  annually  except 
when  less  frequent  revision  is  judged  to  be  appropriate  as,  for  example,  when 
norms  are  based  on  special  studies.  A  statement  of  the  period  in  which  the 
data  were  collected  should  be  included  m  any  publication  that  presents  the 
data. 

12.  Institutional  or  agency  store  recipients  should  be  provided  with  interpretive 
matenals  designed  to  be  helpful  for  using  scores  m  conjunction  with  other 
information,  setting  cutting  scores  where  appropriate,  interpreting  the  scores 
for  special  subgroups  (e.g.,  ethnic  minonties,  males,  females,  and  handi 
tapped  students),  conducting  local  normative  studies,  and  developing  local 
interpretative  materials 
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Procedural  Guidelines:  Test  Validity 

1.  m  should  provide  evidence  of  ihe  vdhdjiv  of  us  tests  m  relation  to  the  prmci 
pal  purposes  or  intended  uses  of  the  tests.  One  or  more  of  the  following  may 
be  applicable: 

a.  When  test  stores  are  to  be  interpreted  in  terms  of  degree  of  mastery  of  the 
knowledge?  skills,  or  abilities  of  a  domain  represented  by  the  test,  content 
validation  evidence  should  be  provided. 

b.  When  test  stores  are  to  be  interpreted  m  terms  of  the  prediction  of  future 
behavior,  cnienon-related  validation  evidence  should  be  provided 

i.  When  test  stores  are  to  beinterpreted  as  a  measure  of  a  theoretical  con 
struct,  construct  validation  evidence  should  be  provided 

2  Evidente  ot  tont^'nt  validity  should  be  based  (a)  on  a  tareful  deterniinauon 
and  analysis  ot  the  domain(s)  of  interest  and  of  the  relative  importanti^  of  top 
its  within  the  domain,  and  (b)  on  »i  demonstration  that  the  test  is  an  appropn 
ate  sampit*  ut  the  knowledge  or  behavior  in  the  domain(s),  A  report  on  evj 
deme  tonient  vdliUity  should  present  descriptions  'of  the  procedures 
employed  in  tiw  !,tuilv,  uitludmg  the  number  and  qualifications  of  experts  m 
vuIvmJ  m  ihi»  tiitaiysis  of  the  domain  or  evaluation  of  the  relevance  and  appro 
pnatene^s  <if  tlie  t(*sl 

i  Construct  validatuin  should  be  based  on  rational  and  empincal  analyses  of 
pnKess(»s  undei lying  performance  on  the  test  m  question  including,  where 
apprupridie.  nuntogiittive  as  well  as  cognitive  furjctions.  Empirical  evidence 
relevant  to  the  analyses  should  mtlude  results  of  investigations  of  the  degree 
to  which  ii'^t  stores  are  rel^ated  or  unrelated  to  other  vanables  m  ways  implied 
by  intended  interpretations 

A  Cntenorvrelated  validation  should  be  used  only  whqn  technically  sound  and 
relevant  c  nterui  are  available  or  can  be  developed  and  when  other  conditions 
affecting  feasibility  warrant  the  study. 

a  C  nter.on  related  validation  should  involve  as  many  performance  variables 
as  necessary  to  permit  evaluation  of  the  effectiveness  of  test  scores  for  pre- 
dieting  the  types  of  behavior  they  are  intended  to  measure. 

b  (  nterion  related  validation  should  not  combine  variables  to  furni  a  single 
ir/termn  ntjMsure  unless  such  a  procedure  is  justified  by  logical  consulera 
lions  or  empirical  evidence  or  the  praitical  requirements  of  the  intended 
use  of  the  results. 

c  Cnterion  data  should  be  t  ollected  m  a  way  that  permits  an  assessment  of 
the  reliability  of  each  cntenon  variable,  but  with  the  understanding  that 
there  may  be  several  sources  lA  irrelevant  vanation  (e.g ,  sampling  of  cnte- 
non content,  source  of  cntenon  ratings  or  data,  and  so  forth). 
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5.  Interpretations  of  correlations  between  test  scores  and  criterion  variables 
should  take  into  account  such  factors  as  sample  size,  criterion  reliability,  pos- 
sible restriction  m  the  range  of  scores  obtained  m  the  validity  study  sample, 
and  other  contextual  factors. 

6.  The  method(s)  by  which  any  validation  is  accomplished  should  be  fully  docu- 
mented; such  documentation  should  include  appropriate  details  such  as  the 
nature  and  reliability  of  the  criteria,  a  description  ofsthe  subjects  used,  the 
materials  surveyed  aod  the  qualifications  of  the  experts  who  made  ludgments 

\  regarding  the  appropriateness  and  importarKe  of  test  content. 

7\  Where  adequate  methods  are  employed  to  insure  equivalence  of  scores  on 
.alternate  forms,  it  is  not  necessary  that  each  new  form  be  validated.  New  vali- 
dation studies  should  be  made  if  revised  tests  have  substantial  changes,  such 
as  different  item  types,  or  if  they  sample  a  revised  performance  domain. 


8.  When  appropriate  and  feasible,  the  validity  of  a  test  should  be  investigated 
separately  for  subsamples  of  the  test-taking  population. 

9.  When  a  name  of  a  test  is  established,  it  should  not  >mply  more  than  is  justified 
by  evidence  of  validity. 

10.  Information  should  be  made  available  to  institutionahand  agency  users  that 
would  be  of  assistance  to  them  m  planning  and  conducting  local  validity 


studies. 
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TEST  USE 


Principle 

Proper  jn(l  lair  ose  o/  ifi  lals  n  e»H'n(ij/  (o  the  ioc(.i/  ulitily  .incl prplChSiOnnl 
accopfcmce  ol  17S  work 

Policies 

A.  trs  will  sel  forth  clearly  to  sponsors,  msmutional  or  agency  users,  and  exam 
inees  che  princtples  of  proper  use  of  ies|s  and  mlerpretaiion  of  lest  results. 

b..     will  establish  procedure!^  by  whieh  fair  and  approprmte  test  use  can  be  pro 
moted  and  misuse  can  be  discouraged  or  eliminated. 

Procedural  Guidelines  q 

1.  Program  publications  should:  , 

a.  describe  appropriate  uses  and  caution  against  potential  misuses  of  pro 
.gram  tests; 

b.  explain  clearly  that  lest  scores  reflect  past  oppQitunity  to  learn  and  diS 
courage  test  interpretations  that  go  beyond  reasonable  inferences  from 
test  performance; 

c.  emphasize  thai  an  individual  s  lest  score  should  be  interpreted  m  the  con 
text  of  other  information  about  him  or  her; 

d.  provide  appropnate  information  about  test  content,  difficulty,  and  purpose 
{o  help  the  mstuutional  or  agency  user  select  fnstruments  that  meet  the 
measurement  requirements  of  the  situation  and  avoid  sc^lecting.  requiring 
or  using  inappropriate  tests; 

e.  mvite  in:>titutionai  or  agency  users  to  consult  with  the  progranri  <iponsor 
and'or  Us  about  their  current  or  intended  uses  of  Ef$  developed  tests  and 
identify  the  offices  to  be  contacted  for  this  purpose*  i 

f  summari/e  results  ol  rc^search  relevant  to  the  us^m  she  test  m  cite  reler 
onc(»s  m  which  such  results  are  r^rporled. 

g  descnbe  adequately  and  clearly  scalr^  properties  that  affect  store  interpre 
talionand  use; 

h  advise  instilutional  or  agency  users  that  decisions  about  the  application  of 
single  or  multiple  prediction  equations,  based  on  distinguishing  character 
istics  such  as  sex,  ethnic  group  or  cuiricular  emphasis  or  training.  sh6uld  be 
.  preceded  by  careful  examination  of  social,  educational  and  psychometric 
factors: 
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I  'advise  institutional  or  agency  users  that  if  examinee'grouping  based  on  test 
scores  is  practiced  provision  should  be  made  for  frequent  review  of  group 
assignments  to  determine  actual  performance; 

1.  stress  that  p^ss-fail  or  cut-off  scores  established  fo.r  such  purposes  as 
admission,  credit,  or  certification  should  be  used  as  a  basis  for  decision- 
making only  if  the  institutional  or  agency  user  has  a  carefully  developed 
rationale,  justification,  or  explanation  of  .the  cutting  score  that  is  adopted; 
and         «  , 

k.'  encourage  institutional  <}r  agency  users  to  reexamine  cut-off  score  policies 

'  peri(fdically  to  minimize  or  eliminate  possible  disproportionate  exclusion 
of  members  of  any  group  such  as  men  and  wqmen  drawn  from  diverse 
backgrounds  (e.g.,  maiorethmc,  handicapped  and  other  subgroups  of  the^ 
population  of  intercM}  in  the  face  of  other  evidence  that  would  predict 
their  success  or  indicate  their  competence. 

2.  Special  (nonprognm)  publications  should  be  developed  and  disseminated  by 
ETS  to  promote  fair  use  of  tests  and  discourage  misuse  of  tests. 

3.  Coinplaints  or  information  about  questionable  interpretation  or  use  of 
reporicH  scares  should  be  investigated  by  means  of  procedures  designed  for 
detecting  misuse.  Such  procedures  should  be  docume^ied.  and  fecords 

^    should  be  kept  of  such  complaints  and  their  disposition^ 

4  in  cases  where  a  clear  misuse  is  brought  to  its  attention,  £TS  shoujd  mform  the 
sponsor  and  the  institutional  or  agency  user  of  tXS'S  opinion  as  to  the  misuse 
and  seek  voluntary  correction  of  the  misuse.  If  reasonable  efforts  to  seek 
voluntary  correction  are  not  successfuf,  ETS,  in  conjunction  with  the  sponsor, 
should  take  steps  to  determine  whether ,to  continue  supplying  tests  or  report* 
ing scores  to  the  institutional  or  agency  user. 
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TECHNICAL  ASSISTANCE 
'ADVICE,  AND  INSTRUCTION 


Principfe 

f /V  i5  dvdnaled  not  on/y  pw^tdtn^  mtMsufvmvnt  (jru^ta,,  ind  i  unc/uU/ng 
re5C«ir(/),  but  .i/m>  U>  puimuUn^  tm.  fvd'*vd  ondfrsUrndtn^  uf  rnvdsurvmenidnd 
test  use 

Policies 

A.  Us  will  dt»vclu|.  and  uHer  imlru\.liunal  prugrams  irt  the  areas  of  iT»ea$ufennenl, 
evaluation,  and  related  research  through  suth  forms  as  pubkalions,  seminars, 
in-servjce  training,  intensive  residence  courses,  workshops,  internships  and 
conferen^^os  Us  may  undertake  these  activities  independently  or  m  coopcra 
tion  with  Other  agencies,  professional  groups  or  educational  institutions. 

Us  will  provide  advice  and  information  on  measurement  related  issues  and 
about  Us  programs,  research  and  services.  In  this  activity.  Us  will  work,  where 
feasible,  in  collaboration  with  othei  professional  organizations  that  show 
concern  about  measurement. 

C  Efs  will  respond  promptly  to  requests  for  advice,  instrucliun  and  iechmcal 
assistance  related  both  to  programs  and  services  offered  by  ETs  and  to  the 
related /ireas  of  educational  measurement,  evaluation  and  research 

D.  Us  willlonform  to  high  standards  of  accuracy  and  professionalism  in  its  advi 
sory,  instructional  and  technical  assistance  activities. 

E  £rs  will  provide  advice,  instruction  and  technical  assistance  to  clients  from  the 
private  and  public  sectors  and  fr  jni  foreign  and  domestic  government  agen 
cies  to  the  extent  that  such  services  are  consistent  with  Us  areas  of  expertise, 
meet  accepted  professional  and  ethical  standards,  and  reflect  an  understand 
ing  oi  and  respect  for  cultural  differences 

f  Us  will  endeavor  to  promote  increased  undeisianding  of  the  purposes  and 
procedures  of  testirjg  among  professionak  groups  and  in  the  public  sector, 
will  make  this  effort  both  independently  and  in  cuupeiatiun  with  other  urgani 
zatiOns  that  share  this  responsibility. 
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Procedural  Guidelines  .  * 

1.  itS's  offices  should  offer  advice,  initruction  and  technical  assistance,  the  staff- 
ing for  such  services  should  be  determined  by  the  nature  of  the  services  and 
the  expertise  required. 

2.  The  special  requirements  of  audiences  with  varying  needs,  mteresis,  cultural' 
backgrounds  and  levels  of  knowledge  should  be  considered  when  ns  pro- 
vides technical  assistance,  advice,  or  instruction. 

3.  New  developments  m  research  o) /esting.should  be  considered  when  tech- 
nical assistance,  advice  and  instruciion  are  offered. 

I  ! 

A,  Technical  assistance,  advice  and  jristructjon  offered  to  institutions  or  agencies 
should  include  guidance  on  how  to  use  other  information  about  examinees 
(such  as^  previous  academic  performance,  English  as  a  second  language,  ^hd 
family  or  cultural  background  factors)  in  conjunction  mixU  test  scored 

S  Comprehensive  collections  of  reference  materials  relating  to  tests,  measlj 
ment,  evaluation  and  related  research  should  be  develope4^nfiairitam(» " 
made  available  to  all     staff  members  and,  when  appropriate^^ 
groups  and  individuals  outside  the  org^ni;;ation. 
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GLOSSARY  OFXERMS 


A<^ofjcv  I  ho  vMvnl  to  whuh  d  prinup<il  prtuiuU  u>nlunm  lo  Us  ipeciti 
(.ditons  Of  uirrCttiy  relU^ls  lUv  suuiu'  Jdta  ^vilhiri  tlu'  ^H'uiwd  limits  ut  ri*h 
dbihty 

(  ht'nt  (sof  Sponsor) 

<  i)i>st')it  Permibiiun  ^rdutfcl  bv  trKit\»tliKil  ur  tlwt  indjvidudls  j  Mrt'nl  ur 
i^Odrdfdn  u>  Ihf  usr  or  r(»l<M>o  ot  ddUi  held  b>  Us  iuili  pfrmtssum  xiuintt'd 
upon  receipt  ifi  <i  rtMsuJu'bl**  t^xpldruitnin  ut  ihr  purpoM*  of  t\w  use  of  reloase 
arid  d  fOdSoudbU'  o\pldi»dt«in  oi  tlu*  fndiiiK'f  in  v\huh  the  results  will  hv 
r(»[X>flcd 

(  lfiU>mnhtirt  lntufji).itiofj  thdt  be  used  lo  drd^v  iniportdnt  ifiter 
i>n<  (a)  «il>oul  die  %por>sor  Us  appointed  external  «.»mtuattees,  lustUutiorml 
or  a^j»n(  v  us<'r  i'xainjriee  sLjbjeit  or  respondent,  or  (b)  b>  the  sponsur  msti 
tutiniwi  «)f  auem  v  user  examinee  subjeit  of  fesp(;ndent  and  \\bivh,  it  an  or 

i  u^tf)huti\t  N<.W"  A  sidle  that  is  detined  to  yield  eitKer  a  speulied  s<or<'  dis 
tfibottoii  iff  a  speutied  nuMO  and  standard  deviation  luf  a  partKular  ^;roup  of 
<'xainirji,*es 

f tf'/  hti^if't'^  liu*  Uv  BtMfd  ot  Iriistees  is  tbe  guvt'min>»  hodv  ot  f  Is 
There  are  V  trustees  Sixte<*n  dre  elected  tor  tt*ur-vear  tentis  \e\\  iJK'iiibers 
ot  the  Bodfd  are  elected  by  current  trustees  Ih*'  President  ot  U>  is  an  *  ^ 
(tUtf  jofnernhef 

<!^ht'tti  rn^MiMn  iltt.t  ith'^  lijtorination  about  individuals  and  institutH^ns 
h«'td  by  Ms  and  derived  tn>m  Us  pnAided  services  ot  lollection  procfssinK 
storage  retneval  amldissem»>atu>r) 

>,^htki  KrxtMf.^j  hii's  Intoruiation  held  by  Us  and  K<'"<*'*J»<'<^  through 
Us  condu<  t<'d  res(Mf(h  »ntef«ded  to  result  m  the  development  nt  new  or  jm 
proved  techniques  and  inatends  tor  application  in  suih  areas  as  Jassfooni 
instruc tH>n.  ovaluation  ot  progress  toward  iniucatiofial  ^oals,  counselinji  of 
students  and  detiMor*  nK»Vjr)>^ot  school  adniinistrators 
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txdminci?  An  individual  who  ^akes  a  lesi.  developed  and  or  administered  by 
£IS 

Instnuuonji  ot- Agency  User  An  organizational  recipient  of  as-processed  or 
produced  information 

tntf?imedtMv  Product  Materials  that  are  not  released  externally,  but  that  are 
necessary  to  the  production  of  the  principal  product. 
Nondistnbmm*  5ca/e  A  scale  that  is  defined  without  reference  to  the  ob- 
served test  performance  of  a  particular  group. 

Sonnotmattvo  Scale  A  scale  that  is  based  on  the  performance  of  any  convem- 
ontly  available  subgroups  of  examinees  for  v^hom  the  test  is  appropriate  A 
score  on  a  nonnormative  scale  is  not  intended  to  convey  information  about 
an  examinee's  standing  m  relation  to  a  defined  population  o 

NonmUvc*  bCAte  A  scale  that  is  based  on  the  test  performance  of  a  sample  of 
oxammoes,  selected  as  prescribed  by  a  specified  design,  from  a  clearly  defined 
population.  A  score  on  a  normative  scale  is  intended  to  convey  useful  infor- 
mation about  the  performance  of  a  particular  examinee  in  relation  to  the  per- 
formance of  that  population 

rtincip<il  Froducl  tTvproduced  or  processed  materials  (e.g.  annual  reports, 
performance  data,  score  reports  and  admissions  tickets)  that  are  released  or 
transmitted  to  a  sponsor.  iTvappomted  external  committee,  institutional  or 
agency  user,  examinee,  subject  or  respondent,  pursuant  to  a  contract  or  pub- 
lished commitment.  Standards  with  respect  to  accuracy  and  timeliness  are 
applicable  to  principal  products. 
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lM)r>  Dayton  The  Iridustoal  Orgar»i/atK)r»al  Psych{>U;^t^t 

K*>'^ft)r.iU  fit  An  Uidivulual  ^\lu>  provtdt*^  data  U>  a  re^rarth  project  jn  a  man 
«H*r  and a  purp^^^f•  dilteri'nt  iron»  eith^T  oxam»H»t»s  or  subject?* 

,t  biuuitioMai  protes-jiuuat'^i  o(<upatiurMl  aNsoLiatiuns  Jedcrai  state 
oT  lo<at  iK<**'<*t">  PuWk  <^r  pnvati'  KMjndatuins  which  ciintrac  t  wah  Us  tor  Ms 
MTvut^s  Ihts  <atf ^,^>rv  lUiludes  then  j;oveuMii>;  h»Mrds,  rtjeu^nTship  and  af> 
pointed  c<A»n»ntlees  or  staff 

"^t  truUuh  UiT  idtit  Alifxhii  <iit'ii  t\\tht>U,iinM  /esfs  Ameruan  Psvihoiogicai  ^ 
A^ .ritjttu  (  M  \)  Aiuefuaii  CdiK<ttioiial  Research  Assoc iat»on,  and  National 
<  oui'«  fh>n  Me  jsurt'njeut  in  f  duuition  V\ashu>gton,  D.C  APA, 

Nui  i  f  ;i  A  pan  «»t  the  iar^iT  pupuiatioH  whuh  is  detinahle  accordnigto  ;an 
uus  t  fiiffta  .ts  appropriate  (e  g  by  sex  race  or  ellmit  ongir).  tfaminj;  (ir  l<jr 
feai  pr*'p<if.iUt»M  ^eu^^raphu  louUion  iruomeieve!  handicap  and  or  age) 

'^tthftut  An  Hidtvidual  vvho  parttopates  »»  an      lahojator^  or  evpenraental 
resear*  li  pfoji'ct 

U'-.ttt  ^  t'i^.ui  tin  A  set  ot  arMn>»«*njetUs  under  ^\hich  examinees  are  scheduled 
U>  take  a  t«*st  tjnUer  standanji/tHl  nmditions,  the  tests  are  supplied  ^Mtii 
tnstruttious  ior  >*ivtn^  and  taking;  them,  and  arran^;ements  are  made  tc^r  scc^r 
iiij;  the  ti*st">  reporting  the  si  ojes,  and  providing  interpretative  mfcirmation  as 
part  a  c<>u»prehens>ve  origoing  sefvue  A  program  is  characten/ed  by  its 
t  ontinuirjg  ( harai  ler  and  hv  the     lusiveness  o^  the  servic  es  provided 

fitin  htu      Ihe  iJegret*  U>  a  huh  a  pnruipai  prcjduct  IS  released  c^r  delivered  tc^ 
lis  renpie/jt  withir*  a  pfecletmed  schecfule 
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Appendix  D 


EDUCATIONAL  TESTING  SERVICE       {£  g/        PRINCETON.  N.J.  086-40 


October  30,  1981 


SUMMARY  RgyORT  ON  TEST  DISCLOSURE  RZQUgSTS, 
TEST  ITEM  CHALIEWCES,  HAND-SCORIHC  REQUESTS, 
AND  TEST  FEES 

Educational  Te»tinj  Service  «r.d  its  client  boardi  voluntarily  have  iapleaented 
nationwide  the  provision  for  test  disclosure  embodied  40  Kev  York  state  lav.  The 
susnary  which  follows,  documents  the  scope  of  this  voluntary  action  for  the  2I''Bonth 
period  froa  January       1980  to  Septenbtr  30,  1981.    It  is  tangible  evidence  of  whit 
has  been  accoapl ished  for  openness  in  testing  without  federal  legislation. 


Test  Disclosure  Requests  <January  I,  1980  tq  Septeaber  30,  1981) 

'^Tests  Disclosed: 

Scholastic  Aptitude  Test,  Preliainary  Scholastic  Aptitude  Test, 

Graduate  Management  Adnission  Test,  Graduate  Record  Aptitude  Te<t, 

Test  of  English  as  a  Foreign  Language 

Kuaber  of  Major  Adain istrat ions :  48 

Number  of  Major  Adainistrations  Disclosed:  29 

Kuaber  of  TeifTakers  at  Disclosed  Administrations 

(excluding  PSAT):  1,175,000 

Xufflber  of  Test ^Disclosure  Requests:  48,743 

Nuaber  of  PSAT/NMSQT  Test-Takers  Receiving 

Autoaatic  Disclosure:  1,292*700 

Average  Response  Tiae  to  Disclosure  Requests:      Less  than  3  weeks 

Mote.    SAT  disclosed  in  Mew  York  only  m  this  period^  will  be  available 
nationwide  beginning  in  1981-82  testing  year. 

Law  School  Admissions  Test  not  included  because  £TS  does  not  handle 
disclosure  requests  for  this  test. 
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T«it  Item  Chillenftt  (J*.nuiry  I,  1980  to  Scpteuber  30.  I98l)  ^.  . 

(Inri^dernrlkol  M.i..ion  Te«  and  .pecial  ad«ini«r.tion.  dxsclo.ed) 


6.480 
40 


3 


Muaber  of  Test  Items  Disclosed: 

Number  of  Test  Forms  Diaclosed: 

Number  of  Test  Items  Challenged:  '7* 

Number  of  Flawed  Test  Items  Resulting  from 
Test-taker  Challenges: 

(I  each  for  the  LSAT.  SAT,  and  PSAT/NMSQT) 

Number  of  Flawed  Test  Items  Identified  and  Removed 

Before  Scoring  by  Normal  Review  Procedures:  H 

(CMAT-1,  GRE-3,  LSAT-1,  SAT-4.  TOEFL-2; 
10  different  test  forms) 

Number  of  Tests  Rcscored:  938,000 

Number  of  Scores  Revised:  289,000 


Hand  Scoring  Requests  (July  1.  1980  to  September  30,  1981) 
— (AvaiUble  nationwide  ior  all  administrations) 

Number  of  Candidates  All  Adminiscrationa 

(including  SAT,  CMAl,  GRE.  and  TOEFL)  2.424,000 

I  241 

Number  of  Hand  Score  Requests: 

Average  Response  Time  to  Hsnd  Score  Requests:      Less  than  3  weeks 


$10.50^ 
$24.00 


Test  Fees  for  1981-82 

Scholastic  Aptitude  Teat 
Crsduate  Record  Examinatici^ 

Graduate  Management  Admission  Test       ^  $27.00 

Test  of  English  as  a  Foreign  Language  $19.00 

Law  School  Admission  Test  (Test  and  Registration)  $38.00 
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Appendix  E 


EDUCATIONAL  TESTING  SERVICE 


PRINCETON.  N.J.  08641 


BOAKD  OF  TRUSTEES,  1980-81 


Virginia  B.  Smith,  Chiinun 
President 
V>«i«r  College 
Poughkeepiie,  NY 

P«ul  F-  Sh«rp,  Vice  Chainuin 

President  Enerituc  and  Kegentt'  Professor- 

Center  for  Studies  on  Higher  Education 

The  University  of  OkUhoaa 

MormJin,  OK 


Gregory  R.  Anrig 
President 

Educations!  Testing  Service 
Princeton,  HJ 

Charles  R.  Bowen 
Director 

Plans  and  Progran  Adnlnistration 

in  University  Relations 
International  Business  Machines 

Corporation 
Ar«onk,  NY  ° 

Ernest  L.  Boyer 
President 

The  Carnegie  Foundation 

for  the  Advancement  of  Teaching 
Washington,  DC 

John  T.  Caldwell 

Chancellor  Eaeritus 

>}orth  Carolina  State  University 

Raleigh,  HC 

^Uredo  G.  de  los  Santos,  Jr. 
Vice  Chancellor  for  Educational 

Develo^asnt 
Maricopa  County  Conounlty 

College  District 
Phoenix,  AZ 


Korman  C.  Francis 
President 

Xavier  University  of  Louisiana  ^ 
Hew  Orleans,  LA 

Dorothy  E.  Gregg 
Corporate  Vice  President 
Coinunications 
Celanese  Corporation 
New  York,  NY 

P.  Sheldon  Hsckney 
President 

University  of  Pennsylvania 
Philadelphia,  PA 

Kurt  M.  Hertzfeld 

Secretary  to  •Che  Investoent  Couaittee 
Amherst  College 
Aaherst,  MA 

Elizabeth  D.  Koontz 

Assistant  State  Suparintendent 

for  Teacher  Education 
State  Department  of  Public  Instruction 
Raleigh,  KC 

Charles  D.  O'Connell,  Jr. 
Vice  President  and  Dean  of  Students 
The  University  of  Chicago 
Chicago,  IL 
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A.  Kenn«ch  Pyt 
Chancellor 
Duke  Univertlcy 
Durhaai  HC 


ToiM«  Kivera 
Chancellor 

University  of  California 
Kivtrsidt)  CA 


SCaphen  K.  Spurr 
Profeator 

Lyndon  1.  Johnaon  School  of  Public  Affairs 
the  Univtrfity  of  Texas 
Autcinp  TX 


Donald  M.  Stewart 
President 
Spelaan  College 
Atlanta,  GA 


October  1961 
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.  Mr.  Wfciss.  I  have  a  few  questions  I  would  like  to  ask  you,  and  at 
the  outset  I  would  ask  also  that  in  the  event  additional  questions 
occur  to  members  of  the  two  subcommittees,  many  of  whpm  are  not 
here  today  because  of  other  business,  tHey  may  be  submitted  to  you 
in  writing  after  tl)e  close  of  this  particular  set  of  hearings  and  you 
will  have  10  legislative  days  in  which  to  respond. 
Mr.  Anrig.  I  d  be  happy  to  do  so,  Mr.  Chairman. 
,Mr.  Weiss.  Fine.  You  had  indicated  that  youVe  been  working 
with  the  three  major  .organizations  that  are  involved  in  setting 
standards  in  your  area— the  American  Psychological  Association, 
the  American  Research  Association,  National  Council  on  Measure- 

l^l  T  ^  _l_  •    _        'I'         OTT       .il    -i   il  


Mr.  Anrjg.  Mr.  Chairman,  there  are  two  parts  to  your  question. 
The  first  is  that  the  existing  standards  of  those  three  organizations 
mdependenlly  arrived  at  By  those  tliree  Organizations  have  been 
incorporated  into  the  ETS  standards  for  quafity  and  fairness  that  I 
referred  to  in  my  testimony.  Those  standards,  however,  were  devel- 
pped  a  number  of  yeqrs  ago  by  those  three  associations.  By  their 
own  decision,  quite  separate  and  apart  from  any  organization  in 
the  testing  field,  they  have  decided  to  update  and  revise  those 
standards.  That  updating  and  re\ision  is  going  on  now  independent 
of  any  tt?stmg  organization-  It  is  being  sponsored  and  directed  by 
the  three  associations.  What  my  testimony  says  is  that  our  organi- 
zation, Educational  Testing  Service,  is  willing  to  commit  ourselves 
to  those  standards  because  we  would  do  no  less  whether  or  not  we 
felt  the  pressure  to  do  so.  We  are  prepared  to  do  so  when  those 
standards  come  out.  They  are  currently  being  developed  independ- 
ent of  any  testing  organization. 

Mr,  Weiss.  Rignt,  had  there  been  standards  previously? 

Mr.  Anrig.  Yes,  sir. 

Mr.  Weiss.  And  had  ETS  adhered  to  those  standards  pr.eviousiy? 

Mr.  Anrig.  That  is  correct.  The  standards  of  those  three  associ- 
ations that  have  been  currently  in  effect  were  used  as  the  basis  for 
developing  what  I  referred  to  as  the  ETS  standards  for  quality  and 
fairness,  and  that's  what  we  tested  out  over  the  last  couple  of 
years.  We  feel  that  we  have  met  those  standards  and  indeed  ex- 
ceeded that  and  are  committing  ourselves  to  go  that  far  by  corpo- 
rate policy  and  beyond. 

Mr.  Weiss.  I  have  my  hands  full  taking  on  the  testing  agencies 
rather  than  starting  another  round  with  them,  but  if  their  stand 
ards  have  been  ones  that  you've  been  adhering  to  I  sort  of  question 
how  diligent  they  have  been  in  setting  standards. 

Mr.  Anrig.  Mr.  Chairman,  I  think  first  of  all  when  I  say  that 
ETS  has  been  adhering  to  those  standards,  that  doesn't  mean  nec- 
essarily that  all  other  organizations,  are.  I*m  speaking  now  again 
onl>  for  Educational  Testing  Service.  Those  standards,  if  you  have 
your  staff  take  a  look  at  them  or  to  meet_^with  any  members  of 
those  three  associations,  are  in  my  judgment  profoundly  important 
and  strong  standards  for  quality  and  accuracy  of  testing.  They 
don*t  cover  all  the  areas  with  which  you  have  addressed  yourself, 
but  the>  do  cover  many  of  the  areas  that  underly  your  concern 
about  testing.  And  I  think  they  are  by  all  judgments  of  the  profes- 
sionals in  the  area  very  high  standards. 
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Mn  Weiss.  Okay,  haye  you  conveyed  the  proposal  and  challenge 
that  is-incoiH^orated  on  page  8  of  your  testimony  to  any  of  the  other 
testing  organizations,  or  is  this  the  first  pHKic  setting7orfh--ot  tTTat 
proposal  and  challenge. 

Mr  Anrig.  Mr.  Chairman,  I  didn't  want  to  take  away  m  any 
way  from  the  prerogatives  of  your  committee  or  hearmg.  I  wanted 
to  express  that  first  here,  but  I  did  have  delivered  to  some  oi  the 
other  orgqxiizations  that  are  affected  by  this,  a  copy  of  my  testimo- 
hy  yesterday  afternoon.  So,  they  have  been  mformed  about  it,  but 
the  formal  announcement  of  it  I  wanted  to  reserve  for  today  s  hear- 
ing, out  oArespevt  to  you.  ;  .   i  r 

Mr.  WeiSs.  It's  too  soon  yet  to  know  what  kmd  of  response  you 
will  be  getting  from  the  other  organizations. 
Mr.  Anrig.  I  think  it  will  be  a  wonderful  question  for  you  to  ask 

^^Mr^"wEiss\WW,THe^  had  a  chance  to  think  about 

it  yet.  In  the  course  of  the  pa^t  couple  of  years,  we  ve  had  a 
number  of  objections  raised  to  what  we  were  attempting  to  do  and 
you  touched  Qn  some  of  those.  I  wonder  if  we  could  sort  of,  go 
^through  them  again.  The  question  of  costs,  for  example.  Have  you 
had  occasion  y^t  to  undertake  a  study  of  what  the  total  cost  is  oi 
quesFion  development  so  far  as  ETS  is  concerned,  and  how  that  cor 
relates  to  the  proposed  increases  in  the  costs  to  applicants  to  take 

that  test?  \ 

Mr  Anrig.  First,  with  regard  to  the  correlation  of  the  cost  to^the 
applicant  fees,  a^  you  know,  Mr.  Chairman,  there  is  required  in^ 
New  York  State  an  audit  as  I  understand  it  of  the  increase  in  fees 
in  connection  witl\  the  Levale  bill.  If  it's  not  required  at  least  it  s 
'  being  followed  out.^So  there  is  now  an  audit  being  conduced  oi  the 
college  board  expenses,  specifically  with  regard  to  the  bAl,  and  the 
results  of  that  audft  will  be  made  available  as  soon  as  that  s  com- 
pleted. That's  bein^  done  by  the  college  board  independent  oi  us. 

The  question  is,  are  there  costs  connected  with  test  disclosure 
and  the  answer  to  that  clearly  is.  yes.  Indeed,  logic  would  indicate 
that  there  would  be.  If  you  disclose  forms  of  tests  you  have  to  de- 
velop new  forms  and^  indeed,  new  forms  are  being  developed,  l^or 
instance,  in  the  gradiiate  management  admissions  test  prior  to  dis- 
closure we  had  to  have  two  forms  developed  annually.  Now  we  de- 
velop four.  With  the  graduate  record  examination  two  forms  w^re 
developed  annually  prbr  to  dibclosure.  Now  we  develop  four.  With 
the  scholastic  aptitude  test,  before  disclosure  we  developed  lU 
fbrms  each  yQar,  I'm  s6rry,  7  forms  each^year.  now  we  re  develop- 
ing  10.  That  means  that  just  at  ETS  alone  the  number  of  People 
who  work  on  test  development  logically  has  to  be  expanded  to  do 
that.  From  a  number  of  42  to  .63  just  during  this  period  ol  time,  A 
50-percent  increase  "to  cobply  with-the  law. 

TVIr.^Eiss.  A  5'0-percent  increase  in  what?  / 

Mr  Anrig.  In  .terms  of  the  number  of  staff  to  develop  the  tests. 

Mr!  Weiss.  Yes.  but  that  still  leaves  open  the  question  as  to  what 
percentage  of  the  total  amount  of  moneys  that  are  taken  in  by  bTb 
are  in  fact  spent  on  test  development  and  what  the  percentage  ot 
increase  is  due  to  the  additional  work  that  s  required  ot  M  b. 

Mr  Anrig.  OK.  those  are  two  different  questions,  tirst,  with 
regard  io  every  dollar  that  is  spent  by  a  tesf  taker  for  the  four 
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major  programs  that  we. administer— the  college  board  admissions 
testing  program,  the  graduate  management  admissions  test,  the 
graduate  record  examinations,  and  the  national  teacher  exam--out 
of  every  dollar  paid,  9  cents  of  that  dollar  is  for  test  development 
That  doesn't  really  tell  you  much.  That  doesn't  tell  you  what  thes 
cost  of  test  disclosure  is.  That  just  tells  you  what  portions  of  the  ' 
overall  costs  of  ETS  go  for  test  development.  The  actual  cost  of  test 
disclosure  as  we've  been  able  to  estimate  them,  and  I  would  have  to  ^ 
say  that  this  is  an  estimate,  Mr.  Chairman,  because  I  anticipated 
you  to  ask  that  question  and  I  asked  that  it  be  drawn  togetjjer. 
We've  hustled  around,  Ive  only  been  there  for  2  months,  so  we  h^d 
to  go  around  and  do  this;  but  let  me  give  you  our  best  estimates  of 
that,  and  these  are  good  faith  figures  that  are  subject  to  change 
but  I  think  they're  generally  correct. 

lo-the  first  year,  taking  all  the  programs  that  we  administer  that 
were  affected  by  test  disclosure.  Taking  the  internal  costs  that  we 
were  incurring  in  terms  of  responding  to  that,  it  cost  me  something 
to  come  here  today  for  instance,  you  take  all  of  the  costs  that  were 
involved  directly  with  test  disclosure,  and  in  1979-80  that  came  to 
an  estimate  of  a  little  over  $1.2  million  for  ETS.  In  1980-81  because 
I  then  we  were  developing  the  newer  forms,  we  had  a  total  cost  esti- 
mate of  about  $2.3  million.  And  for  1981-82,  this  year,  because 
.  we're  moving  ahead  in  some  of  the  programs  to  further  test  disclc 
sure,  we  estimate  our  costs  will  be  about  $2.6  million.  Now,  that 
takes  all  of  the  costs  that  we  could  legitimately  identify  and  we 
weren't  stretching  this,  that  is,  I  said,  don't  put  anything  that's  on 
the  edges  of  this  thing.  I  want  it  to  be,  as  much  as  possible,  an  ac- 
curate picture  of  our  direct,  actual  costs  of  test  disclosure.  They  are 
those  figures  that  Ive  just  spoken  to  you.  Now,  that  niay^  just  be  a 
small  part  of  a  slice  of  a  pie  that  says  9  percent,  but  it  s  a  lot  of 
money.  So^'it's  important  for  us  to  understand  that  the  worthy  pur- 
poses that/you're  trying  to  accomplish  do  cost  money. 

Mr.  Wkiss.  I  appreciate  that.  Now,  put  that  into  context.  Tell  me 
what  the  fees  were  prior  to  1979  and  tell  me  what  the  fees  are  cur- 
rently. ^  ,  .     A     .  , 

Mr.  Anrig.  Sure.  In  1979-80  the  fee  for  the  Scholastic  Aptitude 
Test  was  $8.23.  In  1980-81  it  was  $9.25.  In  1981-82,  this  year,  it  will 
be  $10.50.1  -  .     ^.c  • 

Now,  I  think  I  want  to  make  a  point  on  that,  Mr.  Chairman. 
Back,  as  we  used  to  say  where  I  lived  in  your  district,  as  a  matter 
of  fact,  we  can  get  it  for  you  wholesale,  and  it  is.  If  you  Uxko  the 
•  costs  in  1954-.").*3,  way  before  test  disclosure,  it  cost  $6  to  take  the 
admissions  testing  ^program.  If  you  just  put  inflation  on  that,  noth- 
ing else,  just  inflation  from  1954-55.  the  fee  this  year  should  be 
$17.50.  It  is  $8.25,  or  at  least  in  1979-80  it  was  $8.25. 

Mr.  Weiss.  Commissioner,  don't  take  me  back  to  1954.  Our  ef- 
forts tu  impose  additional  requirements  on  you  only  go  l^ick  to 


Mr.  Anrig.  Yes,  I  gave  you  those  figures.       *  .  ,  N 

Mr.  Weiss.  Right.  If  Tm  correct,  what  you  r«  saying  is  it  s  gone 
up^from  $H/25  to  $10.50.  right? 
Mr.  Ankig.  That's  correct,  for  the  scholastic  aptitude  test. 
Mr.  Weiss.  Right.  So  there's  an  increase  of  somewhere  around  25 


1979. 


percent. 
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"  Mr.  Anrig.  Over  a  S^year  period,  during  the  ihne  when  the  infla- 
tion rateAvaS'^ping  at  a  fairly  high  rate  also.       "      '  . 

Mr.  Weiss.  But  the  actual  cost  increase  as  a  result  of  the  addi- 
tional Burden  was  perhaps  9  percent.  We  have  figures  indicating  it 
raay  have  been  5  percent. 

Mr.  Anrig.  No,  that  latter  part  is  not  correct,  Mr.  Chairman.^ 

Mr.  Weiss., Tell  me  where  it's  incorrect 

Mr.  Anrig^  The  9  percent  that  you  re  using  is  in  reference,  I  be- 
lieve, to  the  point  I  said  tha^  'for  every  dollar  spent  on  tests,  9,  cents 
of  that  dollar  is  for  test  development 

Mr.  Weiss.  OK,  tell  me  what  the  percentage  of  increase  has  been. 

Mr,  Anri6.  I  don't ^knpw,  I  majored  in  history.^ 

Mr.  Weiss.  Would  you  do  the  committee  a  favor?  Find  somebody 
that  majored  in  math.  » ^  "  ^ 

Mr,  Anrig.  And  did  well  on  the  SAT.* 

Mr.  Weiss.  And  , develop  a,  presentation  in  response  to  the  ques- 
tion that  r  asked.  You  know  the  overall  context.  Don't  limit  your- 
self to  whatever  flaws  there  may  .have  been  in  my  question,  but 
ta,ke  ,the  overall  costincreased  expenditure  area  and  try  to  develop 
a  response  so  that,  in  fact,  we  have  a  full  statement  directed  as  to 
what  the  additional  increases  in  fees  have  been,  what, the?* addition- 
al costs  have  been,  with  the  appropriate  breakdowns  and  so  oh, 
OK?  ' 

Mr.  Anrig.  Til  be  happy  to  do  that 

[Answers  to  Mr.  Weiss'  questions  follow:] 


ERIC 


461 

4 


EDUCAVIONAL  TESTING  SERVICE 


PRINCETON.  N.J.  08541 


Otfi^rvK  Annjl 


Decenber  10,  1981 


The  Honorable  Carl  ferkmi.  Chairman 

Subcomittee  on  Elementary,  Secondary^  I 
and^Vocational  Education  ^ 
The  Honorable  Paul  Simon,  Chairman  . 
Subcowiittee  on  Poataecondary  Education  i 
320  Cannon  Houie  Office  Euildin^ 
Washington,  D.C.  20515 

Dear  Mesara.  Perkina  and  Simon: 

During  the  hearinf  on  H.R,  1662  on  November  4,  ConfreaananWeiaa  requett«d 
additional  information  from  ETS  on  several  pointa;    The  number  of  atudenta 
t^ated  by  ETS  In  a^^or  adm^ajiont  pro^raaa,  appeal  procedures  which  atudenta 
can  uae  in  teat  xecurlty^c_aaet,  and  coata  related  to  discloaurfi.    1  am 
providing  that  information  below. 
* 

1.  Number  of  atudenta  teated.    The  attached  table' (Table  1) 
providea  candidate  volumea  for  major  admiaaiona  and 
placement  prD^raBa.    The  numbera  repreaent  candidat>2a 

^  in  each  program.    However,  it  should  be  noted  that  many 

atudenta  vho  take  the  Advanced  Placement  Exam  alao  take 
the  SAT  and  Achievement  teata.    Similarly,  aome  students 
take  more  than  one  profeaaional  achool  exam,  e.^.,  GRE 
and  GMAT.    Thus,  the  total  of  4,119,4pO  is  not  an 
*  unduplicated  one. 

The  encloaed  brochure,  entitled  **£TS  in  Fact,"  pwvidea 
.informatiovi  for  the  1979-80  teatin^  year  aa  well  Jia 
>     additional' general  informacicn  about  E,TS  programs, 
'  /  * 

2.  Score  validity  procedures.    We  make  every  effort  to  jive 
every  atudetVt  an  equal  chance  4-urJji{^the  adminiatrat ion 
of  th'e  taat  i  i  the  teat  center,    He-^want^  to  be  ajre  aome 
candidate)  do  not 'have  an  unfair  advantage  over  othera. 
Thua,  we  take  the  oatter  of  teat  .aecurity  very  aerioualy. 
At  the  same  time,  atudenta  whoae  acorea  are  queationed 
through  our  aecurity  procedures  oust  be  aaaured  that  they 
are  treated  fairly. 

The  procedures  we  4jae  in  inveatisatinj  the  validity  of 
queatioMd  acorea  are  explained  in  the  enclo9ed  booklet 
»  entitled  "Score  V.n.Vidity  Procedures,"    In  addition,  some 

test  aponiora  provide  for  third  party  mediation  ahould 
normal  procedures  fail  to  resolve  the  matter.    As  an 
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exanplc,  I  am  enclosinr  the  policy  scatc«(?nt  adopted  by 
BTSland  the  College  Board  which  applies  to  tests  sponsored 
by  ^he  College  Board. 

Fee  increases  related  to  disclosuri.*  i 


It  is  important  to  understand  that  t^st  fe^s  are  aet  by 
the  policy  boards  and  councils  that  sponsor, each  of  the 
testing  programs,  not  by  ETS.    It  is  the  policy  of  each 
of  the  councils  to  keep  fees  as  reasonable  aa  possible 
but  f'ee  increases  required  vary  from  program  to  program 
depending  on  such  factors  as  a)  changes  m  program 
services,  b)  ,Che  number  of  people  who  take  the  test, 
c)  infUcion,  and  d)  financial  circumstances  , and  reserve 
requirements  of  the  sponsoring  agency.    Cost*,  of  disclosure 
are  but  one  factor.    Since  the  p£ssage  of  the;NewYork 
Stat*Ulaw  m  July  1979,  the  cunulative  fee  increases  to 
date  ill  the  prograo^s  administered  by  ETS  which  are 
coverejl  by  the  law  tange  from  less  than  12  percent  to 
116  percent. 

Similarly,  th?  portion  of  these  increases  that  is 
directly  attributable  to  disclosure  varies  among  programs, 
depending  o,n  the  number  of  test  forms  disclose^,  number 
of  tes£-takers,  and  changes  in  test  development,  equating 
and  adiainlstration  procedures.    For  example,  for  the  Test 
of  English  as  a  Foreign  Language,  no  change  wasv  required 
in  the  number  of  test  editions  developed  annuaUy  or  in 
the  for^Mt  of  the  test,  whereas  the  Graduate  Management 
Admission  Test  had  a  100  percent  increase  in  new  test 
editions  developed  annually  along  with  the  development 
and  implementation  of  a  new,  much  more  complex  and 
expensive  method  of  providing  comparability  of  scores 
earned  at  different  administrations.    Although  it  is 
extremely  difficult  to  separate  the  elements  contributing 
to  fee  increases,  our  best  estimate  is  that  the  increases 
in  test  fees  in  1980-81  directly  attributable  to  disclosure 
ranged  'from  very  little  to  more  than  37  percent.    Test  fee 
increases  for  the  current  testing^ear  range  from  0  to  2U 
percent].    The  increases  were  due  mostly  to  aj  combination  of 
inflation  and  disclosure,  with  the  larger  percentage  increases 
occurring  in  those  programs  which-had  to  incorporate  sharply 
increased  test  development  cost  and  changed  test  formats.  A 
cable  butlining  test  fees  for  the  three  most  recent  years  is 
attacWed  (Table  2). 

InipUcations  of  H.R.  1662.  ^ 

IwpUcations  of  H.R.  1662  ar«  not  merely  a  matter  of  costs. 
Two  sections.  Sections  3  &  5,  include  requirements  that  not 


J 


467' 


463 


4 


(cont. ) 


only  would  increase  costs  but  would  present  seriou*  problems 
of  feasibility  at  any  cose. 

Section  3 

Although  all  progratas  administered  by  ETS  already  j 
provide  most  of  the  mformacion  called  for  in  Section  3, 
the  requirement  in  Sect  ion  3(A)(3)  for  r*'porting  to  test 
subjects  "the  correlation  between  test  scores  and  success 
in  the  career  for  which  admission  is  sought"  calls  for 
information  not  now  available^    In  the  unlikely  event 
that  consensus  could  be  reached  on  a  definition  of 
success,  it  would  take  man;^  years  to  collect  such  \ 
information  and  at  great  expense.    Most  test  materials 
include  statements  saying  that  the  tests  are  not  designed 
to  predict  success  in  a  given  field  and  the  career  paths 
taken  by  individuals  after  completion  of  graduate  or 
professional  training  are  many  and  diverse. 

In  Section  3(4)(B),  "a  comparison  of  the  average  score 
and  percentiles  by  major  income  groups"  is  called  for. 
Some  programs  do  not  collect  income  information  from 
candidates.    Reporting  such  information  would  require 
revision  of  the  application  form,  of  the  data  base  and 
the  computer  system  for  the  program.    For  a  test  «uch  as 
TOEFL  (Test  of  English  as  a  Foreign  Language)  which  has 
many  foreign  candidates  from  iwny  different  countries, 
the  information  would  be  uninterpretable.    For  graduate 
and  professional  program*,  some  applicants  «re  dependent 
on  parental  support  while  others  are  self-supporting 
with  typically  low  incomes;  we  would  be  dealing  with 
"apples  and  oranges," 

Section  3(4)(C)  calls  for  "the  extent  to  which  test 
preparation  courses  improve  test  subjects'  scores  on 
average."    Meaningful  statiatical  averages  or  percentages 
on  the  effects  of  special  preparation  are  not  available 
for  most  programs.    TOEFL,  for  example,  ia  an  achievement 
t*es\  for  which  additional  preparation  would  be  expected 
to  produce  significant  gains.    The  design  for  a  research  , 
project  and  the  collection  of  data  for  one  year  would 
cost  about  $75,000. 

Assuming  that  the  additional  information  called  for 
could  be  provided,  candidate  informational  bulletins 


^See  enclosed  statement,  "Sidc-by-Side  Comparison  of  H.R    1662,  Provi 
and  Current  Practices  of  Guidance  and  Admissions  Tests  Administered 
ETS." 
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would  have  Co  be  expanded,  with  increased  cotes  for 
princing  an'   distribution.    For  TOEFL,  it  is  estimated 
that  the  additional  cost  of  distributing  an  expanded 
handbook  worldwide  alone  would  be  about  $92,000, 

Section  5 

The  costs  of  implementing  the  full  disclosure  called 
for  in  this  section  would  be  twofold:     1)  the  cost  to 
candidates  of  decreased  flexibility,  convenience  and 
ppportun^ties  CO  take  tesCs^^^^mJ  2)  dollar  costs, 
resulting  in  higher  test  t^ct. 

Because  of  the  problems  associated  with  disclosing  tests 
for  every  administration  in  programs'  testing  500p  candi- 
dates or  more,  and  technical  difficulties  associated 
with  developing  new  tests  for  the  small  numbers  of 
candidates  staved  at  sp^ecial  administrations  such  as 
those  for  Sabbath  observers  ind  the  handicapped,  it  is 
highly  probable  that  the  policy  boards  would  decide  to 
eliminate  some  administrations  and  even  drop  some  tests 
entirely»  particularly  from  the  College  Board  Achievement 
Tests  and  Graduate  Record  Advanced  Tests. ^ 

tf«*  tried  to  estimate  some  test  development  costs  using 
the  assumptions  that  the  Current  level  of  test  adninistt* 
tions  would  be  nviinCained  and  that  no  changes  in  lengttf 
or  format  of  tests  would  be  required: 

J.    Admissions  Testing  Program  of  the  College  Board 

1.  SATs. 

Annually  22  forms  are  used. 

Seven  SAT  forms  are  disclosed. 

Currently  10  new  forms  are  developed  each  year. 

Twelve  additional  ones  would  be  needed,  if 

administration  for  special  populations  such  as 
handicapped  are  limited  to  one  or  two  per  year. 

Additional' cost  of  SAT  test  development: 
$1,320,000. 

Additional  cost  per  candidate,  using  1981  volumes 
83^. 

2.  Achievement  Tests. 

Ten  Achievement  tests  would  probably  fall  under 
provision  of  H.R,  1662.  Each  is  administered 
10  tines  per  year. 

On  the  average,  onfe  new  form  of  each  is  produced 
'  per  year. 
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Nine  new  fona<  of  each  would  be  needed. 
Additional  cose  of  tc»t  development:  $2,970,000. 
Additional  cost  per  candidate;  $10.31. 

3.    Total  additional  cost  of  tot  development: 
$4,290,000. 

,        fc.    Graduate  Record  Examinations 

1 .  Aptitude  Tests. 

Annually  10  form*  arc  used  in  major  administrations. 
There  are    more  than  lOO  special  adminisfations 

in  large  urban  areas,  Che  cost  of  which  arc 

not  estimated  here. 
Thre«  forms  are  disclosed. 

Currently  3  new  forms  are  developed  each  year. 

Seven  additional  forms  for  major  administrations 
would  be  needed  (eliminating  special 
administrations)*  ^  ^ 

Additional  test  development  costsJ  $1,155,000. 

Additional  cost  per  candidate:  $4:40. 

2.  Advanced  Tests. 

Six  tests  would  probably  be  covced  by  H.R.  1662. 
Each  is  administered  8  times  per  year  in  regular 

administrations,  as  well  as  in  numerous  special 

administrations. 
On  the  average,  one  new  form  of  each  is  produced 

per  year*. 

Seven  additional  forms  o£  each  would  be  needed  for 

regular  administrations. 
Additional  test  development  costs:  $2,226,000. 
Additional  costs  per  candidate  <estioated  volgme 

1980-81):  $37.10. 

3.  Total  additional  test  development  costs: 

"  $3,381,000. 

c.    Graduate  Hanage^4ent  Admission  Tests 

All  4  rejf^alar  administrations  are  disclosed 
curr''«ntly. 

T^.ee  Monday  administrations  plus  those  for 
handicapped  students  are  not  disclosed. 

Currently  4  new  forms  are  developed  per  year. 

Four  additional  new  forms  would  be  needed, 

assuming  handicapped  testing  would  be  limited 
to  once  per  year. 
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Addt Clonal  test  development  costs:  $600,000. 
Additional  costs  per  candidate  served  on  Monday 

and  in  handicapped  administration:  $5A3. 
Additional  costs  spread  over  all  candidates: 

$2.73, 

The  assumptions  of  no  change*  m  frequency  of  administra- 
tions and  m  fonaat  or  length  of  tests  are  unrealistic. 
For  example,  the  disclosure  of  all  SAT  forms  would 
require  changes  in  the  PSAT/NMSQT  program.    At  the 
present  time,  two  new  forms  of  the  PSAT/NMSQT  are 
developed  each  year  fron  two  undisclosed  SATs.  If 
undisclosed  SATs  are  no  longer  available,  new  questions 
must  be  developed  and  pretested  specifically  for  PSAT/ 
MMSQT  and  nev  methods  for  namtaining  score  cctnparability 
introduced  at  a  presently  unknown  cost  and  at  least  a^^ 
two-year  lea</  tinse. 

Currently,  the  voluntary  national  policy  of  disclosure 
provide*  the  flexibility  required  to  maintain  services 
to  special  populations,  e.g.,  handicapped.  Sabbath 
ob*ervers,  r3ilita<r^  personnel,  students  needing  make-up 
atlniaiscrat  ions.    F'rograras  such  as  ORE  and  SAT  now  use 
test*  equated  on  large  adainistratiipns  for  those  special 
pop'jti  Jtions.    Present  tnethods  of  making  scores  comparable 
(a*  well  as  one  being  developed)  require  a  much  larger 
niiraber  of  test-takers  than  are  available  in  the  nbn- 
Satur«lay  adrajnist rat  ions.    Other  new  methods  would 
require  considerable  research  and,  if  effective,  the 
lengthening  of  the  tests. 

The  problems  for  the  Achievement  and  Advanced  tests 
include  those  mentioned  above  plus  the  formidable  task 
of  producing  a  sufficient  quantity  of  quality  questions 
on  the  samfc  topics  in  a  subject  area,  should  8  to  10 
tiroes  the  number  of  new  forms  have  to  be  produced  each 
year.  ' 

Consequently,  should  H.R.  1662  be  passed  in  its  current 
form,  some  or  the  tests  may  be  dropped  from  the  list  of 
offerings  and  administrations  of  other*  limited  to  one 
or  two  per  yvar.    Moreover,  for  New  York  ther"  is  an 
ironic  twist.    Should  the  policy  bo'ards  decide  to 
eliminate  any  small  volume  adoinistrations  for  Sabbath 
ob&ervers,  there  would  be*a  concurrent  elimination  of 
the  companion,  regular  Saturday  adnsinistrations  in  New 
York,  bc;ause  an  amendment  to  the  New  York  lav  requires 
that  an  equal  number  of  opportunities  to  take  the  test 
must  be  available  to  Sabbath  observer*. 
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As  you  c«n  tee,  th«  iapUcalions  are  Ur  reaching.    While  the  concept  of 
disclosure  o£  test  content  toemf  itrjightforward  and  one  we  support— the 
variations  among  programs,  services  to  students,  and  arrangements  for 
special  situations  are  such  that  sweeping  legislation,  however  straight- 
forward m  intent,  will  have  unintended  effects.    I  repeat  my  strong  belief, 
a*  stated  m  my  testimony,  that  the  goal  of  openness  in  testing  can  be  and 
is  basing  achieved  without  further  legislation. 

I  hope  this  information  responds  adequately  to  the  questions  raised. 
Please  let  me  know  if  1  can  be  of  further  assistance. 

Sincerely  your^^ 

Gregoof  R.  Unrig 
Presi'dent  \ 

GRA: jd  » 


TABLE  1 

ETS  TEST  CANDIDATE  VOUJKES  FOR  SELfiCTEO  t;ATIOKAL  PROGRAMS 

Sponsor 

Candidate  Volurse/  1980-81 

CL£M£NTARV  *  SECONDARY  LEVEL 

Secondary  School  Adnission  Test  (SSAT) 

Secondary  School  Adstission  Test 
Board,  Inc. 

52 

,500 

COLLEGE  LEVEL 

Admissions  Testing  Pro<jrA.n  (ATP) 

College  Board 

1,556 

,100 

Scholastic  Aptitude  Test  only 

1,282 

,100 

Achie<reaent  Tests  only 

76 

000 

SAT  and  Achievefsent  Tests 

198 

000 

Advanced  Placement  Progra:^  (APP) 

College  Board 

134 

000 

Coll«gt-Lovel  Examination  Prograa  (CLEP) 

College  Board 

247 

National  Teacher  E^arai nations  (NTE) 

National  Teacher  Examinations 
Policy  Council 

75 

000 

Pr*ll»inary  Scholastic  Aptitude  Test/National 
Merit  scnoxarsnip  Quaxi eying  Test  itt'AT/nnDvi/ 

College  Board/National  Me^it 
Scholarship  Corporation 

1,295, 

000 

Test  oC  firvglish  as  a  Foreign  Language  (TOEFL) 

College  Board/Graduate  Record 
Examinations  Board 

300 

GRADyATE  &  PIOPESSIOHAL  LEVEL 

Graduate.Manage:Ant  Admission  Test  (CMAT) 

Graduate  Mariagoiscnt  Admission  Council 

219 

500  ^ 

Graduate  Record  ExVminations  (GRE) 

\ 

Graduate  Record  Examinations  Board 

285, 

000 

Law  School  Adaission  Test  (LSAT) 

Law  School  Admission  Council 

110, 

000 

lotal 
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4,119, 

400 

469 


POLICIES  AND  PROCEDURES  FOR  ARBITRATION  OF 
TEST  SECURlTy  ACTIONS  FOR  COLL€GE  BOARD  PROGRAMS 


Test  takers  whose  scores  have  been  questioned  deserve  assurance  that  their 
rights  to  confidentiality  and  fair  treatiuent  are  fully  protected.   Over  the 
years,  ETS  and  the  College  Board  have  tried  to  ensure  that  the  interests 
of  both  test  takers  and  score  users  are  given  balanced  consideration. 

Test  scores  are  cancelled  or  withheld  only  if  there  is  a  reasonable  basis  for 
questioning  then  and  only  after  a  thorough  review  of  the  pertinent  fa^ts  - 
including  an  opportunity  for  the  tes.  taker  to  provide  additional  information. 
Such  actions  are  ititendea  to  ensure  equity,  not  to  be  punitive,  further,  they 
are  kept  in  strict  confidence.    The  ETS  Board  of  Review,  a  group  of  senior 
mefiibers  of  the  professional  staff,  reviews  all  information  about  scores  of 
questionable  validity  including  information  that  the  candidate  or  his  or  her 
designee  provides.   Only  if  there  is  unanimous  agreement  among  three  Board  of 
Review  imbers  that  there  is  a  reasonable  basis  tor  questioning  a  score  is  the 
candidate  notified  of  tl^e  review,  given  the  preliminary  decision,  and  informed 
of  the  options.  ;  .  . 

\ 

Candidates  whose  scores  are  questioned  by  ETS  are  offered  the  following  options. 

1-    to  provide  additional  information  to  the  Board  of  Review  that  the 
candidate  oefJeves  would  lead  to  a  different  decision; 

2.  to  Mtest  to  ^lonfirm  the  questioned  scores; 

3.  to  cancel  the  scores  with  no  record  <naintained  of  any  questions 
raised; 

4.  to  submit  all  if^formation  on  the  questioned  scores  to  the  colleges 
that  the  candidate  designates. 

The  procedures  described  above  are  b&sed  on  established  practice  and  pr(K:edures 
for  dealing  with  test  stores  of  questionable  validity  in  order  to  ensur'i  fair 
treHtnent-andH:on^d€Tftiality.    In  establishing  the  following  addltiona  procedures, 
its  and  the  College  Board  provide  an  option  for  candidates  to  go  beyond 
ekisting  procedures  by  appealing  an  ETS  Board  of  Review  decision  to  an  independent 
tKird' party. 


A|/bitration  Procedures 

1.  The  candidate  is  informed  by  letter  of  the  Board  of  Review's  preliminary 
decision  that  there  is  a  reasonable  bdili  for  questioning  the  validity  of  the 
candiudte's  score  and  is  given  the  four  options  specified  above.    In  the  same 
letter  the  candidate  is  told  of  the  availability  of  third-party  arbitration  if 
additional  information  provided  by  the  candidate  to  the  Board  of  Review  does  not 
persuade  it  to  change  its  decision. 

2.  If  the  Board  of  Review  concludes  that  doubt  still  exists  cbout  the  authen- 
ticity of  the  score  after  the  candidate  submits  additional  information,  the 
candidate  is  reminded  that  appeal  to  an  independent  third  party  is  available 
and  is  told  to  contact  ETS  if  he  wishes  to  initiate  this  process. 
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3     On  request  to  injlitdtc  the  arbttr^tion  process,  ETS  will  send  a  copy  of  an 
Arbitration  Agrefsnent  Form  (see  attachinent  A)  to  be  signed  by  the  candidate. 

4.    Upon  receipt  of  the  signed  Arbitration  Agreement  Form  for  third-party 
arbitration,  ETS  will  forward  the  request  to  the  American  Arbitration  Association 
with  a  swiwary  of  all  information,  along  with  copies  of  supporting  documents, 
that  led  to  the  decision  to  question  the  validity  of  the  candidate  s  scores. 

5    Upon  receipt  froci  ETS,   the  ^erican  Arbitration  Association  will  send  to 
the  candidate  a  duplicate  set  of  all  the  materials  provided  by  ETS  that  led  to 
the  decision  to  question  the  validity  of  the  scores  and  will  ^e  the  candidate 
twenty-one  days  to  reply.   The  candidate  will  be  informed  thatTwhHe  under 
noma!  circumstances,  the  costs  of  arbitration  will  be  borne  by  the  '^ollege 
Board   the  arbitrator  may  at  his  discretion  charge  the  candidate  for  a  portion 
of  the  costs  (not  to  exceed  $200)  if  the  arbitrator  finds  that  the  appeal  is 
without  reasonable  foundation. 

6.  All  informatinn  received  by  the  torlcan  Arbitration  Association  from  one 
party  will  be  provided  to  the  other  party  with  the  opportunity  for  a  response. 

7    Ordinarily  the  arbitrator's  decision  will  be  made  within  ten  working  days 
of  receipt  of  the  necessary  information  from  the  candidate.    (If  no  response 
is  received  from  the  candidate  within  the  allotted  time,  the  arbitrator  will 
make  a  decision  based  on  the  documents  already  submitted.)   Ordinarily,  the 
decision  will  be  based  on  information  submitted  by  mail.    However,  the  arbitrator 
will  consider  a  request  for  a  personal  hearing  if  there  are  compelling  reasons 
to  do  so.    The  cost  incurred  by  the  candidate  for  such  an  JPPe^fance  will  be 
borne  by  the  candidate.    If  a  personal  hearing  occurs,  both  sides  will  be 
invited  to  appear.    The  results  of  the  decision  will  be  forwarded  in  writing 
to  the  candidate  and  ETS.  . 


8.    If  the  cand 
{f  the  candidat 
the  specific  ac 
that  the 
designated 
explanation. 


idate's  appeal  is  denied,  the  candidate's  score  will  be  cancelled. 
e*s  appeal  is  upheld,  ETS  will  inform  the  candidate  by  letter  of 
..v.  -wtions  taken  to  implen^ent  the  arbitrator's  decision,  including 
original  score  reports  have  been  released  to  all  recipients  originally 
d  by  the  candidate  along  with,  if  necessary,  an  appropriate  letter  of 


Periodic  Review 

The  policies  and  procedures  described  in  this  paper  should  be  reviewed  . 
periodically  and  may  be  amended  or  revised  based  on  experience  and  changing 
circumstances 


July  1981 
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,  ATTACHMENT  A 


Agreement  for  Submission  to  Arbitration  of  Test  Security  Actions 


On  (date)  I  took  the       (name  of  exam)  examination 

administered  by  tducatfonai  Testing  Service  at  test  center. 

£TS  is  withholding  release  or,  if  already  released,  planning  to  cancel 
my  score(s)  because  of  a  decision  by  its  Board  of  Review  that  there  is  a  reasonable 
basis  for  questioning  the  validity  of  the  score(s).    I  have  been  Informed  of  my 
options,  n«nely:    (a)  n   "-t  to  confirm  the  questioned  scores,  (b)  submission  of 
additional  information  to  the  Board  of  Review  that  I  believe  would  lead  to  a 
different  decision,  (c)  authorizing  the  cancellation  of  my  scores,  with  no 
record  maintained  of  any  questions  raised,  (d)  release  of  all  information  on  the 
questioned  score  to  those  colleges  I  have  designated  as  score  recipients.  I 
have  submitted  additional  information  to  the  Board  of  Review  which  has  not 
persuaded  "it  to  revise  its  original  decision  that  there  is  a  reasonable  basis 
for  questioning  the  validity  of  the  score(s).    I  am  now  choosing  to  submit  the 
matter  to  independent  third-party  review  with  the  following  conditions: 

1.  I  understand  that  the  third-party  arbitrator  wil?  decide  only  whether 
£TS  has  a  reasonable  basis  to  question  the  validity  cf  my  scores  and  to 
withhold  or  cancel  thefn. 

2.  I  understand  that  Jthe  decision  of  the  arbitrator  is  final,  and  I  agree, 
as  a  condition  of  Submission  of  the  issue  as  mentioned  above,  to  be  bound 
by  the  decision. 

3.  Upon  receipt  of  this  agreement  signed  by  me,  £TS  will  forward 
this  agreonent,  together  with  a  summary  of  all  information  in  its 
possession  leading  it  to  question  the  validity  of  my  score(s), 
plus  copies  of  supporting  documents,  to  the  American  Arbitration- 
Association  (AAA). 

4.  The  AAA  will  then  write  to  me  and  give  me  the  opportunity  tQ  submit  in 
writing  my  position  that  the  questioned  scores  are  valid,  as  well  as 

any  additional  relevant  materials  supporting  tny  position.    The  AAA  will 
also  send  me  a  copy  of  all  materials  submitted  to  them  by  ETS  and  will  send 
a  copy  of  materials  submitted  by  me  to  ETS. 

5.  I  will  have  twenty-o»">e  days  from  the  date  on       AAA's  letter  to 

me  (as  menticned  in  Paragraph  4,  above)  to  submit  my  information.  Following 
receipt  of  iny  information,  the  arbitrator  will  reach  a  decision  within  ten 
business  days.    I  will  receive  a  copy  of  that  decision,  in  writijig,^  from 
the  AAA. 

6.  If  !  do  not  submit  the  information  requested  by  the  AAA  mentioned  in 
Paragraph  5,  above,  within  the  allotted  time,  the  arbitrator  will  make  a 
decision  based  on  the  information  available  at  the  expiration  of  twenty-one 
days  from  the  date  of  the  AAA's  letter  to  me  offering  me  a  chance  to  submit 
informction. 
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7.    I  understamJ/thdt /the  drbJtrator's  decision  will  ordinarily  be  based  on 
infomation  suVrtitte^  by  nail.*  However,  the  arbitrator  will  consider 
requests  for  a  personal  hearing  if  there  are  compel Hftg  reasons  to  do  so. 
If  a  personal  hearing  occurs,  both  sides  will  be  invited  to  appear.    I  , 
understand , that  any  costs  incurred  by  me  in  such  an  appearance  .wil  1  be  ciy 
responsibility. 

87  If /the  arbitrator's  decision  is  in  my  favor,  ETS  will  infom  me  In  ^ 
writiiig  of  the  specific  actions  being  taken  to  implement  the  arbitrator  s 
decfsion,  including  that  the  original  score  reports  have  been  released  to 
al!  recipients  designated  by  me. 

9.    If  the  arbitrator's  decision  Is  not  in  my  favor,  ETS  will  cancel  my 
score. 

,0.    I  understand  that,  under  ordinary  circumstances,  the  costs  of  the 
arbitration  process  will  be  borne  by  thfe  College  Board.    I  further  understand 
however,  that,  should  the  arbitrator  find      appeal  is  without  reasonable 
foundation,  I  may  be  charged  for  a  portioi#0^  these  costs  not  to, exceed 
$200  at  the  discretion  of  the  arbitrator.  .  ^• 


I  have  read,  understood,. and  agree  to  be  bound  by  this  agreement.    I  am 
aware  of  my  right  to  have  the  advice  of  anyone  I  choose  before  I  sign  this 
agreement. 


(Candidate) 


(Parent  or  guamian  ot  the  c^naidace. 
If  the  candidate  Is  not  18  years  of  age) 


'Tl)dte) 
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TABLE  2 
TEST  FEES 


P79-80 

19^6-81 

1981-82 

SAT             <  , 

t 

New  York  Surcharge 

8.25 

9.25 
1.75 

10.50 
.50 

CRE 

lA.OO 

20. 0^ 

2^.00 

\ 

 a  =^ 

CMAT             *  ^   

-  12.50 

"  23.50 

^        27.00  . 

TOEFL 

Incernatlonal  Testing  Program/ 
Soecial  Center  Testing  ProgcAra 

/ 

17.00 
25.00 

19,ioO 
27,00 

19.00 
27.00 

LSAT  AND  LSDAS  J, 
Batic  Reglitratlcfh  Fee 

LSDAS 

LSAT  only   

LSDAS  only 

"  15.00 
1  18.00 
15.00 
18.00 

16.00 
15.00 
15.00 
31.00 
31.00 

18.00 
20.00 
"7  15.00 
38.00 
33.00 

LSAT  +  LSDAS      '  '      33.00  ^  '  «6.00- 


SCORE 


PROCCIBIIRES 

'       ~         i  I, 

A  Guide  to  ETS  Test  Security 

Practices  for  Tesftilcers, 

Parents  an4  Counselors 
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^  * 

This  pamphlet  is  intended  to  familiarize  test 
takers—and  their  parents  and  other  persons, 
from  whom  they  may  seek  advice— with  the 
procedures  for  reviewing  test  scores  of 
questionable  validity.  Examinees  and  other 
affected  parties  are  entitled  to  know  why  certain 
scores  have  been  identified  for  review  and  the 
procedures  used  by  Educational  Testing  Service 
(ETS)  and  testing  program  sponsors  either  to 
verify  or  invalidate  scores  that  have  been 
questioned. 


0 
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ETS  is  »n  Ec|U8!  Opportunity  Employer. 
Copyright  ©  1961  by  Educ*tIoft«l  Testing  Service. 
\  All  rIgWs  reserved. 


476 


A  Matter  of  Equity 


Test  takers  whose  scores  have  been  questioned 
deserve  assurance  that  their  rights  to 
confidentiality  and  fair  treatment  are  being  fully 
protected.  Over  the  years  ETS  has  made  a 
diligent  effo»t  to  ensure  that  the  interests  of 
both  test  takers  and  score  users  are  g»ven 
balanced  consideration. 
.   Our  concern  for  equity  is  precisely  whywe 
are  stringent  in  matters  of  test  security.  Test 
takers  who  attempt  to  enhance  their  scores 
through  improper  means,  such  as 
impersonation  or  copying  answers,  are  abusing 
the  rights  of  the  vast  majority  of  those  who  take 
tests  unassisted  and  in  good  faith.  The  first 
obligation  of  ETS  and  the  test  sponsors  is  to 
ensure  that  some  candidates  are  not  permitted 
to  have  an  unfair  advantage  over  any  others.  We 
also  have  an  obligation  to  institutions  that 
receive  scores  to  provide  them  v/ith  information 
that  accurately  reflects  the  abilities  of  test 
takers.  Thus,  when  persons  register  to  take  an 
ETS-administerec|  test,  they  sign,  in  effect,  a 
contract  acknowledging  that  ETS  or  the  test 
sponsor  for  whom  we  are  an  agent  (such  as  the 
College  Board  or  Graduate  Record 
Examinations  Board)  have  the  sole  right  to 
cancel  any  test  score  if  there  is  reason  to 
question  its  validity. 

test  scores  are  canceled  or  withheld  only  if 
there  is  a  reasonable  basis /or  questioning  them 
*and  only  after  thorough  review  of  the,  facts 
pertinent  to  each  case— including  information 
presented  by  the  test  taker.  Such  actions  are 
not  intended  to  be  punitive;  they  are  kept  in 
strict  confidence.  Examinees  who  have  had  their 
scores  questioned  are  offered  a  retest  or,  * 
depending  on  the  policies  established  by  the 
test  sponsor,  an  opportunity  to  appeal  the 
decision. 
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Following,  in  question  and  answer  form,  is  an 
explanation  of  ETS  test  security  procedures  and 
steps  that  can  be  taken  if  test  scores  have  been 
questioned: 

Q:  Who  assembles  information  about  scores  of 
questionable  validity? 

A:  Information  is  assembled  by  the  ETS  Test 
Security  Office  under  policies  established  by 
the  ETS  Board  of  Review,  a  group  of  senior 
members  of  "the  professional  staff 
responsible  for  dealing  with  such  issues. 

Q:  How  are  questionable  scores  first  identified? 

A:  Such  scores  are  most  commonly  identified' 
through  a  computer  check  of  all  score 
differences  following  each  test 
administration.  If  the  comparison  of  the 
most  recent  score  with  a  previdus  score  (pr 
scores)  reveals  an  unusual  difference, 
available  information  is  assembled  and 
automatically  reviewed  for  handwriting 
differences,  indications  of  copying,  an 
exchange  of  answer  sheets,  or  for  other  signs 
of  possible  irregularities.  Questionable 
scores  also  are  brought  to  the  attention  of 
the  Test  Security  Office  by  score  recipients 
who  cannot  reconcile  an  apparent 
inconsistency  between  a  test  score  and  other 
information  kiiown  about  the  candidate, 
such  as  previous  test  scores  or  academic 
performance.  Othe^  test  takers  or  test  center 
supervisors  who  suspect  or  have  observed 
misconduct  also  report  such  information  to 
the  ETS  Test  Security  Office.  Occasionally 
ETS  receives  anonymous  letters  alleging 
irregularities.  Such  cases  are  reviewed,  but 
the  specific  content  of  such  letters  is  not' 
presented  to  the  Board  of  Review  for  its 
consideration. 
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Q:  Is  a  large  score  difference,  in  Ftself,  sufficient 
reason  to  cancel  a  score? 

•9- 

,A:  Mo.  Such  a  score  difference  must  be 

accorhpanied  by  at  least  one  other  indication 
of  an  irregularity. 

Q:  What  happens  to  test  scores  while  they  are 
being  reviewed?  ^ 

A:  Scores  that  have  not  been  reported  are 

withheld  pending  final  9utcome  of  the  c\ 
review,  and  are  released  only  if  cleared.  If 
the  scores  have  glrea.dy  been  reported,  score 
recipients  are  not  advised  by  ETS  of  the 
score  status  until  fjnal  determination  of  the 
case. 

Q:  What  happens  during  a  review? 

A:  If  the  Test  Security  Office  concludes,  upon 
review,  that  there  is  no  reason  to  question 
the  score,  the  inquiry  goes  no  further  and,  if 
the  score  has  not  been  released,  it  is 
reported  normally.  If  the  score  has  already 
been  reported,  any  inquirers  are  informed 
that  the  score  is  valid.  (Approximately  two 
thirds  of  ETS  reviews  end  at  this  stage  of  the 
process.) 

Q:  What  if  there  is  a  reasonable  basis  for 
questioning  the  validity  of  a  score? 

A:  If  the  Test  Security  Office  finds  that  the 
information  assembled  indicates  reason  to 
question  the  validity  of  a  score,  the  case  is 
presented  to  the  Board  of  Review  with  a 
riecommendation  for  a  specific  course  of 
action.  The  Board  then  examines  the 
information  and,  if  there  is  unanimous 
agreement  among  the  quorum*  of  three 
Board  members  that  there  is  a  reasonable 
basis  for  questioning  the  score,  the 
examinee  is  notified  of  the  Board  s  review 
and  preliminary  decision.  At  this  time, 
examinees  are  also  informed  of  the  options 
open  to  them. 
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Q:  And  if  there  is  not  unanimous  agreement  by 
the  Board? 

A:  If  even  one  member  of  the  Board  determines 
that  there  is  insufficient  reason  to  question  a 
score,  it  is  cleared  and  reported  according  to 
normal  procedures. 

Q:  What  options  are  available  to  a  test  taker 
whose  score  has  been  questioned? 

A:  Three  courses  of  action  are  open  to  the  test 
taker: 

1.  He  or  she  is  entitled  to  take  a  retest 
under  special  supervision  to  confirm  a 
questioned  score*  If  performance  on  the 
fetest  is  reasonably  close  to  the  score  in 
question,  ETS  will  either  affirm  its 
validity  to  score  recipients  who  may  heive 
questioned  it  (if  the  score  has  already 
been  released),  or  report  the  score 
promptly  to  designated  score  recipients 
^    (if  it  has  been  withheld).  A  test  taker  who 
V    h3S  been  advised  of  possible 

discrepancies  may  request  the  score 
confirmation  standards  for  his  or  her  - 
particular  test  from  the  Test  Security 
Office.  If  the  retest  fails  to  confirm  the 
questioned  score,  ETS  Nvill  cancel  the 
score  and,  if  it  had  been  previously 
released,  so  notify  score  recipients.  The 
basic  test  Tees,  plus  any  additional  fees, 
will  be  refunded. 

(A  test  taker  who  elects  this  option 
should  be  aware  that  he  or  she^will  be 
required  to  provide,  in  addition  to 
regularly  required  identification,  a 

•Because  of  administrative  difficulties,  persons  tested  outside 
the  Gnited  States  and  Canada  are  not  customarily  offered  a 
retest  for  the  purpose  of  confirming  a  questioned  score. 
They  may.  however,  provide  additional  relevant  information 
to  the  Board  of  Review  for  its  consideration  or  authorize 
cancellation  of  the  questioned  score. 
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separate  and  additional  recent 
photograph  which  will  be  forwardfed  to 
ETS  with  the  retest.  The  exanninee  also  is 
required  to  nanne  three  responsible 
*  individuals  who  can  identify  hinn  or  her 
fronn  this  photograph.  Each  test  taker 
may  be  asked  also  to  provide  a 
thunnbprint  as  an  additional  nneans  of 
positiye  identification  at  the  tinne  of  the 
retest.) 

If  an  exanninee  elects  this  option  he  or 
she  nnay  request,  prior  to  learning  his  or 
her  refest  results,  that  the  retest  score  be 
retained  as  the  score  of  record.  There  is 
'  no  refund  of  fees  when  the  retest  score  is 
reported  in  this  way. 

2.  A  test  taker  nnay  authorize  ETS  to  cancel 
the  questioned  score  and  rennove  it  fronn 
the  record.  The  basic  test  fee  plus  any 
aclditional  fees  will  be  refunded,  and,  if 
the  score  has  .already  been  reported,  ETS 
will  notify  the  score  recipients  that  it  has 
been  canceled.  Recipients  will  not  be 
infornned  of  the  reasons  for  cancellation. 
If  a  score  has  been  held  pending 
investigation,  no  disclosure  of  the 
cancellation  will  be  nnade  to  designated 
score  recipients. 

3.  Test  takers  nnay  provide  the  Board  of 
Review  with  additional  information  for  its 
consideration,  such  as  other  test  results 
or  academic  records  or  a  doctor's 
certificate  attesting  to  physical 
impairments  that  might  affect 
handwriting.  (Character  references  are  not 
generally  considered  by  the  Board  to  be 
relevant  to  the  validity  of  a  test  score.)  If 
the  Board  finds  the  information 
unconvincing,  the  examinee  may  submit 
additional  information, 'take  a  retest,  or 
authorize  cancellation  of  the  score. 


A  test  taker  who  decides  to  take  one  of 
the  options  3escol>ed  should  contact 
the  Secretary  of  the  Board  of  Review.  If  none 
of  tKese  options  is  chosen,  the  questioned 
score  will  be  withheld  and  not  reported  by 
ETS.  If  the  score  has  already  been  reported, 
score  recipients  will  be  notified  only  that  the 
score  has  been  canceled;  no  reference  will 
be  made  to  the  reason  for  the  cancellation. 

Q;  When  must  a  test  taker  select  one  of  these 
options? 

A:  If  a  score  has 'been  withheld,  there  iis  no 
deadline;  the  score  in  question  is  simply  held 
in  an  inactive  status  until  such  tirhe  as  the^ 
candidate  decides  to  respond. 

If  arscore  has  previously  been  released, 
the  examinee  is  notified  of  a  date  by  which 
he  or  she  must  respond.  If  there  is  no 
response  by  the  stipulated  date,  the  score 
will  becancelled,  fees  refunded,  and  score 
recipients  so  notified.  Score  recipients  will 
not  be  informed  of  the  reason  for  the 
cancellation. 

Q:  Is  there  anything  else  test  takers  should 
know? 

A:  The  ETS  Test  Security  Office  encourages 
examinees  to  call  for  further  information 
about  the  options  descrit>ed  above.  In 
addition,  certain  test  programs  have 
established  procedures  for  third  party 
mediation  of  test  security  cases.  The  Test 
Security  Office  can  inform  test  takers  of  the 
specific  test  programs  to  which  these 
procedures  are  applicable,  and  under  what 
conditions. 
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Additional  Options 

ETS  views  the  nature  and  results  of  test 
'score  validity  investigations  as  strictly 
confidential .  However,  we  recognize  the 
possibility  that,  based  on  the  available 
information,  other  parties  could  come  to 
different  conclusions  about  the  validity* of 
a  test  taker's  score.  Institutions  are  not 
bound  by  ETS  decisions  regarding 
questioned  test  s&res,  and  may  make 
their  own  judgments  on  the  usefulness  of  a 
test  score  for  their  own  decision  making. 
Therefore,  with  a  test  taker  s  written 
authorization  and  the  agreement  of  the 
institution(s)  involved,  all  information 
pertinent  to  the  investigation  of  the  score 
will  be  made  available  by  ET&to  a 
representative  of  the  designated 
institution(s). 

While  examinees  should  be  aware  that 
not  all  admissions  officers  may  be  willing 
to  review  the  facts  and  make  independent 
judgments,  this  is  a  course  of  action  worth 
considering. 

Finally,  each  test  taker  is-encouraged  to 
speak  with  his  or  her  parents,  counselor  or 
other  advisor  before  making  a  final 
decision  regarding  the  options  available  to 
him  or  her.  This  is  recommended  if  the 
lest  taker  is  a  minor.  The  Test^curity 
Office  is  ready  to  discuss  any  aspect  of 
this  matter  wi^h  affected  examinees,  and 
the  Board  of  Review  will  reconsider  any 
case  in  light  of  such  discussion  if 
requested.  ' 
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Educational  Testing  Service  (ETS)  is  a  nonprofit  organization  ,and  instructional  services;  and  research  on  techniques  and 
con^mitted  to  development  and  administration  of  respon-  uses  of  measurement,  human  learning^  and  behavior,  and 
sible  testing  and  financial  aid  programs;  creatiort  of  advisory  educational  development  and  policy  formation. 


ACADEMIC  TESTING  PROGRAMS 

ETS  develops  and/or  administers  tests  for  various  spon 
sors  in  the  Umted  States  and  administers  examination 
programs  m  some  156  other  countries.  Additionally,  the^ 
organization  supplies  related  seryices,  scoring  tests,  re- 


cording, storing,  and  reporting  test  results,  performing 
validity  studies,  undertakiiiy  program  research.  The  num- 
bers (to  the  nearest  thousand)  taking  the  td^ts  in  1979-80 
are  listed  for  several  major  programs. 


^     Testing  Program 

Sponsor* 

Candidate  Volume/  1979-80 

Elementary  &  Secondary  Level 

Educational  Records  Bureau  (ERB) 

ERB 

173.000 

Secondary  School  Admission  Test  (SSAT) 

.  SSAT  Board 

50.000  ' 

College  Level 

Admissions  Testing  Prograrh  (ATP)  | 

CB 

1,527;000 
1  ?B5,006 

ERIC 
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Test  of  Standard  Written  English  (TSWE) 

•  • 

Achie^jem^t  Tests  only 

* 

76,C00 

#SAT  and*Achievement  Tests 

- 

196p000 

Advanced  Placement  Program  (APP) 

CB 

120p000 

College-Levj|pxamination  Program  (CLEP) 

CB 

266,000* 

Comparative  Guidance  and  Placement  Program  (CGP) 

CB 

•  •  •  • 

National  Teacher  Examinations  (NTE) 

NTE  Policy  Council 

76,000 

Preliminary  Scholastic  Aptitude  Test/National 

Merit  Scholarship  qualifying  Test  (PSAT/NMSQT) 

CB/NMS^ 

1,270.000 

Test  of  English  as  a  Foreign  Language  (TOEFL) 

CB/GRE  Board 

282,000 

Graduatt  &  Proftsslonal  Levtl 

Graduate  Management  Admission  Test  (GMAT) 

GMAC 

»  205,000 

Graduate  Record  Examinations  (GRE) 

GRE  Board 

302,000 

•Law  School  Admission  Test  (LSAT) 

LSAC 

112,000 

—    .  \ 

•CB-ColI<se  Bo4rd.  ERB- Education*!  Recor*.^  Bureau.  Inc  .  ETS-Educ*t»n*l  Testing  Service.  \        '  'TSWE-Admini«ered  in  conjunction  wrth  the  SAT 
GMAC— Gr«du4ie  M*n*l^<ment  AdmiSJton  Counct);  GRE  Board— Graduate  Record  Examma-  \      "*Numberof  examinationsadminmercd 

liojfl  Board.  LSAC- Law  School  Admission  CounciL  NMSC^  National  Mer«  Scholarship  Corpo  ^  *  "  'CCP-institiKionallv  administered  40.000  mdividuatly  self  scored  298  000 
ration.  SSAT  Board -Secondary  Schoo!  Admission  Test  Board.  Ir>c  \^ 
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DIRECT  ''.INES  FOR  TESTING  PROQR/XMS  ' 


ATP 

■  609-771-7600 

LSAT 

■ 

215-968-1000 

SSAT 

■ 

609-771.7530 

GMAT 

■  609-772-7330 

NTE 

■ 

609-771-7330 

TOEFL 

■ 

609-771-7570 

GRE 

■  609-771-7615 

JnquiiiM  concerning  other  ETS  testing  program* should  be  directed  to  the  Princeton  Off>ce.  609-921  9000.  The  c«ble  address »  EDUCTESTSVC.  telex  84  3420 


FINANCIAL  AID  SERVICES 


^  Financial  Aid  Service 

Sponsor* 

Volume/ 
1979  80 

For  information,  write 

Secondary  Lev«i 

School  S<!holarship  Service  (SSS)  ^ 

NAIS 

36,000 

School  Scholarship  Service 
Box  599,  Princeton,  NJ  08541 

Coll«g«  Leva! 

College  Scholarship  Service  (CSS) 

CB 

2,850,000 

\ 

\^  College  Scholarship  Service 
\^ox  2700,  Princeton,  NJ  08541 

Graduate  I  Profassional  Laval 

Graduate  &  Professional  School 
Financial  Aid  Service  (GAPSFAS) 

GAPFAC 

88,000 

Graduate  &  Professional  School 

Financial  Aid  Service 

Box  2614,  Princeton,  NJ  08541 

•<5B-Coflege  Board;  GAPFAC- Graduate  and  Pro(ej$Jonal  Financul  Aid  Council,  NAIS- National  Association  of  Independent  Schools 
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INSTITUTIONAL  SERVICES 


Institutional  Service 

•  Sponsor' 

S«condar/  Ltvtl 

Questionnaire  for  Students,  Teachers,  and  Administrators  (QUESTA  I  and  QUESTA II) 

- 

SSRP 

ATP  Summary  Reporting  Service  (SRS)  * 

Community  College  Goals  Inventory  (CCGIJ 

ETS 

Institutional  Functioning  Inventory  (IFI) 

ETS 

Institutional  Goals  Inventory  (IGI) 

ETS 

Small  College  Goals  Inventory  (SCGI) 

ETS 

Student  Instructional  Report  (SIR) 

ETS 

Student  Reactions  to  College  (SRC) 

ETS 

Student  Search  Service  (SSS) 

CB 

Undergraduate  Assessment  Program  (UAP) 

UAP  Council 

Validity  Study  Service  (VSS) 

CB 

Graduate  Laval 

Minority  Graduate  Student  Locater  Service  (MGSLS) 

GRE  Board 

•CB  -Con<9<  Bo*rd.  ETS-Educ«lion«lTejiing  S«vlce,  ORE  Bo«rd-Gr»du«te  Record  Ex«min«ilon$  Bo*fd.  SSRP-Second«ry  School  ResMrch  Progrtm.  be  . 
UAP  Council- UndergTidu«te  Assessment  P/ogram  Council 
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OCCUPATIONAL  AND  PROFESSIONAL  MEASUREMENT  PROGRAMS 

The  ETS  Center  for  Occupational  and  Professional    uing  education/self-assessment,  and  selection  m  some 30 
Assessment  (COPA)  develops  and/or  administers  written.,  occupations  and  professions.  These  include, 
and  performance  tests  for  licensing,  certification,  contin- 


Actuaries 

Engineers 

Physicians 

Architects 

Foreign  Service  Officers 

Podiatrists 

Auto  and  truck  mechanics 

Public  housing  managers 

Purchasing  managers 

Business  forms  designers 

Insurance  agents 

Radiologic  technologists 

City  planners 

Lawyers 

Real  estate  brokers  and  salespersons 

Construction  code  inspectors 

Nurses 

Respiratory  therapists 

Contact  lens  dispensers 

Obstetricians  and  gynecologists 

Social  workers 

Data  processing  personnel 

Opticians 

Travel  agents 

Dental  auxiliaries 

Pharmacists 

U.S.  Employment  Service  personnel 

OFFICE  FOR  MINORITY  EDUCATION  (OME) 

OME  coordinates  ETS's  continuing  efforts  to  help  minori-  vices.  OME  provides  consultation  and  training  for  edu- 

ty  students  gam  access  to  and  benefit  from  education  at  cators  and  students  m  such  areas  as  bilingual  education, 

all  levels.  OME  collects  information  on  barriers  to  minority  assessment,  instruction,  and  test  awareness, 
achievement  and  identifies  relevant  research  and  ser- 
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TEST  COLLECTION 


The  Test  Collection  is  probably  the  largest  open  library  of 
its  kind  in  the  world.  It  provides  access  to  most  tests  and 
assessment  devices  p^ubllshed  in  the  U.S.,  as  well  as 
many  of  those  published  in  foreign  countries.  Instruments 


cited  in  the  journal  literature,  but  not  available  through 
publishers,  are  also  collected,  and  some  of  these  can  be 
obtained  in  microfiche  form  from  the  Test  Collection.  In 
addition,  information  on  test  publishers  is  provided. 


ERIC/TM  CLEARINGHOUSE 

Supported  by  the  National  Institute  of  Education,  each  of 
the  16  Educational  Resources  Information  Center  (ERIC) 
clearinghouses  is  responsible  for  collecting,  cataloging, 
indexing,  and  abstracting  unpublished  research  and  de- 
velopment documents.  Over  170,000  such  documents  on 


microfiche  comprise  the  complete  ERIC  collection,  which 
can  be  accessed  through  a  computer  retrieval  system. 
The, ERIC/TM  Clearinghouse,  located  at  ETS,  is  responsi- 
ble for  documents  relating  to  testing,  measurement,  eval- 
uation, learning  theory,  and  human  development. 


PROGRAMS  OF  CONtlNUINQ  EDUCATION  (PCE) 


Programs  of  Continuing  Education  (PCE)  offers  work- 
shops at  ETS  on  subjects  related  to  testing,  evaluation, 
and  measurement  issues  that  concern  and  interest  educa- 
tors. Topics  include  assessing  basic  skills,  formative  and 
summative  staff  evaluation,  assessment  of  programs  in 


special  education,  and  analyzing  students*  writing  skills. 
PCE  also  produces  instructional  packages  for  use  in 
school  districts*  inservice  programs.  Packages  include 
content  outline  or  te,<ts,  visual  aids,  background  materi- 
als, and  copy  for  preparation  of  handouts. 
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PROGRAMS  FOR  THE  ASSESSMENT  OF  WRITING 


Programs  for  the  Assessment  of  Writing  reflects  ETS's 
long-standing  interest  in  the  teaching  and  evaluating  of 
writing  and  offers  a  wide  range  of  program  services  and 
other  activities  designed  to  help  those  in  the  academic 
and  business  communities  concerned  with  improving  and 

INTERNATIONAL  OFFICE 

The  ETS  International  Office  coordinates  overseas  activi- 
ties of  the  organization  and  conducts  programs  as  well  as 
instructional,  research,  and  consultative  projects  abroad. 
The  curriculum  of  the  instructional  progam,  offered  yearly 
at  ETS,  includes  techniques  in  test  development  and  pro- 
duction; statistical  analysis  at  the  introductory,  intermedi- 
ate, and  advanced  levels;  and  program  evaluation.  The  of- 


RESEARCH 


Education  Policy  Regearch  Institute 

Educational  as^essment;;;finance  and  governance 


evaluating  writing.  Offerings  include  program  and  scoring 
services,  such  as  the  development  of  placement  and  de- 
scriptive tests  of  writing  ability,  and  professional  develop- 
ment workshops  and  seminars. 


fice  also  provides  educational  measurement  and  evalua- 
tion workshops  and  courses  tailored  to  the  needs  of 
groups  from  particular  countries  or  regions.  International 
conferences  and  workshops  arranged  in  the  United  States 
and  abroad  help  to  initiate  and  further  collaborative  re- 
search. 


Divisions 


Measurement,  Statistics  and  Data  Analysis  Research 

Educational  technology;  measurement  methodology; 
psychometric  research;  scientific  programming; 
statistical  research 
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Educational  Research  and  Evaluation 

Bicultural  research;  educational  program- evaluation; 
educational  sociology,  guidance,  higher  education, 
instructional  research,  occupational  and  career  research* 
student  development;  teacher  behavior 


Basic  psychological  investigation 

Service  to  the  educational  community 

Development  and  improvement  of  operational  programs 


Expenditures/ 1979^0 


$8,225,000,  including  $5,690,000 
from  outside  contractors  and  grantors 


Projects/ 1979^0 


Major  funded  projects— 98 
(including  program-related  research) 


ERIC 


Center  for  Assessment  and  Research  in  Human 
Development 

Cognition  and  learning,  infancy,  personal/cognitive 
development,  personality  and  social  behavior; 
psycho-educatiorial  development;  young  children 


Funding  Sources/ 1979r80 


52,0%— Federal  government 
30.8% -ETS  support 
3.9%— Foundations 

.2%— State  and  local  government 
13,1%— Other  sources 


100.0% 


Staff/ 1979^0 


204  data  analysis  specialists,  economists,  measurement 
specialists,  psychologists,  research  assistants,  secretaries, 
sociologists,  statisticians 


4- 
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EDUCATIONAL  TESTING  SERVICE 

statements  of  Revenue  and  Expenditures  for  the  fiscal  . year  ended  June  30, 1980 


Revenue 


Expenditures 


Testing  activities 

Research,  development, 
and  instructional  services 

Other  revenue 

Total  revenue 


$95,959,540 

8,970,101 
1,864,689 


(90%) 

(8%) 
(2%) 


$106,794,330  (100%) 


Salaries,  wages,  and  employee  benefits 

$57,995,762 

(54%) 

Professional  services 

11.020,305 

(10%) 

Printing  and  niaterials 

9,921,531 

(  9%) 

Depreciation 

2,204.037 

(  2%) 

Electronic  equipmerit  rental  and  services 

4,805,231 

(  4%) 

^Uli|iges^anip«^P^ts;  taxes 

1,880,930 

(  2%) 

Freight  and  postage/telephone 

and  telegraph 

9:262,901 

'(  9%) 

Other  operating  and  / 

administrative  expenses 

10.305,336 

(10%) 

Total  expenditures 

$107,396,033 

(100%) 
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HENRY  CHAUNCEY  CONFERENCE  CENTER 


Who  Can  Use  the  Center 


The  Center,  located  at  ETS  headquarters  in  Princeton,  is  available  to  educational  and  research  organizations  and  agencies  and  to 
other  groups  that  sponsor  conferences  or  meetings  for  educational  purposes.  The  Center  can  be  used  for  meetings  that  last  several 
days  or  a  few  hours  and  for  groups  of  10  to  200. 


r 


Conference  Facilities 


Meeting  Rooms 

The  auditorium  barn  can  be  used  in  its  entirety  to  seat  up  to  200  or  subdivided  into  separate  meeting  rooms  Other  meeting  rooms  arc 
designed  for  groups  of  10  to  100.  Facilities  for  film  projection,  slide/tape  presentations,  and  other  visual  aids  are  available  Support- 
ipg  services  such  as  administrative  and  clerical  assistance  can  be  arranged  in  advance. 


Accommodations  » 

The  Center  has  100  bedrooms  designed  for  single  or  double  occupancy.  The  main  dining  room  seats  up  to  200  guests 


For  Information 


For  reservations,  schedule  of  rates,  or  further  information,  call  the  operations  manager.  609-921  3600,  or  write  to  the  Henry 
Chauncey  Conference  Center.  Box  2605,  Princeton,  NJ  08541. 
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ETS  OFFICES 


MAIN  OhMCl 

NATIONAL  RELATIONS  OFFIC  b 

PUERTO  RICO  OFFICt 

SOUTHERN  REGION 

Ros<d«'.«  Road 

Pnnceton.NJ08541 

609-921.9000 

WtlHamW  Tumbui).  President 

1800  Massachusetts  Avenue.  NW 
Washington.  DC  20036 
202-659-0616 

Alice  J.  Irby.  Vice  President 

Suite  1115 

Banco  Popular  Center 
209  Munoz  Rivera  Avenue 
Hato  Rey»  PR  00918 
809-753.6363 

Protase  Woodford.  Director 

Suite  2020  250  Piedmont  Avenue 
Atlanta.  GA  30308 
404-524.4501 

Scarvia  B.  Anderson.  Senior  Vice  President 
Charlotte  Rentz.  Director 
Alabama    Kentucky        South  Carolina 
Rorida      Mississippi  Tennessee 
Georgia     North  Carolina  Virginia 

WESTERN  REGION 

MIDWFSTERN  REGION 

NORTHEASTERN  REGION 

Berkeley  Office 

1947  Center  Street 
Berkeley.  CA  94704 
415-849-0950 

JohnW  Evans.  Director 

Alaska  Montana 
Northern      Northern  Nevada 

Cafifornia  Oregon 
Colorado  Utah 
Hawaii  Washington 
Idaho  Wt^'oming 

Lo9  Angeles  Office 

Room  216 

2^00  Merton  Avenue 
Los  Angeles.  CA  90041 
213-254.5236 

J  Richard  Harsh.  Director 

Ari2ona 
Southern  Southern 
California  Nevada 

Southwestern  Office 

Suite  100 
South^test  Tower 
211  East  Sever^th  Street 
Austin.  TX  78701 
512-478.8191 

Reginald  A.  Cordcr.  Director 

Arkansas          New  Mexico 
Louisiana  Oklahoma 
Texas 

1  American  Plaza 
Evanston.lL  60201 
312-869.7700 

Mich>e!  Kean,  Director 

Illinois  Missouri 
Indiana  Nebraska 
Iowa                   North  Dakota 
Kansas  Ohio 
Michigan              South  Dakota 
Minnesota            West  Virginia 
Wisconsin 

1 1 1  Washington  Street 
Brookline.  MA  02146 
617-739.2210 

George  W,  Elford.  Director 

Connecticut       New  Hampshire 
Delaware          New  Jersey 
Maine              New  ^ork 
Maryland  Pennsylvania 
Massachusetts     Rhode  Island 
Vermont 

For  further  mfo'irjti.jri  regarding  ETS  prugtams.  and  activities.,  contact  the  Information  Division.  Educational  Testing  Service.  Princeton.NJ  08541/ 
609  <J21  <)000  The  cable  address  is  EDUCTESTSVC.  telex  84  3420.  Educotionof  Testing  Service  is  an  Equal  Oppartunitv  Einplayer. 
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SIDE-BY-SroE  COMPAEISON 
OF  H.R.  1662  PROVISIONS  AND 
CURRENT  PRACTICES  OF  GUIDANCE 
AND  ADMISSIONS  TESTS 
ADMINISTERED  BY  ETS 


Major  Points: 

•  Admissions  test  sponsors  served  by  ETS  already  pro- 
vide voluntarily  most  of  the  information  about  tests 
required  by  H»R.  1662.  For  example  they: 

— provide  information  about  each  test,  its  purposes,  its 
scoring,  and  the  interpretation  and  use  of  scores,  to 
test-takers  and  institutions,  


— publish  studies  about  their  tests, 

— voluntarily  disclose  nationwide  the  questions  on  sev- 
eral major  administrations  of  each  admissions  testing 
program  each  year/ 

•  H.R.  1662  would  require  the  establishment  of  a  bureau- 
cratic entity  in  the  Department  of  Education  to  collect 
information,  most  of  which  is  already  publicly  avail- 
able, and  to  prepare  a  report  to  ^Congress  on  subjects 
which  have  already  been  widely  and  thoroughly  de- 
based. 

•  This  bill's  forced  disclosure  of  confidential  documents 
governing  business  transactions  between  non-profit 
organizations  is  unprecedented.  It  represents  unwar- 
ranted governmental  intrusion  into  private  business 
affairs. 
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KEY  PROVISIONS  OF  H,R.  1662 
(The  Educational  Testing  Act  of  1981) 

Sec.  3    Information  to  Test  Subjects  and  Postsecondar>  Education  Institutions 
•    Test  agencies  mubt  include. in  registration  materials  mformatjun  as  to. 

— test's  purpose^ 

\.  2 
— subjebt^matter  and  knowledge  and  skills  measured 

— interpretation  of  test  results,  including  test  explanation,  correlation 
between  score  and  future  school  success,  standard  error  of  mea- 
surement and  correlation  between  test  score  and  career  success^ 


— effects  on  and  uses  of  test  scores,  including  extent  of  improved  ac- 
curacy in  prediction  over  Gr^ide  Point  Average,  comparison  of 
scores  according  to  incume,  and^extent  of  score  improvement  from 
coaching'^ 


5 

-form  of  score  report,  alteration  of  scores,  and  use  in  prediction 

-accuracy  of  scoring,  timeliness  of  reporting,  and  privacy 

-students'  property  interest  in  test  results,  retention,  storage  and 
future  use  of  scores'^ 


—time  period  within  which  students  and  institutions  will  receive 
scores^ 

9 

— special  services  for  handicapped  students 

—lest  disclosure,  lest  privacy,  and  appeal  procedures'^ 

•  inbtitutionb  which  are  test  scure  recipients  must  albo  receive  above 
information^^  * 

•  Slutieuis  and  insiitutiun.s  mu.sl  bo  notified  if  stores  <irt:  (hilasiui  ton 
O          days  J  2 

ERIC  502 
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CURRENT  PRACTICE  OF  GUIDANCE  AND  ADMISSIONS 
TESTS  ADMINISTERED  BY  ETS 
(SAT,  PSAT,  GRE,  LSAT,  GMAT,  TOEFL) 


Sec.  3    Information  to  Test  Subjects  and  Postsecondary  Education  Institutit is 

1  Provided  by  all  tests  in  registration  materials. 

2  Provided  by'all  tests  in  registration  materials. 

3  All  test  programs 'provide,  either  in  registration  materials  or  mater- 
ials distributed  at  the  time  of  score  reporting,  informati(m  on  how  to 
interpret  test  results,  including  the  standard  err/)r  of  measurement, 
relationship  of  scores  to  first  year  grades,  and  the  use  of  scores  in 

'  coo]uriction  with  grades  in  school.  Most  programs  include  statements 
to  the  effect  that  the  tests  are  not  designed  to  predict  future  success 
in  a  given  field  and,  consequently,  do  not  include  statements  about 
how  well  scores  predict  success  or  income. 

-  4  See  3  above.  This  information  is  available  in  published  research  re- 
ports for  some  programs;  others  do  not  collect  income  information 
from  candidates.  ETS  and  test  sponsors  believe  it  is  not  desirable  to 
report  this  mformation  in  preregistration  materials  for  candidates  be- 
cause It  could  be  misleading  since  individual  candidates  in  all  income 
groups  can  and  do  obtain  scores  at  all  levels. 

Meaningful  statistical  averages  or  percentages  on  the  effects  of 
coaching  are  not  available  because  the  results  of  those  studies  that 
have  been  done  vary  so  widely.  Reports  of  all  such  studies  are  pub* 
hcly  available.  All  programs  include  general  statements  on  the  effects 
©f  coaching  m  their  registration  or  test  preparation  materials  (except 
TOEFL  which  is  an  achievement  test). 

5  Provided,  where  applicable,  in  registration  materials  and/or  with 
score  reports. 

6  Provided  by  all  tests  in  registration  materials.  ^ 

7  "Property  interest"  is  an  inappropriate  reference;  however,  the  issue 
of  confidentiality  with  respect  to  retention,  storage  and  future  use  of 
scores  is  discussed  in  all  registration  materials. 

8  Provided  by  all  tests  in  program  materials. 


9    Provided  by  all  tests  in  program  materials. 

10  Provided  by  all  tests  in  program  materials. 

1 1  Institutions  are  provided  the  same  information  provided  to  test-takers.  <^ 

12  Those  testing  programs  which  have  experienced  delays  in  score  re- 
porting have  routinely  notified  students^and  institutions  at  the  time  of 

-  regular  reporting  that  a  score  or  scores  will  be  delayed. 
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KEY  PROVISIONS  OF  H,R,  1662 
Sec.  4    Reports  and  Statistical  Data  and  Other  Information 

•    The  Secretary  musl  be  provided  Ihe  following  information; 

—any  study,  evaluation  or  statistical  report  about  a  test  which  a  test 
agency  prepares  or  causes  to  be  prepared,  or  provides  data  for  ^ 


— a  copy  of  service  contracts  between  test  developer  and  test  spon- 
soring agencies^  , 

•  All  documents  so  submitted  shall  be  considered  records  subject  to  the 
Freedom  of  Information  Act^ 

•  The  Secretary  must  report  to  Congress  on  relationships  between  test 
scores  and  income^  race.  sex.  ethnicity,  handicapped  status,  and 
completion  of  lest  preparation  courses^ 

Sec.  5    Promoting  a  Better  Understanding  of  Tests 

•  Test  agencies  must  file  w^ith  the  Secretary  and  send  test  subjects, 
upon  request:^ 

— a  copy  of  test  questions  used  in  determining  raw  scores 

— the  correct  answers  (and  to  test  subjects,  their  mdividual  answer 
sheets) 

— a  statement  of  rules  for,  transferring  raw  scores  (and  to  lest  Rab- 
jecls.  the  raw  score  used  to  calculate  the  final  score) 


2 

•  Test  agencies  may  charge  a  nominal  fee  for  this  service  * 

•  These  provisions  do  not  Apply  to  tests  administered  to  less  than  S.boo 
pen yea r^ 

^      •    Documents  submitted  to  the  Secretary  re  considered  records  subject 
to  the  Freedom  of  Information  Act,"^ 
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CURRENT  PRACTICE  OF  GUIDANCE  AND  ADMISSIONS 
TES^ADNIINISTEREbBYETS  : 

Sec.  4    Reports  and  Statistical  Data  and  Other  Information     -  . 

1  Routinely  ETS  publishes  studies  it  carries  out,  if  not  identifiable  with 
particular  individuals  or  institutions,  or  when  not  precluded  from  re- 
lease by  contract  agreement.  However,  ETS  and  test  sponsors  cannot 
be  responsible Jor  studies  conducted  by  others  based  on  data  provided 
by  tfiem. 

2  ETS  and  its  clients  follow  the  typical  business  practice  of  keeping 
their  contractual  agreements  confidential. 

3  See  1  and  2  above. 

4  Routinely  ETS  publishes  research  findings  on  these  subjects  where 
not  precluded  because  cxf  confidentiality  considerations  or  contrac- 
tual agreement. 

Sec.  5    Promoting  a  Better  Understanding  of  Tests 

^  I    All  admissions  test  sponsors  served  by  ETS  have  instituted  Voluntary 
procedures  for  disclosing  their  tests  nationwide: 

SAT:       Four  of  six  regular  national  administrations  plus  a  special 
October  administration  in  six  slates  are  disclost;d. 

LSATf     All  four  major  administrations  are  disclosed. 

GRE:       Two  of  the  five  major  adminTstrations  of  the  aptitude  lest 
are  disclosed.* 

GMAT:    All  four  major  administrations  are  disclosed. 

For  all  testing  programs  there" is  at  least  one  opportunity  for  a  Satur- 
^  day  Sabbath  observer  to  take  a  disclosed  test.  ^ 
*  *(Note:  Constraints  resulting  from  introducing  a  newly  formatted 
test  in  Oct.  '81  prevents  disclosure  of  additional  GRE  test 
forms  in  the  1981-82  testing  year,  three  are  planned  for 
1982-83.) 

2    Nominal  fees  are  charged  for  disclosure. 
3*  See  1  above. 

4    Protecting  copyright  on  disclosed  tests  is  a  concern  of  ETS  and  its 
lest  sponsors.  A  perception  by  the  public  that  material  that  is  ''avail- 
able" is  not  protected  by  copyright  could  lead  to  inappropnatb  com- 
mercial  uses  of  test  mjaterial  and  might  also  jeopardize  Iho  security  of . 
other  undisclosed  test  material* 
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KEY  PROVISIONS  OF  H.R.  1662 


4b 


Sec.  6    Privacy  of  Test  Scores 

•  Test  scores  may  not  be  released  to  any  party  unless  authorized  byjesl 
subject^ 

*  Test  agencies  may  release  all  previous  scores  to  designated  score 
recipients^ 

Sec.  7    Testing  C&ets  end  Fees  to  Student s 

♦  Testing  agencies  must  report  to  the  Secretary 
—the  closing  date  of  their  testing  year 

— the;;number  of  times  a  test  was  taken  during  the  testing  year 

,  — the  number  of  test-takers  taking  the  test  once,  twice,  and  more  each 
year 

— the  number  of  refunds  given  to  registrants  who  didn't  take  the  test 

— the  number  of  test-takers  for  whom  the  test  fee  was  waived  or 
reduced "  - 

— total  amount  of  fee?  received  for  each  test  program  per  year 
— total  revenue  received  from  each  program 

— expenses  to  the  test  agency  including  test  development  and  over- 
head costs 

.  — number  registering  for  admissions  data  assembly  services  and  for 
•score  reporting  services  for  which  fees  are  charged 

— amount  of  revenue  received  for  admissions  data  assembly  and  score 
reporting  services 

— expenses  for  admissions  data  assembly  and  score  reporting  services. 
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CURRENT  PRACTICE  OF  GUIDANCE  AND  ADMISSIONS 
TESTS  ADMINISTERED  BY  ETS 


Sec.  6    Privacy  of  Test  Scorer 

1    This  is  existing  practice, 

Z    This  is  existing  practice. 


Sec.  7    Teiting  Costs  and  Fees  to  Students 

Much  of  the  information  regarding  test  repeaters,  refunds,  and  fee 
waivers,  is  maintained  by  ETS  but  not  regularly  reported  because  of 
lack  of  public  interest.  Information  about  ETS  fees,  revenues^  and 
expenses,  except  that  v^hich  is  considered  confidential  according  to 
standard  business  practices,  is  publicly  available.  Information  con- 
cerning data  assembly  services  is  not  an  ETS  responsibility,  but  rath- 
er one  of  the  Law  School  Admissions  Service. 
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Mr.  Weiss.  Another  area  that  we  had  some  dispute  over  is  a 
question  as  to  what  the  test  developer  or  test  giver  ought  to  be 
doing  to  bring  to  the  attention  of  the  test  taker,  that  the  informa- 
tion included  in  H.R  1662  is  available  to  him  or  her.  There  have 
been  different  approaches  to  that.  The  law  school  people  have  a 
box  on  the  top  sheet  of  their  test  which  the  test  taker  simply  has  to 
check  if  in  fact  he  or  she  wa^)ts  the  results.  It's  not  feven  going  to 
be  necessary  as  of,  I  understand,  this  year  or  next  year  because 
everybody's  going  to  get  them,  but  that  was  their  approach  to 
them.  The  ETS  approach  was  to  have  a  separate  sheet  of  paper 
which  the  test  taker  had  to  locate  within  the  packet  and  then 
having  located  it,  to  make  some  notation  on  it,  and  then,  I  guess, 
submit  rt  m  some  way  to  ETS.  The  question,  I  think,  I  asked  of  a 
witness  from  the  College  Board  at  the  last  hearing  and  I  ask  it  of 
you,  why  can't  you  make  it  as  simple  as  the  law  school  admission 
people  made  it. 

Mr.  Anrig.  Mr.  Chairman,  because  you  made  an  error  that  I 
used  to  make  all  the  time  until  I  came  to  ETS  and  that  is  you  as- 
sumed that  the  College  Entrance  Examination  Board  and  the  Edu- 
cational Testing  Service  are  one  in  the  same— they  are  not.  Educa- 
tional Testing  Service  is  contracted  by  the  College  Board,  by  the 
Law  School  Admissions  Board,  by  the  Graduate  Management  Advi- 
sory Council,  and  by  the  Graduate  Records  Examination  Board,  to 
perform  certain  services.  The  decisions  on  those  programs  are 
made  by  each  of  those  independent  governing  boards.  We  adminis- 
ter whatever  decisions  those  are  that  are  carried  out.  Obviously  we 
try  to  influence  those  decisions  and  advise  on  them,  but  the  deci- 
sion jests  with  the  separate  governing  boards  which,  in  turn,  con- 
tract with  us  to  carry  out  their  decision. 

My  own  feeling  is  if  you're  going  to,  release  it,  put  it  out  there.  I 
have  no  problem  at  all  with  that,  but  that'^not  my  decision.  The 
decision  rests  with  the  governing  board.  In  fact,  I  think  that's  not 
as  big  an  issue  as  has  been  made  of  it.  We're  talking  here  about 
youngsters  who  are  going  on  to  college.  The  difference  of  them 
dealing  with  a  checkoff  point  or  filling  out  a  separate  form,  they 
are  experts  in  filling  out  separate  forms.  They've  been  doing  it  all 
their  lives,  and  many  of  those  forms  I  required  as  a  state  commis- 
§ioner.  So  I  don't  think  that's  a  big  issue. 

Mr.  Weiss.  I  think  it  is,  because  you  know  what  happens.  We  get 
.  the  witnes.ses  coming  back  to  us  telling  us  how  unnecessary  this 
legislation  is,  arguing  that  the  test  takers  don't  want  the  results, 
right?  Now,  it  seems  to  me  you  can't  really  have  it  both  ways.  You 
can't  hide  the  request  form— I'm  not  talking  about  you,  whoever  is 
giving  the  test  at  that  time—can't  hide  the  request  form  and  then 
argue  that  because  it's  not  found  or  it's  not  sent  in  in  large  enough 
numbers  that  students  are  not  interested  in  submitting  a  request 
form. 

Mr.  Anrig.  Well,  two  points,  Mr.  Chairman.  First,  you  didn  t 
hear  me  today  advance  the  argument  on  how  many  people  are 
asking  or  not  asking  for  the  forms.  I  don't  think  that's  a  worth- 
while argument.  ,        i  , 

Mr.  Weiss.  Yes,  but  the  College  Examination  Board  people  made 

it. 
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Mr.  Anrig.  That's  their  perogative  to  do  so.  I  can  only  speak  for 
Educational  Testing  Service,  and  you  did  not  hear  that  referred  to 
in  my  testimony  nor  do  you  see  it  other  than  in  gross  numbers  in 
the  appendices  to  the  testimony.  I  don^t  think  that's  an  argument 
we  should  get  into,  but  that  s  my  judgment  and  9thers  are  entitled 
to  theirs.  The.second  point  is  the  forms  have  not  been  heavy.  The 
forms  are  there,  I've  seen  them.  They're  not  either  complicated  or 
-.^^hidden.  Is  there  a  better  way  to  do  it?  In  my  judgment,  yes,  I 
happen  to  like  what  the  Law  School  Admissions  Council  is  doing, 
but  it's  not  ^nij'  judgment.  The  judgment  rests  with  the  boards  that 
•govern  those  te^programs. 

I  think  what  is  happening  and  I  believe  the  July  heating  in- 
ferred this  was  that  over  time,  people  are  going  to  be  more  alike 
than  different.  I  think  you  said  tliat  a  couple  of  years  from  now 
you'ie  going  to  brag  that  you  just  had  a  great  innovation  by  releas- 
ing something  like  that  and  really  you  could  have  done' it  all  along. 
I  was  sympathetic  to  that  testimony,  but  nontheless  I  don't  call 
those  shots.  That's  for  somebody  else  to  call.  I  don't  think  the  presv 
ent  sybtem  is  cumbersome  for  college-bound  students.  I  saw  nothing 
in  there  that  was  either  hidden  or  unduly  bureaucratic  or  difficult 
for  a  student  to  complete.  It  is  different  and  I  think  it  would  be 
nice  if  we  had  less  of  that  difference  over  time  and  I  think  we  will. 

Mr.  Weiss.  I  think  that  given  the  interrelationship  between  ETS 
and  the  College  Entrance  Examination  Board,  it  is  probably  fair  to 
conclude -that  if  ETS  were  to  suggest  how  they  do  it  that  they 
might  at  least  get  a  sympathetic  hearing.  They  may  not  follow  it 
but  I  think  they  would  Jisten  to  you  sympathetically,  wouldn't  you 
think  so?  \  . 

Mr.  Anrig.  Let  me  put  it  this  way,  I  would  hope  so  and  I'll  cer- 
tainly make  that  as  a  result  of  our  discussion  here  today,  Mr. 
Chairman,  Til  bring  that  comment  back  to  them.  But  kt  me  assure 
you  the  sense  of  independence  between  the  College  Board  and  ETS 
is  almost  as  much  as  the  sense  of  independence  of  New  York  State 
versus  New  Jersey  State. 

Mr.  Weiss.  Well,  I  won't  comment  on  that.  Another  area  of  some 
dispute  and  I  think  you  addressed  it  to  some  extent,  is  that  weVe 
had  testimony  in  the  course  of  the  last  couple  of  years  from  schol- 
ars in  the  field  who  told  us  ,how  much  difficulty  they  had  in  getting 
both  in-house  reports  that.  ETS  had  worked  up  or  had  commis- 
sioned and/or  some  of  the  raw  data  on  which  those  reports  were 
based.  1 

Now,  you  were  suggesting^  think  in  the  course  of  your  testimony 
that  there  is  going  to  be  a  cl^ange  in  that  attitude.  Some  of  the  wit- 
nesses we  had  told  us  that, they  had  to  go  to  court  to  try  to  get 
some  of  that  material.  Question,  how  is  it  goirt^  to  work  in  the 
future?  1  j 

Mr.  Aniug.  Mr.  Chairman^  that  is  an  issue  whiqh  the  ETS  board 
of  trustees  had  assigned  to  its  Subcommittee  on  JResedrch  and  De- 
velopment because  it  wants  ,to  resolve  that  issue.  In  fact,  the  past 
history  has  been  that  as  far  as  I've  been  able  to  track  it  back  and  I 
admit  to  being  new  at  this  tjiat  requests  for  information  generally 
were  acceded  to  if  the  information  were  available.  Some  of  the  re- 
quests that  came  in  were  no|:  for  raw  data,  as  I  understand  it,  but 
for  data  that  was  worked,  that  is  to  request  that  something  be  done 
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about  the  data  and  then  fulfill  the  request.  Well,  that  has  costs 
connected  to  it.  VVe're  not  in  the  business  of  being  a  research  li- 
brar>  for  researchers  in  terms  of  asking  us  to  do  something  pro 
bono.  The  raw  data,  that  is  the  basic  data,  and  the  data  to  the 
extent  tha^we  have  worked  it  for  reasons  of  our  own  planning  and 
evaluation  will  be  put  orl  what  are  called  on  public-use  tapes. 
Those  public-use  tapes  will  be  available  either  through  ETS  or  if 
we  can  find  a  third-party  kind  of  way  of  doing  that  we're  looking  at 
that  issue  now,  and  that  will  be  available  at  cost  or  very  minimal 
kind  of  cost  for  whatever  that  service  is.  My  general  feeling  as  a 
rule  of  thumb  is  that  if  we  have  it  we  ought  to  let  others  have  it, 
and  that  the  burden  of  proof  on  why  not  to  do  so  should  fall  on  us 
internally  and  I've  asked  my  own  staff  to  approach  it  that  way.  If 
we've  got  it,  lets  put  it  out  there.  If  there's  some  sound  reason  pro- 
prietary in  nature  or  copyright  in  nature  or  certainly  on  the  issue 
of  individual  privacy  where  we  should  not  do  that,  then  let's  prove 
to  ourselves  why  that  should  be  the  prevailing  decision  on  that.  So 
our  basic  approach  will  be  that  way.  Those  recommendations  were 
voted  upon  yesterday  in  the  committee.  They'll  be  brought  to  the 
board  of  trustees  at  the  April  meeting  of  our  board  and  I  anticipate 
very  speedy  action  on  that  and  I  will  be  in  support  of  that  action. 

Mr.  Weiss.  The  other  area  you  touched  on  along  those  lines  deals 
with  test  taker  accessibility,  complaints,  grievances,  and  so  on.  Can 
you  spell  that  out?  You  said  that  you've  got  somebody  who's  been 
specially  assigned  to  deal  with  that  because  the  testimony  that 
we've  had  up  to  this  point  indicates  that  yes,  ultimately  if  some- 
body i^y  fortunate  enough  and  persevering  enough  that  maybe  they 
will  get  a  remedy.  But  there's  no  process  at  all  as  to  how  to  start. 
You  send  a  complaint  off  to  somebody  or  to  ETS  and  it's  just  as 
likely  to  be  totally  ignored  as  it  is  to  be  responded  to. 

How  are  complaints  either  as  to  scoring,  grievances  as  to  the  am- 
bience or  the  setting  in  which  the  examination  was  given,  or  what- 
ever the  various  complaints,  how  are  they  going  to  be  handled? 

Mr.  Anrig.  Mr.  Chairman,  first  of  all  the  position  that's  been  ad- 
vanced as  you've  just  described  it  is  not  either  true  or  fair.  I  be- 
lieve you've  been  down  at  ETS  and  visited  our  Ewing  site  where 
people  can  call  in  directly  and  they  get  the  answer  right  on  the 
phone.  What  s  my  score?  Was  it  sent  to  such-and-such  a  school? 
What  did  I  say  on  this  particular  part  of  the  questionnaire?  Those 
answers  are  given  by  phone,  calling  into  ETS,  no  matter  where  you 
call  in  it  gets  switched  over  to  that  Ewing  site,  and  there's  a  room 
full  of  people  doing  that.  I  think  you  saw  that  during  your  visit.  If 
you  didn't,  come  on  back  and  we'll  take  you  over  there  and  have 
you  see  it 

ETS  work3,very  hard  at  responding  to  those  student  complamts. 
The  problem  I  found  as  I  looked  into  that  very  same  question  be- 
cause I  feel  strongly  about  the  accessability  about  an  organization 
including  to  those  who  want  to  complain  about  it  was  that  a  stu- 
dent who  once  took  the  SAT  complained  one  time  one  way  and 
then  as  he  or  she  moves  to  graduate  school  for  the  graduate  record 
exam  there's  a  different  process,  and  if  they  want  to  ^o  to  law 
school  there's  a  different  process.  That's  confusing  to  our  consum- 
ers. So  what  I  want  to  have  is  one  way,  not  on  a  centralized  basis, 
but  one  procedure  that  if  you  want  to  complain  about  anything  at 


510 


506 


ETS  whether  in  a  regional  office  or  calling  into  the  main  switch- 
board or  writing  me,  that  it  will  be  handled  in  the  uniform  way  in 
terms  of  being  received,  logged,  assigned  to  a  person,  resolved,  and 
back  to  the  complainant  withm  a  period  of  time  that  we  set  in  ad- 
vance. So  that's  something  we're  going  to  have  in  place.  I  put  the 
student  concerns  coordinator  in  charge  of  getting  that  in  ^lace.  We 
will  have  it, fully  operational  by  January  1,  and  I  think  it  s  a  prob- 
lem I've  identified  and  we  can  resolve  rather  quickly. 

Mr.  Weiss.  We  had  a  witness  who  took  the  examination  and  the 
monitor  concluded,  surmised,  perhaps  suspicions  vibrations,  that 
tlfe  test  taker  had  done  something  improper  or  unethical.  The  mon- 
itor made  that  notation,  and  the  student  was  then  given  a  failing 
grade,  or  low  grade,  or  no  grade.  I  don't  recall  specifically  on  that. 
A  teacher-instructor  who  knew  that  student  very  well  spoke  to  the 
student,  in  fact  then  spoke  to  the  monitor,  and  obviously  there  was 
nothing  objective  about  the  conclusion  or  determination  of  that 
monitor.  They  had  not,  although  at  that  point  it  was  over  1-year- 
old,  they  had  not  been  able  to  arouse  the  attention  of  anybody  at 
ETS  to  the  injustice  that  seemingly  was  done  just  as  a  matter  of 
process.  Never  mind  the  merits  of  the  case,  I  don't  know  what  the 
merits  are  as  far  as  the  process  was  concerned,  and  I  wonder  what 
youVe  doing  or  what  your  thoughts  are  about  having  a  formalized 
grievance  procedure  so  that  you  don't  have  some  personnel  in 
either  ETS  or  the  college  entrance  examination  board  or  whoever 
making  what  in  essense  are  life  and  death  decisions  without  the 
right  of  due  process. 

Mr.  Anrig.  Mr.  Chairman,  a  former  Governor  of  New  York  State 
used  to  start  off  his  speeches  by  saying,  "Let's  get  the  record 
straight,"  Al  Smith.  Let's  get  the  record  straight  on  this  issue.  I 
used  to  be  a  principal  and  every  time  a  student  was  sent  to  my 
office  by  a  teacher  for  causing  trouble  in  the  classroom  when  I 
asked  that  student  what  happened  I  got  one  story.  When  I  found 
out  what  happened  from  others  involved  there  was  a  different  per- 
spective on  it.  One  of  the  problems  of  a  hearing  process  such  as 
you're  in  in  this  situation  is  that  a  person  comes  before  you  and 
makes  an  allegation.  If  there's  not  the  opportunity  to  rebut  that  al- 
legation on  the  facts  of  that,  then  it  stands  on  the  record. 

Let  me  talk  about  our  procedures  because  I  can't  answer  that 
particular  case,  I  wasn't  here  at  the  time.  But  our  procedures  are 
such  that  if  a  question  of  test  security  is  what  the  policy  that  apply 
here  is  raised,  that  is  sent  to  a  unit  which  deals  with  that  very 
issue  and  specializes  in  it.  No  single  piece  of  evidence  alone  is 
enough  to  establish  that  there's  been  a  breach  of  security.  There 
must  be  a  combination  of  evidence  which  is  compelling,  and  that 
evidence  and  those  criteria  are  spelled  out  and  published  and  I'd  be 
glad  to  submit  them  for  the  record.  There  is  an  appeal  procedure 
from  that.  There  is  nobody  that  is  given  a  failing  grade.  They 
simply  are  not  given  a  score  and  they're  notified  that  they  will  not 
receive  the  score.  They  may  appeal,  or  they  may  take  the  test  o\er. 
If  they  take  the  test  over  I  believe  if  I  remember  correctly  that's 
done  without  charge.  So  the  opportunity  is  given  to  take  the  test 
again  without  charge  and  also  there  is  an  appeal  route.  The  reason 
I  know  this  is  I've  already  received  an  appeal  from  that  procedure 
and  that  appeal  eventually  comes  to  the  president  of  the  organiza- 
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tion.  There's  a  very  careful  process.  When  I  first  heard  that  J>y 
computer  scanning  we  identified  these  problems  I  was  scared  to 
death.  As  I  got  mto  the  extraordinary  combination  of  circum- 
stances that  must  be  present  for  a  test  security  allegation  to  be 
made,  I  didn't  have  that  concern  because  there  must  be  established 
clear  patterns  beyond  the  individual  instance  of  the  test  supervisor 
in  the  center.  In  other  words  they  would  have  looked  also  at  the 
pattern  of  test  answers.  And  if  you  find  similarity  to  the  person  sit- 
ting next  to  them,  that  kind  of  thing,  then  you  do  begin  to  get  into 
evidence. 

So  the  problem  you  had  in  that  instance,  I  believe,  was  the  stu- 
dent coming  into  the  principal's  office  and  telling  his  or  her  side  of 
what  went  on  back  in  the  classroom.  In  fact,  the  policy  of  ETS  in 
that  area  are  in  print,  are  very  clear,  do  include  an  appeals  proce- 
dure, and  I'd  be  glad  to  submit  that  for  the  record. 

Mr.  Weiss.  How  long  has  that  been  in  place? 

Mr.  Solomon.  Several  years. 

Mr.  Anrig.  Mr.  Robert  Solomon,  the  executive  vice  president  of 
Educational  Testing  Service  says  it's  for  several  years. 

Mr.  Weiss.  There's  been  no  change  in  th^t  process  for  the  last 
few  years? 

Mr.  Anrig.  There  has  been  change,  but  I'm  not  familiar  with  it. 

Mr.  Weiss.  Would  you  outline  the  change  for  me? 

Mr.  Anrig.  Pardon  me? 

Mr.  Weiss.  Would  Mr.  Solomon? 

Mr.  Anrig.  With  the  Chair's  position  I'll  call  on  Mr.  Solomon. 
Mr.  Weiss.  Outline  what  changes  have  taken  place  in.  the  last 
couple  of  years. 

Mr.  Solomon.  Mr.  Chairman,  the  more  recent  change  is  that  in 
two  programs,  first  with  the  law  school  admission  test  and  more  re- 
cently with  the  college  board  scholastic  aptitude  test,  the  appeal 
procedure,  now  provides  for  going  if  the  student  requests  to  arbitra- 
tion proviaed  by  the  American  Arbitration  Association. 

Mr.  Weiss.  When  was  that? 

Mr.  Solomon.  The  law  school  instituted  that  procedure  at  least  5 
or  6  years  ago,  I  don't  recall  exactly;  and  the  college  board  institut- 
ed that  procedure  this  past  year.  The  other  programs  for  which  we 
administer  tests  are  also  considering  the  arbitration  appeal  route 
as  well.  Previous  to  that  was  an  appeal  procedure  but  the  outside 
arbitrator  was  not  part  of  that  appeal  procedure. 

Mr.  Weiss.  Thank  you  very  much.  So  no  longer  will  ETS  or 
CEEB  be  in  fact  the  judge,  jury,  prosecutor,  the  whole  works  in  the 
situation. 

Mr.  SolOmon.  We  try  never  to  be  that,  sir,  but  we  have  included 
"   the  arbitration  procedure  now. 

Mr.  Weiss.  All  right,  thank  you  very  much.  Then,  I  guess,  the 
last  question  I  have  is  a  factual  one.  How  many  ETS  sponsored 
tests  are  given  annually? 

Mr.  Anrig.  In  terms  of  numbers  or  the  titles  of  tests? 

Mr^  Weiss.  No,  numbers.  How  many  SAT's  for  example? 

Mr.  Anrig.  With  the  Chair's  permission,  I'll  submit  that  for  the 
record.  I  don't  know  that  offhand.  It's  somewhere  around  1.2  mil- 
lion. I  can  tell  you  what  it  is,  I've  got  a  document  here  for  1981 
which-is-not  quite  the  current  year,  but  the  admissions  testing  pro- 
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gram,  the  SAT  goes  to  1,255,000  students.  The  total  admissions  test- 
ing program,  which  would  include  the  achievement  test,  the  SAT, 
is  1,527,000.  That  was  for  the  years  1979-80. 

*Mr.  Weiss.  Thank  you  very  much.  Would  you  make  sure  that 
whatever  additional  materials  you  will  be  submitting  are  submitted 
within  10  days  so  the  record  can  be  closed  within  a  reasonable 
period  of  time? 

[The  information  referred  to  follows:] 
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Samuel  Messick  / 
) 

Educational  Testing  Service 
ABSTRACT 

Multiple  sources  of  controversy  over  coaching  for  scholastic  aptitude 
tests  are  addressed*    These  include  disputes  over  the  meaning  of  scholastic 
aptitude,  over  the  meaning  of  coaching,  over  the  nature  of  the  fundamental 
research  questions,  over  the  adequacy  of  the  empirical  evidence  for  coaching 
effectiveness,  over  the  possible  implications  of  effective  coaching  for  student 
perfomance  and  for  test  validity,  and  over  the  consequent  ethical  imperatives 
for  educational  and  testing  practice*    Three  possible  outcomes  of  coaching 
having  different  implications  for  college  performance  are  discussed  —  genuine 
improvements  in  the  abilities  measured  by  the  test  resulting  in  coimensurate 
increases  in  test  scores;  enhanced  test-taking  sophistication  (Item  familiar** 
ization,  guessing,  pacing)  resulting  in  increased  test  scores  that  are  more 
accurate  assessments  of  ability;  and,  heightened  test-taking  artifice  (straC^ 
agems  and  answer-selection  tricks)  resulting  in  increased  test  scores  that  are 
inaccurately  high  assessments  of  ability*    The  first  two  if  realized  would  be 
beneficial  from  the  standpoint  of  both  test  validity  and  student  performance, 
while  the  third  is  only  incidental  with  professionally  made  test^*    A  framework 
for  gauging  the  practical  utility  of  coaching  effects  is  presented  and  several 
ostensible  yardsticks  of  coaching  impact  are  discounted  as  largely  irrelevant* 
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Itsues,  of  Ef fectlveneif,  and  Equity  in  the  Coaching  Controversy: 
Impllcatl&;i8''tor  Ed^atlonal  and  Testing  Practice^ 

'  Samuel  Kesslck 

Educational  Testing  Service  * 

The  controversy  over  whether  or  not  coaching  works  for  tests  of 
scholastic  aptitude  such  as  the  College  Board  SAT  Is  in  actuality  la 
multitude  of  controversies  —  over  the  9»eanlng  of  scholastic  aptitude, 
over  the  meaning  of  coaching,  over  the  nature  of  the  fundamental  research 
questions,  over  the  adequacy  of  the  empirical  evidence  for  coaching 
effectiveness,  over  the  possible  Implications  of  effective  coaching  for 
student  performance  .and  for  test  validity,  and  over  the  consequent 
ethical  imperatives  for  educational  and  testing  practice.    Since  miscon- 
ceptions and'ml8un4er8tandings  abound  on  each  and  every  one  of  these 
points,  discussions  of  the  coachablllty  of  scholastic  aptitude  tests 
readily  reduce  to  rhetorical  and  political  posturing  when  what  is  needed 
is  nore  extensive  rational  analysis  and  scientific  appraisal  of  research 
evidence.    And  as* we  shall  see,  since  much  of  the  controversy  reflects 
poorly  articulated  ethical  stances,  what  Is  also  needed  is  a  clearer 
conception  of  the  values  underlying  rival  ethical  Imperatives. 

In  any  event.  It  is  not  so  much  a  question  of  eschewing  rhetoric, 
because  In  essence  test  "validation  is  a  rhetorical  process"  (Cronbach, 
1980,  p.  102).    Rather,  It  Is  a  question  of  ensuring  that  the  rhetorical 
arguments  reflect  facts  and  rationales  as  well  as  values  and  beliefs. 
Granted  that  "empirical  evidence,  task  analysis,  formal  assumptions, 
everyday  beliefs,  and  valuations  are  Intertwined  In -the  argucrenC  that 
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supports  «  teat  use**  (Cronbacb,  1980,  p*  101;  Messick,  1980b,  1981b), 
nonetheless  the  role  of  evidence  should  be  central  and  directive  in 
teBpering  the  trade-offs  eabodied  in  our  current  best  scientific  judgment 
about  a  value-laden  issue  such  as  coaching.    To  be  sure,  since  it  rarely 
completely  dispels  divergent  interpretations,  evidence  —  thatjis,  "both 
data,  eft  facts,  and  the  rationale  or  arguaents  that  cenent  those  facts 
into  a  justification  of .inferences"  (Messick,  1980b,  p.  1014)  —  nay 
not  fully  deteriBine  the  outcome  or  conclusion*    Evidence  does  serve, 
however,  to  limit  the  range  of  plausible  alternatives*    In  an  attempt  to 
reinforce  the  directive  role  of  evidence  in  current  arguments  over 
coaching,  the  present  article  sunun^rizes  research  findings  from  studies 
of^'coaching  for  the  SAT  in  the  context  of  a  conceptual  analysis  of  the 
meaning  and  likely  import  of  the  coacfiability  of  such  ability  tests*  The 
intention  is  to  illuminate  if  not  resolve,  in  the  light  of  recent -research 
results,  the/central  issues  of  meaning^^  effectiveness,  and  equity  of 
access  inhei/ent  in  the  coacjr^ng  controversy* 

Controversies  Over  Meaning 

As  so/often  happfths  In  continuing  controversies,  the  key  terms  —  in 
t^jiis  case  rcoaching-  and  "scholastic  aptitude"  —  take  on  different 
meanings  for  different  proponents*    Multiple  meanings  of  test  constructs 
often  lead  to  surplus  or  excess  meanings  that^o  beyond  defensible,  score 
interpretations,  and  "excess  meanings  lead  t<i  misuses  and  misinterpretations 
of  tests'/  (Anastasi,  1980,  p.  1).  .Imputed  meanings  for  scholastic 
aptitude  I  range  all  the  way  from  "fixed  endowment,"  which  imj)lies^hat 
valid  scholastic  aptitude  tests  should  be  essentially  uncoachable,  to 
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-direct  learning  outco.e,"  which  li»pUe«  that  they  ihould  be  «i  reiponiive 
to  coaching  or  instruction  ai  any  other  oeaiure  of  educational  achievement 
such  as  tests  of  history  or  biolo^gy.    But  scholastic  aptitude  as  measured 
by  the  SA-r  falls  at  nei^  of  .these  two  extremes:    The  SAT  measures 
developed  -  or  more  precisely,  developing  -  abilities  which  are  by  no 
means  fixed  but  which  by  the  senior  year  of  high  school  are  relatively 
^stable  In  their  development.    This  Implies  that  the  SAT  may  indeed  be 
responsive  to  coaching  or  instruction  to  some  degree,  but  It  should  not 
be  nearly.as  responsive  as  the  typical  educational  achievement  test  of 
subject-matter  attainment. 

Similarly,  Imputed  meanings  for  coaching  range  all  thr  way  from 
short-term  cramc^lng  and  simple  practice  on  sample  items  at  one  extreme  to_ 
long-term  instruction  aimed  at  knowledge  and  skill  development  at  the 
other.  ^It  is  here  maintained  that  ,any  intervention  program  designed 
to  Improve  SAT  scores  may  be  considered  an  instance  of  coaching,  wherever 
It  may  fall  along  this  continuum  of  meaning,  but  that  such  "coaching- 
programs  should  not  be  averaged  together  in  a  single  conglomerate  category 
because  different  program  characteristics,  such  as  duration  or  curriculum 
emphasis  on  skill  development,  may  be  associated  with  dlf ferentiaKSAT 
score  effects  (Messlck,  1930a). 

Scholastic  Aptitude  as  Developed  Ability 

One  important  source  of  controversy  over  the  meaning  of  scholastic 
aptitude  derives  from  differences  in  the  popular  and  Lechni  .1  uses  of 
trte  term  ••apcltude.'\  The  dictionary  (Webster.  1969)  denotes  aptitude 
as  -capacity  for  learning. .. (or)  natural  ability"  (p.  A4).  "a  natural 
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liking  for  soae  activity  and  the  likelihood  of  aucceas  in  it"  (p.  352), 
In  the  loose  language  of  popular  usage »  it  seems  only  a  small  slip  to 

move  from  "natural  ability**  to  ''innate  ability**  and  from  there  to  **fixed 

0  -  - 

ability***    !lut  it  is  a  slip  nonetheless  and»  from  the  standpoint  of  its 
putative  implications  for  aptituJe  measurement^  an  enormous  one.    For  if 
aptitude  constitutes  fixed  ability »  then  valid  aptitude  tests  should 
preaumablynot  be  coachable.    Any  such  tests  that  in  fact  prove  to 
be  coachable  are  not  valid  measures  of  aptitude  by  this  chain  of  reasonings 
,but  rather"  assess  general  educational  achievement;  they  should  therefore 
be  treated  in  selection  decisions  on  the  same  basis  as  other  aeasures  of 
achievcDiint •    If  purported  aptitude  tests  are  interpreted  as  being  aore 
fundamental  or  more  instruaental  in  predicting  future  success  than  are 
typical  achievement  tests  and  if  those  so-called  aptitude  tests  are 
indeed  coachable »  then  the  Issue  cooes  to  be  cast  in  terms  of  fair  test 
use;    By  this  Iin«  of  argument »  coachabX^  aptitude  tests  are  ipso  facto 
unfair  to  students  not  having  access  to  high  quality  coaching  programs. 
But  the  equity  issue  is  much  more  complicated  than  ^lis  even  granting  the 
foregoing  simplistic  premises »  because  coaching  Is  a  form  of  instruction 
arid  coachable  aptitude  tests  are  said  to  be  akin  to  achievement  tests , 
which  are  expected  to  be  responsive  to  instruction  —  in  this  involuted 
sense  of  unfairness  whtsre  tests  bear  the  burden  for  societal  inequities , 

educational  achievement  tests  tiave  always  been  unfair  to  students  not 

i 

having  access  td  high  quality  Instructional  programs. 

In  contrast  to  nontechnical  dictionaries »  a  compendium  of  psychologi- 


cal terms  (English  &  English,  1958)  asserts  that  "APTITUDE  (which  formerly 
ctirried  Implications  of  innateness)  has  now  been  specialized  in  technical 
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writing  to  refer  to  the  fact  that  the  Individual  can  be  brought  by  a 
specified  amount  of  training  to  a  specified  level  of  ability,  either 
general  or  special"  (p.  1).    Furthermore,  "an  APTITUDE  TEST  Is  merely  one 
fora  of  ability  test,.. .a  measure  of  present  characteristics  that  has 
been  found  to  be  predictive  of  capacity  to  learn'*  (p.  39)  or,  more 
generally,  predictive  of  future  performance.    Along  these  same  lines,  two 
closely  related  but  distinct  features  of  aptitude  aie  noted  by  Cronbach 
and  Snow  (1977):    Generally  speaking,  aptitude  is  "any  characteristic  of  a 
person  that  forecasts  his  probability  of  success  under  a  given  treatment** 
(p.  6)  —  that  is,  aptitude  is  a  forecaster  of  learning  or  performance; 
speaking  "psychologically,  aptitude  Is  whatever  makes  a  person  ready  to 
learn  rapidly  In  a  particular  situation"  (p.  107)  —  that  is,  aptitude  is 
a  facilitator  of  learning  or  performance.    Both  of  these  connotations  are 
Inherent  in  the  typical  rationales  for  interpretation  and  use  of  scholastic 
aptitude  tests. 

Scholastic  aptitude  tests  such  as  the  SAT  are  not  direct  measures  of 
Innate  InteUigence  or  fixed  endowment,  nor  are  they  measures  of  subject- 
matter  attainment  as  in  the  usual  educational  achievement  test.  The 
SAT  was  explicitly  designed  to  differ  from  achievement  tests  in  subject- 
matter  fields  in  the  sense  that  its  content,  being  derived  from  a  wide 
\arlSh  of  substantive  areas,  is  not  tied  to  a  particular  field  of 
study',  curriculum,  or  program.    The  SAT  measures  developed  abilities 
of  verbal  and  mathematical  reasoning  and  comprehension  that  are  acquired 
gradually  over  many  years  of  experience  and  use  in  both  school  and 
nonschool  settings,  being  exercised  'to  some  degree  in  all  subject-matter 
areas  at  all  levels  of  schooling  as  well  as  in  response  to  real-life 
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situations.    According  to  Carroll  (1978),  "to  the  extent  that  tests  of 
the  SAT  type  are  valid  In  predicting  college  or  graduate-school  success, 
It  i^s  undoubtedly  because  they  provide  a  good  Indication  of  the  extent  to 


_ -Van  exhibit  through  their  pecforoance  on  a  test,  certain  genef^^l^ntellec- 
tual  skills  in  handling  verbal,  quantitative^  and  symbolic  informatlo^ 
that  are  contributory  or  even  necessary  to  high-level  success  in  academic 
studies"  (p,  78)»    In  other  words,  scholastic  aptitude  tests  are  general 
forecasters  of  academic  learning  and  perforaaoce  because  they  measure 
general  facilitators  of  academic  learning  and  performance* 

A  critical  feature  of  this  technical  formulation  of  the  construct 
of  aptitude  is  that  scholastic  aptitudes  are  viewed  as  developed  abilities 
not  fixed  abilities,  so  one  might  expect  high  quality  Instruction  over  a9 
extended  period  of  time  lo  liaprove  them.     But  since  these  general  intellec 
tive  skills  develop  gradually  over  a  number  oit  years  as  a  result  of 
-everyday  experience  as  well  as  formal  education,  they  may  b6  relatively 
difficult  to  enhance  markedly  in  late  adolescence  through  brief  courses 
of  intervention.    This  is  in  contradistinction,  to  the  specific  knowledge 
and  skills  tapped  by  typical  educational  achievement  tests,  which  should 
be  relatively  responsive  to  high  quality  instruction  even  in  the  short 
run.    As  Carroll  (1978)  put  it,  "a  low  score,  on. ..a  (scholastic  aptitude] 
test  is  no  guarantee  that  the  Individual  cannot  acquire,  during  a  subse- 
quent  period,  the  skills  and  abilities  that  tfre  tested,  but  it  is  an 
indication,,  at  least,  of  the  probability  that  the  individual  could 
acquire  these  skills  and  abilities,  if  at  all,  only  with  much  expense  of 
time  and  effort  and  with  careful  instruction"  (p.  78). 


] — -which  applicants  have  at  the  time  of  testing  developed  or  acquired,  and 
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Repeatedly  throughout  thli  diicusslon,  contrasts  have  been  drawn 
between  scholastic  ability  tests  on  the  one  hand  and  educational  achieve- 
ment tests  on  Che  other.    In  Idealized  form  these  two  types  of  tests 
define  opposite  poles  of  a  continuum,  with  most  actual  educational  tests 
—  by  virtue  of  sharing  various  features  of  each  pole  —  falling  somewhere 
m  the  intemcdiate  range.    For  example,  scholastic  ability  tests  measure 
general  Intellective  skills  such  as  verbal  reasoning  by  means  of  diverse 
Tontent  drawn  from  a  multiplicity  of  topical  areas,  whereas  educational 
Achievement  tests  measure  specialized  knowlege  and  skill  using  relatively 
circutascrlbed  content  drawn  from  a  particular  subject-matter  field.  Yet 
an  achievement  test  in  political  science,  say,  might  Include  Items  to 
assess  skill  In  reasoning  with  political  concepts;  to  the  extent  that 
ftch  specific  reasoning  also  reflects  more  general  reasoning  abilities, 
the  test  might  prove  to  be  more  broadly  predictive  beyond  political 
science  to  related  fields. 

In  oany  ways,  an  educational  achievement  test  is  akin  to  a  job-sample 
test  —  that  is,  a  test  in  which  the  Items  present  task  and  stimulus 
conditions  in  roughly  the  same  form  and  in  the  same  relationships  as 
they  appear  on  the  job  (or  In  the  curriculum),  thereby  eliciting  responses 
representative  of  behaviors  similar  to  those  on  the  job  (or  In  the  course 
of  academic  learning).    Scholastic  ability  tests.  In  contrast,  measure 
reasoning  and  comprehension  skills  that  contribute  to  successful  performance 
in  a  number  of  Important  academic  jobs.    Although  such  ability  tests  might 
not  be  as  predictive  as  the  job-sample  test  for  the  specific  job  (or  field  of 
academic  learning),  they  arc  more  generally  predictive  across  a  variety 
ot  jobs  or  fields  calling  for  those  reasoning -skills  (Messlck,  1981a). 
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Anong  other  things^  che  two  types  of  tests  differ  in  what  Snow  (1974;  , 
Coan,  1964)  calls  referent  generality  —  that  is,  in  the  breadth  or 


respectively  neasured  constructs  of  educational  achievement  and  scholastic 
ability.    One  Implication  of  this  difference  in  referent  generality, 
according  to  Snow  (1980),  is  that  "if  one  chooses  to  work  with  a  relatively 
specif icJ^Vel'^ar'achievement  measurement,  the  best  predictor. . .will  be 
elevant  prior  achievement,  [and]  next  best  will  be  general  scholastic 
ability... If  one  chooses  to  work  at  a  more  general  level  of  achievement 
construct,  [such  as  college  grade-point  average,]  the  best .. .measures  for 
prediction  purposes  will  b^  general  scholastic  ability,  followed  by 
specific  prior  achievement  tests"  (Snow,  1980,  p.  46). 

Coaching  as  Instruction,  Demonstration,  and  Practice 

Just  as  there ^is  a  progression  or  ordering  of  educational  tests 
ranging  from  measures  of  scholastic  abilities  at  one  pole  to  measures 
of  subject-matter  attainment  at  the  other,  so  there  is  a  progression 
of  types  of  preparation  for  taking  examinations  ranging  from  Vactice 
on  sample  tests  at  one  extreme  to  intensive  instruction  aimed  at  developing 
knowledge  and  skill  at  the  other.    lUs .oricaliy ,  coaching  for  scholastic 
ability  tests  has  tended  to  fall  toward  the  practice  side  of  this  continuum, 
eaphasizing  test  familiarization  and  test-taking  strategies,  while 
coaching  for  achievement  tests  has  tended  to  fall  toward  the  instructional 
side,  emphasizing  directed  study  and  review  of  subject-matter  content. 
This  wide  airay  of  possible  forms  of  coaching  has  led  to  heated  controversy 
over  its  meaning,  because  different  parties  often  selectively  restrict 


variety  of  performances  presumed  to  be  covered  or  interpreted  by  the 
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their  referents  to  different  portions  of  the  continuum.    At  the  sane 
time,  the  full  range  of  coaching  possibilities  has  come  to  be  applied  to 
any  type  of  educational  test,  thereby  making  preferential  usage  appear  not 
only  restrictive  but  arbitrary.    For  example,  In  regard  to  coaching  for 
the  SAT,  some  writers  have^^Umlted  their  use  of  the  term  to  short-term 
drill,  test  practice,  and  test-wlseness  training  (cf.  Pike,  1978), 
whereas  others  Include  under  the  same  rubric  virtually  full-time  Instruction, 
at  specialized  preparatory  schools  for  periods  of  six  months  or  more  (cf. 
Slack  &  Porter,  1980).    Adlierents  of  the  former  position  underscore  a 
distinction  between  coaching  and  Instruction,  whereas  adherents  of  the 
latter  position  view  such  differences  as  lonaterlal.  Implying  that 
anything  resulting  In  improved  test  scores  testifies  to  coachabUlty. 

In  an  eftort  to  avoid  disputes  over  what  Is  or  is  not  coaching, 
we  will  here  accept  as  coaching  any  Intervention  procedure  specifically 
undertaken  to  Improve  test  scores,  whether  by  improving  the  skills 
measured  by  the  test  or  by  impiovlng  the  skills  for  taking  the  test,  or 
both.    Thus,  for  our  purposes  coaching  may  fall  nuywhere  in  the  broad 
range  bounded  by  the  two  extremes  of  practice  and  instruction,  embracing 
any  combination  of  test  fanlUarization,  drlU-and-practlce  with  feedback, 
motivational  enhancement,  training  in  strategies  for  specific  item 
formats  and  for  general  tes't  taking  (Including  advice  on  pacing,  guessing, 
and  managing  test  anxiety),  subject-matter  ttiltlon  and  review,  and 
skiU-developoent  exercises.    In  this  view,  coaching  for  educational 
tests  Is  any  procedure  specif i^ially  oriented  toward  the  Improvement  of 
test  scores  as  distinct  from  nontest-specif Ic  learning  experiences  and 
cognitive  growth  ~  which  nay  also  result  in  Improved  test  scores.  This 
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broadly  inclusive  stance  is  consistent  with  the  dictionary  definition  of 
the  word  coaching,  which  is  **to  train  Intensively  by  instruction,  demonstra- 
tion, and  practice**  (Webster,  1969,  p.  158). 


Even  if  we  were  to  have  agreement  on  the  meaning  of  scholastic 
aptitude  as  developed  ability  and  on  the  meaning  of  coaching  as  any 
intervention  procedure  for  improving  test  scorei>,  there  would  still 
be  ample  controversy  over  the  effectiveness  of  coaching  and,  indeed, 
over  the  way  in  which  the  question  of  effectiveness  is  posed.  As 
Kaplan  (196A)  maintains,  **How  we  put  the  question  reflects  our  values 
on  the  one  hand,  and  on  the  other  hand  helps  determine  the  answer  we 
get"  (p.  385).    The  challenge  is  to  have  sufficient  recourse  to  relevant 
research  evidence  so  that  our  values  do  not  solely  determine  the  answer 
we  get.    The  problem  is  that  research  evidence  is  selectively  sought  in 
the  context  of  the  question  posed  so  that  facts  and  values  are  intimately 
intertwined  in  our  efforts  at  interpretation.    One  safeguard  is  to 
attempt  to  take  values  explicitly  into  account  throughout  the  research 
endeavor.    Another  is  to  pose  the  research  question  in  alternative  ways 
so  that  data  are  collected  and  analyzed  from  alternative  perspectives  — 
in  the  hope  that  convergence  of  evidence  would  lead  to  consensus  of 
interpretation  and  that  divergence  of  evidence  would  lead  to  exposure  and 
examination  of  value  differences  (Churchman,  1971,  1979;  Kessick,  1975, 
1980b). 

Yes-No  Questions  Versus  Questions  of  Degree 

Studies  of  the  effectiveness  of  coaching  for  the  SAT  have  consistently 


Controversies  Over  Effectiveness 


526 


522 


poted  the  reaearch  quettlon  Jin  categorlctl  form,  teeklng  to  ascertain  >n 
general  teraa  whether  or  not  coaching  works  and,  tf  It  doei,  to  determine 
the  overall  aiiount  of  acore  Increment  attainable  through  coaching  (Messlck. 
1980a),    Those  viewing  the  coachablllty  of  scholastic  aptitude  tests  as 
prloirlly  an  Issue  of  fair  testing  practice  tend  to  phrase  the  question 
in  this  way.      For  them,  coachablllty  Implies  unfairness  If  student 
access  to  effective  coaching  Is  not  equitable  or,  at  the  least.  If  ^ 
examinee*  are  not  uniformly  apprised  of  the  kinds  of  special  preparation 
they  should  undertake.    However,  If  coachablllty  Is  viewed  not  only  as  an 
issue  of  fair  testing  practice  but  also  as  an  Issue  in  the  construct 
validity  of  scholastic  aptitude  tests  as  measures  of  developing  abilities, 
then  the  research  question  Is  more  aptly  posed  as  one  of  degree:     It  Is 
not  just  a  question  of  whether  coachlrig  works  or  not,  but  of  how  much 
student  time  and  effort  devoted  to  what  Kinds  of  coaching  experiences 
yield  what  level  of  score  Improvements.    From  this  standpoint,  It  matters 
to  what  degree  coaching  Is  effective  and  by  what  means,  for  although 
developed  scholastic  abilities  may  be  further  developed  by  relatively 
long-term  programs  emphasizing  comprehension  and  reasoning  skills,  they 
should  not  be  readily  Improved  by  short-tertn  programs  stressing  test- 
taking  strategies  or  drlll-and-practlce.    This  Is  not  to  say,  however, 
that  progr<»as  of  the  latter  type  might  not  lead  to  some  score  Improvement 
as  a  consequence  of  enhanced  test  wlseness  or  reduced  anxiety  about  what 
to  expect. 

The  first  viewpoint,  by  virtue  of  focussing  slmpllstlcally  on 
whether  coaching  works  or  not,  leads  to  a  simple  tallying  of  statistically 
significant  and  nonsignificant  coaching  effects  or  to  an  averaging 
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of  attained  coaching  effect*  «cro»»  available  atudles  (Slack  &  Porter, 
1980)*    The  aecond  viewpoint,  by  virtue  of  focussing  on  the  relationship 
between  atudent  tl«e  and  effort  devoted  to  coaching  end  the  size  ot 
associated  score  effects,  leads  to  the  calculation  of  correlation 
coefficients  across  coaching  programs  between  estimated  coaching  effects 
and  such  Indices  of  student  effort  as  program  contact  time  (Messlck  & 
Jongeblut,  1981),    Eacn  of  these  viewpoints  thus  provides  a  distinctive 
organizing  framework  for  summarizing  the  research  findings  from  studies 
of  coaching  for  the  SAT,  which  Is  our  next  topic  for  detailed  examina- 
tion.   One  might  hope  that  such  a  juxtaposition  of  alternative  ways 
of  Integrating  research  findings  would  provide  some  closure  on  the 
Issue  of  coaching  effectiveness  —  and  It  does  —  but  the  situation 
Is  beclouded  by  a  variety  of  flaws  In  experimental  design  that  variously 

i 

distort  the  extant  studies.    This  leads  to  yet  another  controversy,  this 
time  over  the  adequacy  of  the  empirical  evidence  for  coaching  effectiveness. 

Categorical  Answers  Versus  Relational  Answers 

Whether  posed  In  categorical  or  In  relational  terms,  the  question 
of  coaching  effectiveness  must  perforce  be  answered  In  comparative 
terms  by  appraising  obtained  score  gains  associated  with  coaching 
against  the  baseline  of  experiential  growth  In  ability  that  may  occur 
over  the  same  time  period  In  the  absence  of  any  coaching  program. 
Since  developed  scholastic  abilities  continue  to  develop  during  the 
high  school  years  In  response  to  both  formal  schooling  and  nonschool 
experiences,  any  scorn  Increases  exhibited  by  groups  of  coached  students 
need  to  be  evaluated  in  comparison  with  the  score  gains  of  equivalent 
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control -groups- of  uncoached-itudent*.    A  aajor  source  of  discord  in 
suoa»Ari2ing  the  inport  of  research  results  on  coaching  is  that  several  of 
the  studies  either  utilized  no  control  group  at  all  or  else  eaplpyed 
control  groups  tnat  were  seriously  nonequivalent  to  the  treatment  groups 
receiving  coaching,  thereby  rendering  highly  questionable  both  the  size 
and  the  meaning  of  obtained  score  effects.    This  is  particularly  unfortu- 
nate because  those  studies  having  no  control  groups  at  all  happened  also 
to  exhibit  the  largest  score  Increases  of  any  studies  to  date  and  to 
entail  coaching  programs  that  were  by  far  the  longest  in  duration  (Pallone, 
1961;  Marron,  1965;  Coffman  i  Parry,  1967),  while  among  those  studies 
having  patently  noncomparable  control  groups  is  one  of  the  largest 
and  most  ambitious  coaching  investigations  yetj  attempted  (Federal 
Trade  Commission,  1979). 

In  the  former  case,  there  is  no  really  satisfactory  way  in  the 
absence  -of  control  groups  to,  adjust,  the  obtained  score  increases  for 
expected  experiential  growth  in  ability,  although)  various  adjustments 
based  on  comparisons  with  national  norm  groups  or  with  control  groups 
from  fimilar  studies  have  been  attempted  with  debatable  credibility 
(Pike,  1978;  Slack  &  Porter,  1980;  Messick  &  Jungeblut,  1981).    In  the 
latter  case  of  nonequivalent  control  groups,  regression  techniques  may  be 
used  to  control  statistically  for  those  group  differences  for  which  some 
index  or  measure  is  available,  but  there  is  no  way  of  adjusting  tor  any 
unmeasured  personal  characteristics  that  might  have  influenced  both  the 
student's  participation  in  the  coaching  program  and  that  program's 
apparent  effectiveness.  / 

This  is  the  problem  of  selection  bias,  which  is  a  pervasive  one  in 
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•tudlcs  of  coaching.     It  arise*  whenever  systematic  differences  that  are 
correlated  with  the  dependent  variable  —  in  this  case  with  SAT  performance  — 
exist  between  the  experime^ntal  and  control  samples.    Systematic  differences 
resulting  from  student  choice  of  the  treatment  rather  than  from  experimenter 
choice. of  the  student  are  called  self-selection  bias.    To  be  sure,  those 
group  differences  for  which  reliable  measures  are  available  may  be 
effectively  adjusted  statistically  using  analysis-of-covariarttce  techniques, 
but  to  the  extent  that  unmeasured  group  differences  are  also  likely, 
residual  selection  bias  remains  and  the  results  are  invariably  equivocal. 
For  example,  in  the  Federal  Trade  Commission  .(FTC)  study  (1979),  the 
leached  group  differed  dramatically  from  the  uncoached  group  on  a  number 
of  >^dices  related  to  SAT  performance,  such  as  having  higher  school 
grades^  and  parental  income,  making  it  likely  that  they  also  differed  on 
equally  t)ertincnC  unmeasured  factors  such  as  motivation  and  parental 
education.  ^ Under  these  circumstances,  the  obtained  score  effects  cannot 
be  unequivocally  attributed  to  the  coaching  treatment  and  must  be  interpreted 
as  combined  coaching/ self-selection  effects  (Messick,  1980a;  Stroud,.  1980). 

The  standard  prescription  for  avoiding  selectioa  bias  is  an  experimental 
design  with  random  assignment  of  participants  to  coaching  treatment 
groups  and  noncoaching  t^ntrol  groups,  for  only  with  randon  assignment 

can  treatment  effects  be  p^resumed  to  be  Independent  of  prior  status  on  ^ 

\ 

any  of  a  host  of  personal  or, background  characteristics.    At  the  outset, 

•\ 

no  systematic  deferences  are  ^pected  between  treatment  and  control 

groups  when  they  are  constituted  by  random  assignment,  and  if  effective 

'  \ 

control  conditions  are  instituted  and  maintained,  the  only  systematic 
difference  that  should  eventuate  is  that  the  treatment  group  will  have 
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been  coached  while  Che  control  group  will  not* 

To  date,  three  studies  of  SAT  coaching  have  emplo^4  random  assignment 


(Roberts  4  Oppenheim,  1966;  Evans  &  Pike,  1973;  Aldermany  Powers,  1980) 


one  might,  ordinarily  expect  heavy  reliance  to  be  placed  on  their  results. 
However,  in  all  three  instances  the  posttest  used  was  a  special  admlnis- 
trration  of  a  retired  form  of  the  SAT  or  PSAT  (Preliminary  Scholastic 
Aptitude  Test)  rather  than  a  regular  SAT  administration.    In  each  case, 
for' purposes  of  equity,  the  plan  was  to  make  coaching  available  to  all 
study  participants  but  to  postpone  access  for  the  control  groups  until 
after  the  experimental  posttest;  the  Intent  of  administering  a  special 
SAT  was  to  protect  the  control  students  from  having  test  scores  count  on 
their  college  admission  records  before  they  had  an  opportunity  to  be 
coached*    But  precisely  because  they  did  not  count,  these  special  admini- 
strations may  have  been  viewed  to  some  degree  as  practice  tests,  thereby 
eliciting  less  motivation  and  effort  than  would  a  real  SAT  administration, 
especially  for  the  uncoached  control  students* 

Warning  signals  Chat  this^  night  have  bee n^  the  case  were  detected  in 
two  of  the  studies  (Roberts  &  Oppenheim,  1966^  Alderman  &  Powers,  1980), 
In  which  some  of  the  control  groups  were  found  to  exhibit  score  decreases 
in  going  £rom  the  pretest  to  the  special  SAT  posttest  when  the  expectation 
from  national  norm  samples  of  test  repeaters  is  for  score  Increases  over 
the  same  time  period*    Control-group  score  decreases  were  not  obstrved  In 
the  third  randomized  study  (Evans  &  Pike,  1978)  or,  for  that  matter,  in 
all  of  the  schools  Included  In  the  other  two  investigations  —  control- 
group  scores  In  3  out  of  lU  schools  did  norttf^fease  in  Roberts  and 


and,  given  the  power  of  randomized , experiments  to  obviate  selj^tion  bias. 
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Oppcnhclm  (1966)  while  5  out  of  8  did  not  In  Mderaan  and  Powers  (1980). 
But  there  Is  no  way  of  gauging  how  auch  the  obtained  score  Increases  were 
Influenced  by  the  different  motivational  conditions  of  a  special  as 
opposed  to  a  regular  SAT* 

Although  the  available  studies  of  coaching  for  the  SAT  are  methodolo- 
gically flawed  In  one  way  or  another,  the  various  defects  entail  sufficiently 
divergent  Inpllcatlons  that  any  regularities  or  lawful  consistencies 
across  the  studies  would  nonetheless  be  compelling.    Most  of  the  studies 
are  subject  to  the  Influence  of  selection  bias  discussed  earlier,  which 
severely  compromises  interpretations  as  to  the  source  or  determinants  of 
score  effects  —  in  particular  whether  they  nay  l>c  unequivocally  attributed 
to  coaching  experiences  ^s  opposed  to  personal  or  background  characteristics 
of  the  (self-)selected  students.    In  this  regard,  some  of  the  studies 
involved  control  groups  of  uncoached  students  attending  different  schools 
from  thy^  of  the  coached  students  or  else  drawn  from  other  extrinsic 
sources  such  as  test-score  files,  thereby  confounding  coaching  effects 
with  school  effects  and  numerous  self-selection  factors  (Dyer,  1953; 
French,  X955;  Dear,  1958;  Federal  Trade  Conmlssion,  1979;  Stroud,  1980). 
In  soDe  other  studies,  control  groups  of  uncoached  students  were  specially 
constituted  to  mat<^  available  samples  of  commercially  coached  students 
on  a  number  of  variables,  but  this  still  allows  systematic  differences 
between  the  groups  on. unmatched  variables  (frankel,  1960;  Whltla,  1962). 

Another  defect  common  to  several  of  the  studies  is  an  unfortunate 
reliance  on  small  samples  of  coached  students,  which  results  in  Imprecise 
estimates  of  score  effects  and  a  reduced  likelihood  that  real  effects 
will  be  detected  as  statistically  significant  (Frankel,  1960;  Whltla, 
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1962;  CoffMn  i  Parry,*  X967;  AldcrMn  1^  Power*,  1980).  MoreoverTr-*»-w«  

hAve  seen,  sont  studies  were  subject  to  the  unrealistic  ■otlvatlonal 
condltlcns  of  a  special  as  opposed  to  a  regular  SAT  adalnlstratlon,  which 
very  likely.  Introduced  biases  In  the  estimated  s^zes  of  scor^r^-^^s 
(Roberts  i  Oppenhela,  1966;  Evans  &  Pike,  1973;  Alderman  &^M^Tl980). 
Finally,  and  by  far  the  aost  troublesoae  from  the  standpoint  of  estlnatlng 
and  Interpreting  coaching  effects,  sone  of  the  studies  had  no  control 
groups  at  all  (Pallone,  1961;  Marron,  1965;  Coffman  4  Parry ,^ 1967). 

All  of  there  studies  are  arrayed  In  Table  1,  which  lists  fv,r 
each  coaching  program  the  type  of  control-group  design  employed,  the 
size  and  statistical  significance  of  the  obtained  score  effect,  the 
amount  of  student  contact  time  entailed,  and  thf  size  of  experimental  and 
control  samples.    This  Information  Is  given  separately  for  the  the  Verbal 
(V)  and  Math  (M)  parts  of  the  SAT.    The  studies  are  grouped  Into  three 
sections  In  order  to  obtain  separate  estimates  of  aveiage  score  effects^ 
from  those  studies  having  control  groups,  those  wltboiit  control  groups, 
and  those  manifesting  some  evidence  of  distorted  or  biased  results. 
Included  In  this  latter  group  are  those  coaching  programs  which  exhibited 
control-group  score  decreases  (Roberts  &  Oppenhelm,  1966;  Alderman  & 
Powers,  1980)  as  well  as  the  study  by  Coffman  and  Parry  (1967),  which 
wak  marred  by  treatnent-Jroup  score  decreases  and  other  Indications  of 
r.otivatlonal  difficulties.    The  estimates  of  score  effect  and  of  student 
contact  time  In  Table  1  are  as  given  In  Messlck  and  Jungeblut  (1981), 
li  which  each  of  the  studies  Is  summarized  In  detail.  ,The  score  effects 
for  the  control-group  studies  are  either  weighted  intercept  differences 
between  experimental  and  control  regression  lines,  when  th^e  were 
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available  f ro«.  analyaei  of  covariance,  or  else  they  are  weighted  average 
•core  Increaaes  of  experii»ental  over  control  groups,  weighted  in  the  case 
of  multiple  experimental  or  control  groups  J?y'' their  respective  saaple 
sizes.    The  score  effects  for  the  uncontrolled  studies  were  estimated  by 
reducing  the  reported  score  gains  by  an  anoQnt  approximating  the  corres- 
ponding experiential  growth  expected  on  the  basis  of  both  national  norms  ^ 
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data  and  control-group  growth  in  similar  studies.    See  Messick  and 
Juhgeblut  (1981)  for  details. 

To  begin  with,  we  note  that  a  simple  tallying  of  statistically 
significant  and  nonsignificant  score  effects  Is  not  very  illuminating* 
Of  the  17  Verbal. score  effects  derived  from  control-group  studies  (Including 
the  suspect  ones),  5  are  statistically  significant  at  the  .05  or  .01 
level  and  12  are  not,  but  10  of  the  latter  values  are  based  on  treatment- 
group  sizes  of  about  30  cases  or  less  compared  with  more  than  100  cases 
for  each  of  the  significant  effects.    If  the  8  schools  from  the  Alderman 
and  Powers  (1980)  study  are  combined  —  Including  the  suspect  values  from 
Schools  A,  B,  a,d  D,  which  serve  to  inflate  the  composite ^estimate  —  the 
resulting  weighted  pooled  effect  of  8.4  could  be  adjudged  statistically 
significant  at  the  .05  level,  and  the  overall  SAT-Verbal  tally  would 
become  6  significant  and  4  nonsignificant.    Of  the  12  Math  score  effects 
frooK control-group  studies,  8  are  statistically  significant  (all  but  one 
at  the  .oriev^l)  and  k  arc  not  significant,  two  of  the  latter  being 
based  on  coached  sacBples  of  50  or  fewer  cases.    Although  such  tallies  of 
significant  and  nonsignificant  findings  may  tell  us  aore  about  the  siie 
of  samples  and  about  the  power  of  statistical  tests  than  about  the 
effectiveness  of  coaching,  even  this  gross  comparison  tends  to  suggest 
that  SAT-Verbal  may  be  somewhat  less  rebponsive  to  coaching  Interventions 
than  SAT-Math,  which  shoula  not  surprls^  us  given  the  greater  curriculum 
relatedncss  of  SAT-M. 

Inquiring  about  the  average  sizes  of  obtained  score  effects  Is 
not  very  helpful  either,  because  one  gets^ strikingly  different  answers 
from  those  studies  tuvlng    )me  form  of  control  group  versus  those 
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•cudies  having  no  control  group  ac  all.    Excluding  Che  suspect  studies 
and  weighting  in  each  case  by  the  size  of  the  associated  coached  sample , 
the  weighted  average  SAT-V  effect  from  control-group  studies  Is  14.4 
and  that  of  SAT-M  is  16.2,  whereas  the  corresponding  values  from 
the  uncontrolled  studies  are  39. 0| —  or  36.6  (see  Table  1)  —  and  54.2. 

These  values  represent  average  numbers  of  SAT  score  points  on  a  score 

I 

scale  ranging  from  200  to  800  points,  on  which  typical  score  distributions 
exhibit  standard  deviations  of  about  100  points. 

Since  the  uncontrolled  studies  yield  estimated  score  effects  that 
are  far  out  of  line  with  those  of  the  control-group  studies,  we  must 
cart^fully  appraise  the  credibility  of  the  a4justmcnts  made  for  experiential 
growth  in  lieu  of  control-group  comparisons,  for  at  first  glance  these 
uncontrolled  studies  appear  to  warrant  a  pore  general  discounting  on 
methodological  grounds  alt^nc.    Uc  must  also  consider  the  possibility  that 
even  though  the  score  effects  from  the  uncontrolled  studies  are  out  of 
line  with  those  from  the  controlled  studies,  they  may  be  in  line  with 
expectations  derived  from  systematic  program  differences  between  the  two 
types  of  studies       In  particular,  the  fact  that  the  coaching  programs  In 
the  control-group  studies ,  .with  one  exception,  entailed  about  20  hours  of 
student  contact  time  or  less,  whereas  the  programs  In  the  uncontrolled 

studies,  again  with  one  exception,  entailed  about  300  hours  of  student 

\ 

contaci  tine.    However,  before  addressing  these  two  questions  in  detail  — 
that         how  defensible  are  the  estimated  score  effects  from  thti  uncontrol- 
led studies  and  how  credible  are  they  as  student  outcomes  from  long-term 
coaching  programs?  —  we  should  first  explore  a  further  complication: 
In  some  cases,  the  program  score  effects  reported  in  Table  1  obscure 
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e^fgent  interactions  between  the  size  of  individual  score  effects  and 
the  personal  or  background  characteristics  of  the  students, 

Although  statistically  significant  interactions  have  been  observed 
in  a  number  ol  coaching  studies,  the  findings  do  not  readily  cumulate 
into  a  coherent  picture.    For  example,  in  a  study  of  two  highly  selective 
independent  schools  for  boys.  Dyer  (1953)  found  that  for  students  not 
taking  mathematics  as  seniors,  those  who  were  coached  gained  over  29 
points  more  on  SAT-M  than  those  who  were  not  coached;  whereas  for  student! 
taking  mathematics  at  the  time,  those  who  were  coached  gained  only  3 
points  more  than  those  who  were  not  coached.    In  contrast,  although 
French  (1955)  noted  the  same  pattern  in  attenuated  form  for  boys,  he 
obtained  the  reverse  pattern  for  girls:    Coached  girls  currently  studying 
math  exhibited  score  increases  over  the  noncoached  girls  in  two  control 
schools  of  about  20  and  30  points,  respectively,  whereas  the  coached 
girls  not  taking  math  at  the  time  exceeded  their  noncoached  counterparts 
in  the  two  control  schools  by  only  1  and  A  points.    Thus,  an  interaction 
between  the  size  of  SAT-M  score  effects  and  current  enrollment  in  math 
courses  was  replicated  for  males  but  the  reverse  was  found  for  females, 
suggesting  that  the  relationship  Is  cither  haphazard  or  systematically 
moderated  by  the  student's  sex.    In  opposition  to  Dyer's  (1953)  results, 
Dear  (1958)  found  that  the  greatest  coaching  gains  on  SAT-M  were  for 
students  currently  studying  math,  but  no  comparison  can  be  mada  with 
French's  (1955)  finding  of  a  sex-moderated  interaction  because  Dear's 
sample  was  not  broken  down  for  separate  analyses  by  sex  of  student. 

In  regard  to  SAT-Verbal  score  effects,  the  only  Interactions 
observed  to  date  were  uncovered  In  Stroud's  (1980)  reanalysis  of  data 
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froB  the  FTC  (1979)  study.    At  one  of  the  two  coaching  schools  In  the 
FTC  study  (School  A  In  Table  1),  students  exhibited  combined  coaching/ 
self-selection  effects  that  were  statistically  significant  for  both 
SAT-V  and  SAT-M,  but  no  Interactions  were  discovered  for  any  of  the 


dozen  or  so  variables  that  served  as  covariates  in  the  analyses  of 
covarlance*    However,  at  the  other  coaching  school  (School  B),  though 
nonsignificant  score  effects  were  obtained  overall,  two  statistically 
significant  and  independent  interactive  effects  on  SAT-V  were  observed, 
one  for  race  and  the  other  for  8elf-reporti.-u  parental  Income,    On  the 
average,  even  though  their  number  was  quite  small  (N  -  13),  black  students 
at  School  B  exhibited  significantly  larger  coaching/ self-selection 
effects  on  SAT^V  than  nonblacks*     In  addition,  students  reporting  low 
family  Income  exhibited  significantly  larger  coaching/ self-selection 
effects  on  SAT-V  than  those  reporting  high  family  Income  (Messlck,  ';)80a, 
pp.  46-51).    In  contrast  to  previous  findings  (Dyer,  1953;  French, 
1955;  Dear,  1958),  no  differential  score  effects  were  uncovered  for 
SAT«M,  either  as  a  function  of  years  of  math  taken  or  of  sex  or  of  any 
of  Che  other  covariates. 

This  sporadic  emergence  of  statistically  significant  interactions 
indicates  that  certain  types  of  students,  such  as  those  with  low  family 
Income  or  males  not  currently  studying  math,  might  exhibit  larger  than 
average  score  increases  In  some  coaching  programs.    These  are  particular 
Instances  of  t  more  general  possibility  that  we  should  now  be  ever  alert 
to  —  that  coaching  programs,  like  other  forms  of  teaching,  may  display 
differential  effects  for  different  tyt)e8  or  groups  of  students. 

Since  particular  types  of  students  may  exhibit  larger  than  average 
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score  effects  In  loae  coaching  progrimf  and  since  the  score  effects 
exhibited  in  the  uncontrolled  studies  were  larger  than  the  average 
effects  obtained  In  the  control-group  studies,  the  discrepancy  in  the 
average  size  of  effects  in  the  two  kinds  of  studies  nay  b«  partly 
attributable  to  student  differences  as  well  as  to  program  differences  and 
design  differences.    This  brings  us  back  to  the  two  questions  that  were 
temporarily  left  in  abeyance  —  hov?  defensible  are  the  corrections  for 
experiential  growth  used  in  estimating  score  effects  in  the  uncontrolled 
studies  and  how  plausible  are  those  adjusted  score  effects  as  student 
gains  In  ability  due  to  coaching?    The  Interpretive  difficulties  introduced 
by  the  complete  absence  of  control  groups- were  indeed  compounded  by  the 
special  and  self-selected  nature  of  the  students  in  the  uncontrolled 
studies.    These  studies  (Pallone,  1961;  Marron,  1965)  were  each  conducted 
in  private  preparatory  schools  that  specialized  In  providing  high  school 
graduates  with  a  year  of  post-high  school  study  aimed  at  securing  admission 
to  the  U.  S.  service  academies  and  selective  colleges  (the  school  involved 
in  Pallone's  investigation  was  one  of  the  ten  studied  by  Marron). 

In  the  absence  of  control  groups  of  similar  students  i  it  is  difficult 
to  appraise  the  import  of  the  obtained  score  gains.    Four  methods  of 
adjusting  for  experiential  growth  in  ability  over  the  pretest-posttest 
interval  have  been  suggested  as  a  means  of  salvaging  these  studies,  but 
these  proposals  are  all  questionable  for  one  reason  or  another.  The 
authors  of  the  original  articles  both  suggested  that  the  obtained  score 
Increases  be  compared  with  normal  expectations  of  SAT  gains  typical  of 
males  during  the  senior  year  of  secondary  school,  as  revealed  by  College 
Board  normative  data  (Pallone,  1961;  Marron,  1965).    Tliis  is  not  a  very 
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satisfactory  comparison,  however,  because  the  preparatory  school  students 
In  question,  most  of  whom  were  high  school  graduates,  were  clearly  not 
representative  of  high  school  seniors  who  take  the  SAT.    Another  sugges- 
tion wa«  to  compare  the  obtained  results  with  average  gains  In  national 
SAT  administrations  of  Junior-  to  senior-year  retesters  having  the  same 
Initial  average  score  levels  as  the  preparatory  school  students  (Slack  & 
Porter,  1980),    Again,  this  Is  not  a  very  satisfactory  comparison  because 
these  private  school  students  were  not  a  representative  sample  of  the 
national  population  of  test  repeaters.^  Other  suggestions  Involved  a 
comparison  of  the  original  score  Increases  with  the  average  gains  of 
control  students  in  superior  schools  from  other  studies  nf  proprietary 
programs  (Pike,  1978)  or  with  score  gains  of  control  students  in  other 
coaching  studies  who  had  average  Initial  score  levi^Ls  roughly  comparable 
to  Pallone's  and  Marron's  groups  (Hesslck  &  Jungeblut,  1981). 

The  point  is  that  In  the  absence  of  comparable  control  groups, no 
generally  satisfactory  estimate  of  coaching  or  Instructional  effects 
can  be  made.    But  the  fact  Is  that  these  four  proposed  adjustments, 
though  based  on  different  and  debatable  rationales,  yield  corrections 
for  experiential  growth  which  are  not  radically  different  from  one 
another.    The  lowest  estimates  of  experiential  growth  were  generally 
produced  by  the  Slack  and  Porter  (1980)  procedure  and  the  highest  by 
Pike's  (1978);  on  the  average,  the  former  fell  about  10  points  below 
Che  mean  of  all  four  adjustments  and  the  latter  fell  about  8  points 
above  the  mean,    Hie  correction  applied  to  each  uncontrolled  study 
In  Table  1  was  the  average  of  all  four  proposed  procedures  (Messick  & 
Jungeblut,  1981),    This  resulted  In  weighted  average  estimates  of 
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experiential  growth  In  F«llone*«  case  of  Al  SAT-V  points  over  a  12- 
month  teatlng  Interval  and,  in  Marron's  case,  of  23  SAT-V  points  and  25 
SAT-M  points  over  a  6-fflonth  testing  interval.    Given  the  highly  self- 
selected  nature  of  the  preparatory  school  students  and  the  fact  that 
these  gross  procedures  leave  important  factors  of  differential  motivation 
and  growth  uncontrolled,  these  provisional  values  for  experiential  growth 
may  still  be  somewhat  underestimated       and  the  corresponding  adjusted 
score  effects  somewhat  overestimated  —  but  they  do  not  seem  to  be  unreason" 
able.     Indeed,  they  appear  to  be  in  the  right  ballpark. 

The  resulting  weighted  average  score  effects  from  the  uncontrolled 
studies  were  39  points  for  SAT-Verbal  and  34  points  for  SAT-Math,  which 
brings  us  to  the  question  of  how  credible  it  is  to  find  such  large  score 
effects  associated  with  SAT  coaching  prograas.    Of  course,  with  such 
highly  self-selected  students^ —  and  especially  in  the  absence  of 
control  groups  or  refined  covarlance  adjustments  —  these  score  effects 
represent  combined  coaching/self*selcction  effects,  and  their  size  may 
be  as  much  a  consequence  of  student  characteristics  as  of  prograc 
effectiveness.    Un  the  other  hand,  the  preparatory  school  programi>  In 
question  were  not  typical  SAT  coaching  efforts,  but  rather  entailed 
"full-time  exposure  to  course  content  that  is  directly  related  to  the 
verbal  and  mathematics  College  Board  tests  (both  aptitude  and  achievement)" 
(Marron,  1965,  p.  1),  undertaken  "for  students  in  their  final  year  of 
precollege  work,  including  a  large  number  of  high  school  graduates  who 
were  completing  a  year  of  post-high  school  iStudy"  (Pallone,  1961,  p. 
655).     It  should  come  as  no  surprise  if  such  a  long-term  instructional 
program  with  curriculum  emphases  on  test^relevant  knowledge  and  skill 
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development  were  found  to  yield  larger  SAT  score  gains  than  short-term 
programs  emphasizing  test  familiarization  and  practice,  as  is  the  situation 
with  some  of  the  control-group  studies  in  Table  1.    If  this  is  the  case, 
then  the  search. for  categorical  answers  to  the  simplistic  question  of 
whether  or  t\ot  coaching  works  is  seen  to  be  futile,  for  the  computation 
of  an  overall  average  score  effect  across  the  range  of  studies  in  Table  1 
would  produce  a  misleading  middle  ground  that  fails  to  characterize  the 
results  of  either  the  Long-term  or  the  short-term  programs  very  well. 
As/ a  consequence,  there  is  little  recourse  but  to  seek  relational 

answers  to  more  complex  questions  of  degree.    Instead  of  appraising 

/ 

the  ^verage  size  of  score  effects  associated  with  coaching  in  general, 
we  ^'should  rather  appraise  the  size  of  particular  score  effects  in 
r/lation  to  the  amount  and  kind  of  coaching,  asking  how  much  student 
/time  and  effort  devuted  to  what  kinds  of  coaching  experiences  yield 
what  level  of  score  improvements.    In  this  approach,  a  natural  first 
step  is  to  correlate  the  size  of  obtained  score  effects  with  available 
indices  of  program  characteristics.    Unfortunately,  data  on  program 
characteristics  that  are  sufficiently  comnensurable  across  studies  to  ^ 
permit  a  detailed  comparison  and  evaluation  of  coaching  procedures  is 
typically  not  available.    Indeed,  no  coaching  study  as  yet  has  systemati- 
cally investigat*ed  the  kinds  of  Instructional  methods  and  materials  that 
may  be  most  effective  in  Improving  SAT  performance.    Although  program 
descriptors  that  apply  uniformly  across  studies  are  rare  in  the  literature 
on  coaching  for  the  SAT,  the  amount  of  student  contact  time  in  each 
coaching  program  does  provide  a  generally  applicable  index  of  student 
effort.    Since,  for  the  relevant  research  studies,  those  coaching  programs 
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.involving  relatively  high  amounU  of  student  contact  time  also  entailed 
^structured  curricula  emphasizing  knowledge  and  skill  developtnent  while 
the  relatively  low-contact  programs  emphasized  test  review  and,  practice , 

^thls  Index  embodies  a  confounding  of  program  characteristics  in  these 

\ 

.data.    Thus,  student  contact  time  in  this  context  can  also  be  viewed  as  a 
^  proxy  for  increasing  curriculum  Jtructure  and  Increasing  emphasis  on 
skill  development.  f 

,  When  all  of  the  studies  in  Table  I  are  ranked  in  order  of  their 
obtained  score  effects  and  this  ranking  is  compared  with  their  ordering 
In  terms  of  student  contact  time  in  the  respective  coaching  programs, 
Che  two  rank  orders  prove  to  be  recoarkably  similar.    As  seen  in  Table  I, 
the  Spearman  rank-order  correlation  coefficient  between  SAT-V  score 
effect  and  student  contact  time  across  all  24  Verbal  coaching  studies  is 
.62,  while  that  for  SAT-M  across  all  15  Math  coaching  studies  is  .74. 
Both  coefMclents  are  statistically  significant  at  the  .01  level.  If 

m 

the  five  suspect  studies  are  deleted  from  the  calculation  for  SAT-V,  the 
new  correlation  is  .77  across  19  studies,  which  is  also  significant  at 
the  .01  level.    Thus,  as  anticipated,  the  suspect  studies  add  consider- 
able noise  to  the  data  set,  but  the  relationship  between  SAT-V  score 
effect  and  student  contact  time  remains  strong  with  or  without  them. 
The  results  for  SAT-M,  in  contrast,  are  hardly  affected  by  the  lone 
suspect  Math  coaching  study;    Upon  its  delation,  the  new  correlation  is 
.71  across  14  Math  studies,  which  again  is  significant  at  the  .01 
level. 

In  Interpreting  these  sizable  correlation  coefficients.  It  must  be 
remembered  that  as  ranK-order  statistics  they  Imply  a  regular  monotonia 
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relationship  between  student  , contact  time  and  *core  effect  but,  not 

t 

necessarily  a  linear  one.    Indeed even  ^though  the  time  dimension  is 

covered  in  only  a  fragmentary  fashion  by  the  available  studies,  when 

the  magnitude  of  score  effect  is  plotted  against  student  contact  tim/, 

the  relationship  is  distinctly  nonlinear*    To  demonstrate  this,  when 

linear  regression  lines  were  fit  to  score  effects  from  coaching  programs 

requiring  less  than  50  hours  of  student  contact  time  (all  of  which 

Included  control  groups),  the  extrapolated  predicted  score  effects  for 

Coaching  programs  entailing  300  hours  of  contact  time  (none  of  which 

included  control  groups)  were  much  higher  than  the  score  effects  actually 

obtained.     In  the  case  of  SAT-V,  the  predicted  300-hour  score  effects 

consistent  with  linearity  were  two  to  three  times  as  large  as  the  obtained 

average  score  effects,  whether  actual  or  adjusted,  and  for  SAT<-M,  three 

to  four  times  as  large.    This  marked  linear  overprcdictioii  of  score 

/ 

effects  for  higher  \/aIues  of  student  contact  time  clearly  indicates  a 
phenomenon  of  diminishing  returns  in  coaching  effectiveness  (Mcssick  & 
JUingeblut,  1981).  ^ 

Diminishing  Returns  in  SAT  Coaching  Effects 

As  is  frequently  the  case  with  diminishing  returns,  a  logarithmic 
transformation  of  the  time  dimension  provldcti  a  much  better  representation 
of  the  functional  relationships.    To  illustrate,  when  linear  equations 
.were  fit  to  the  regression  of  score  effect  on  log  contact  time  for  those 
coaching  programs  rcquirl«ig  Xc5&  than  30  nours,  the  cxtrapulatcd  predicted 
values  for  3uu-hour  programs  (33  points  for  Verbal  and  44  points  for 
^dth)  nuw  deviated  from  the  corresponding  obtained  average  adjubtcd  score 
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effects  by  only  .bout  3  to  5  points  for  SAT-V,  depending  on  which  of  Pellone's 
(1961)  diacrep.nt  values  are  Included,  and  by  10  points  for  *SAT-M.  Regression 
line,  fit  to^all  of  the  data  In  log  time  were  very  similar  to  tShose  regression 
-lines  based  only  on  "control-group  studies,  differing  from  each  other  by  only  2 
or  3  points  for  SAT-V  and  8  points  for  SAT-M  aC^  the  benchnark  of  300  hours 
(Messlck  i  Jungeblut.  1981).    These  logarithmic  equations  based  on  the  full 
range  of  data^(e^cluding  the  suspect  studies  and  Pallone's  discrepant  values) 
are  plotted  io  Figure  1.  transformed  so  as  to  relate  SAT  score  effect  to 
student  contact  time  in  real  rather  than  log  hours. 


"f. 
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As  can  be  seen  from  Figure  1.  according  to  the  logarithmic  models 
fit  to  the' obtained  score  effects  from  the  available  SAT  coaching  studies, 
a  Verbal  coaching  program  Involving  about  10  hours  of  student  contact 
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time  would  be  expected  to  be  associated  with,  average  SAT-V  score  effects 
of  8  or  9  points,  while  a  10-hour  Math  coaching  program  would  be  associated 
with  average  SAT-M  effects  of  about  12  or  13  points.    Siraiiarly,  the 
corresponding  values  for  a  20-hour  Verbal  and  a  20-hour  Math  program  are 
13  SAT-V  points  and  2i» SAT-M  points;  for  30-hour *prograns  apiece,  16 
SAT-V  points  and  25  SAT-M  points;  for  50  hours  each,  19  and  31  points; 
for  100  hours  each,  24  and  39  points;  for  200  hours  each,  28  and  A7 
points;  and,  for  300  hours  each,  31  and  52  points.    Or  for  uniform 
iO-polnt  increases  in  expected  average  score  effect,  the  associated  hours 
of  contact  time  would  be  as  fbllows:    About  12  hours  of  Verbal  coaching' 
or  8  hours  o£  Math  coaching  for  an  average  of  10  SAT  points;  about  57 
hours  of  Verbal  or  19  hours  of  >lath  coaching  for  an  average  of  20  score 
points;  about  ZbO  hours  of  Ver^l  or       hours  of  Math  for  an  average  of 
30  points;  and,  about  1185  hours  of  Verbal  or  107  hours  of  Math  for  an 
average  of  40  points.    Thus,  arithmetically  increasing  amounts  of  score 
effect  are  associated  with  geometrically  Increasing  amounts  of  student 
contact  time.    For  uniform  10-point  increases  in  average  score  effect,  as 
in  the  Illustration  Just  presented,  the  multiplicative  constant  carrying 
one  amount  of  student  contact  tlae  Into  the  next  higher  amount  is  aboul 
4.57  for  SAT-V  and  about  2.37  for  SAT^M.'*  The  fact  that  Verbal  entails 
ouch  Qore  student  contact  time  than  Math  for  the  same  amount  of  average 
score  effect  — -  at  least  for  these  logarithmic  models  fit  to  available 
SAT  coaching  data  ~  is  consistent  once  again  with  the  expectation  J\at 
Math,  being  aore  currlculua  related  than  Verbal,  should  be  relatively 
more  responsive  to  coaching  intervention.  * 

It  must  be  emphasized  (hat  these  logarithmic  functions  are  based  on 


546 

ERIC 


ai 


542 


existing  data  fro.  available  itudlci.  all  of  which  Involved  itudenti  who 
to.a  large  degree  were  motlvated-to  Increaie  their  Celt  scorei  through 
co-ichlng*    Since  luch  motivated  itudcnts  are  likely  to  have  been  highly 
task  oriented,  It  U  not  unreaionable  under  these  circumstance*  that 
*itudenc  contact  tlae  should  be  found  to  be  directly  related  to  av'erage 
•test  score  increases  (Stalllngs,  1?80)»  *But  we  must  remember  two  caution- 
ary notes:    One,  that  Increases  iti  student  contact  time  are  confounded  in 
these  studies  with  increasing  curricuiiun  emphases  on  knowledge  ^and  skill 
development,  so  thut  other  program  characteristics  that  contact^ time  may 
be  a  proxy  for  should  also  be  taken  into  Recount  In  interpreting  the 
relationships  and  determining  expectations.    The  other  derives  from  the 
pervasiveness  of  methodological  flaws  In  Che  extant  studies,  which 
compels  us  to  consider  the  possible  role  of  selection  bias  in  Interpreting 
the  basis  of  the  functional  relationships  —  many  of  the  longer-term 
programs,  such  as  the  preparatory  schools  in  Marron's  (1965)  study  and 
commercial  coaching  school  A  in  the  FTC  (1979)  study,  were  not  only 
associated  with  larger  score  effects  but  were  also  highly  subject  to 
self-selection  bias.    With  these  caveats  in  mind.  It  appears  likely  that 
improvement  of,,  the  comprehension  ^nd,  reasoning  skills  measured  by  the 
SAT,  when  it  occurs,  is  a  function  of  the  time  and 'effort  expencjed  and 
that  each  additional  score  Increase  may  require  geometrically  increasing 
amounts  of  tine  and  effortj.    This  developmental  pattern  of  gradual  and 

Imlntshing  Increases  in  response  to  coaching  or  Instructional  experiences 
Is  just  about  what  one  might  expect  with  measures  of  stable,  UoMgh 
developing  abilities.  ,  ' 
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Controversieq  Over  Implicationg 

Before  we  can  properly  appraise  the  import  of  an  apparently  curvilinear 
relationship  between  student  contact  time  and  score  effects  associated 
with  coaching,  we  must  carefully  consider  the  different  ways  in  which 
coaching  might  operate  to  improve  test  scores.    With  respect  to  implica- 
tions for  educational  and  testing  practice,  it  matters  what  processes 
underlie  improved  test  performance  —  in  particular,  whether  any  in- 
creased test  scores  attributable  to  coaching  reflect  stable  improvements 
In  the  verbal  and  mathematical  reasoning  abilities  measured  by  the  SAT 
as  opposed  to  improved  facility  in  overcoming  madvertant  sources  of 
test  difficulty,  unrelated  to  t!>ese  reasoning  skills  (such  as  test 
anxiety  or  unfamiliarity  with  different  item  formats  and  test-taking 
strategies),  or  soae  combination  of  the  two.    We  must  also  consider  the 
extent  to  which  any  obtained  score  increases  associated  with  coaching 
are  practically  worthwhile  in  relation  to  the  investment  of  student 
time,  cfforc,  and  financial  resouices  required  and  in  light  of  multitud- 
inous factors  that  complicate  this  judgment.    Depending  on  their  source 
and  practical  utility,  SAT  score  gains  attributable  to  coaching  —  if 
they  were  to  occur  with  any  regularity  —  would  have  important  policy  ^ 
iiflpllcatlons  for  either  educational  practice  or  testing  practice,  or  both. 

Tpplications  for  Student  Performance  and  Test  Validity 

Of  the  potential  ways  in  which  coaching  may  function  to  improve 
test  scores,  three  major  possibilities  can  be  distinguished  (Messick, 
i98Ua);    First,  some  coaching  programs  may  genuinely  improve  the  abilities 


548 

ERIC 


544 


and  tkilli  measured  by  the  ccic,  resulting  in  coawaensurate  increases  In 
test  scores.    Such  siore  increases  reflective  of  improved  abilities 
should  threaten  neither  the  construct  validity  nor  the  predictive  utility 
of  the,  SAT,  for  any  lasting  ioproveoents  in  verbal  quantitative 
reasoning  abilities  should,  lead  to  score  increases  on  tests  measuring 
these  constructs  and  should  also  serve  the  student  well  in  criterion 

situations  entailing  these  abilities," as  is  t^e  case  in  school  and 

I 

college  learning.    Second,  some  coaching  programs  may  enhance  test-taking 
sophistication  or  reduce  the  anxiety  often  associated  with  .aking  tests, 
resulting  In  increased  test  scores  that  ar^  now  more  accurate  assessments 
of  student  ability.    Such  score  increases  reflective  of  improved  test 
vrlsc'ncss,  by  virtue  of  revising  previous  scores  that  were  inaccurately 
low  because  of  construtt-irrelevant  test  difficulty,  should  lead  not  only 
to  more  accurate  assessment  of  abilities  but  also  to  enhanced  predictive 
validity  of  the  test.    Third,  some  coaching  (jrograms  may  teach  test-taktng 
stratagems  and  answer-selection  tricks,  resulting  in  increased  test 
scores  that  are  inaccurately  high  as  assessments  of  student  ability.  ' 
Such  score  increases  reflective  of  acquired  artifice  should  not  only  j 
dilute  the  construct  validity  of  the  test  but  jeopardize  its  predictive  ^ 
validity  as  well.    Some  coaching  programs,  of  course,  may  produce  nonj  of 
these  effects  or  laore  than  one  in  various  coibinatlons ,  so  that  in  an| 
particular  Instance  sooe  mix  ^f  improved  abilities,  improved  test  wis<|ness 

r 

and  Improved  arMflcc  might  contribute  to  improved  test  performance. 

The  first  two  possible  outcomes,  if  the^  were  realized,  would  be 
good  both  from  the  standpoint  of  student  performance  and  from  the  stand 
point  of  test  validity.    The  third  possibility  is  probably  only  a-mlnor^ 
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problem  with  well-constructed  tests,  because  professional  test  makers 
strive  to  minimize  the  use  of  >^compllcated  or  tricky  Item  formats  and  to 
avoid  items  that  may  be  answered  on  the  basis  of  clues  unrelated  to  the 
abilities  tested.    Moreover,  test  makers  also  strive  to  attenuate 
the  Import  of  the  second  possible  outcome  of  coaching  by  providing 
Tcst-famlllarlzatlon  materials  and  practice  tests  to  all  candidates  as 
well  as  advice  on  guessing,  pacing,  reviewing,  and  the  like,  "With 
well-made  tests  the  concern  Is  not  that  students  will  learn  how  to 
capitalize  on  extraneous  clues  to  inflate  their  test  scores,  for  such 
clues  should  be  rare  and  are  further  reducible  through  test  analysis,  but 
rather  that  students  learn  to  cope  most  advantageously  with  the  test  as  a 
standardized  vehicle  for  demonstrating  their  abilities"  (Messlck,  198Da, 
p.  65). 

Thus,  of  three  main  possible  outcomes  of  coaching,  two  are  good  for 
both  studeat  performance  and  test  validity  while  the  third  is  a  nlnOr 
and  rareiy  demonstrable  problem  with  professionally  developed  tests. 
The  second  possibility  —  that  improved  test  wlseness  might  yield  in- 
creased test  scores  of  greater  accuracy  —  although  potentially  critical 
for  certain  types  of  students  who  are  relatively  unpracticed  and  un- 
ortentcd  In  the  ways  of  standardized  testing,  is  of  debatable  Importance 
for  the  generality  of  students.    The  principal  reason  for  this  surmise 
is  that  various  coaching  programs  have  attempted  to  enhance  test  wlse- 
ness by  drilling  the  student  ia  different  approaches  to  different  item 
formats  and  to  allay  anxiety  by  providing  feedback  on  effective  item 
performance,  but  the  available  fragmentary  research  evidence  indicates 
that  if  this  is  all  that  Is  done  such  coaching  will  have  little  impact 
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on  SAT  icores  (Mesilck,  1980«).    Coaching  prograas  that  euphaslzt  test 
familiarization  and  practice  appear  to  be  assoclftted  with  small  score 
effects,  if  any,  whereas  programs  that  Includfe  skill-development  compo- 
nents tend  to  be  associated  with  larger  sco^re  effects  which,  on  the 
whole,  seem  to  occur  more  for  Mach  than  for  Verbal.    This  can  be  seen 
In  Table  1  once  we  note  that  the  former  programs  tend  to  be  relatively 
short-term  while  the  latter  programs  are  relatively  long-term. 

This  leaves  us  with  the  first  possible  outcome,  of  coaching  — 
namely,  that  effective  coaching  programs  genuinely  Improve  the  verbal  and 
mathematical  reasoning  abilities  measured  by  the  SAT  —  and  with  the  task 
of  ascertaining  the  credibility  of  such  an  outcome  glvea  the  paucity  of 

\ 

directly  relevant  research  evidence.    No  study  of  coaching  to  date  has 
systematically  addressed  this  Issue  of  Improved  abilities.    Rather,  all 
of  them  have  focussed  on  the  prior  Issue  of  first  demonstrating  signifi- 
cant score  Increases  associated  with  coaching  before  Inquiring  Into  their 
causes.    Since  this  second  step  has  not  yet  been  taken,  at  this  point  we 
can  only  conjecture  as  to  the  likelihood  that  obtained  score  Increases 
reflect  Improved  reasoning  skills. 

An  Important  related  question  pertains  not  only  to  the  Improvement 
of  abilities  through  coaching  but  to  the  stability  of  that  Improvement 
over  the  long  term.     If  effective  coaching  does  Improve  abilities,  this 
might  occur  via  the  development  of  new  skills  or,  more  likely,  by  the 
strengthening,  honing,  and  refining  of  existing  skills  through  exercise 
and  challenge.    Although  Increased  test  scores  attributable  to  coaching 
may  reflect  real  ability  Improvement  at  the  time  of  testing,  this  Improve- 
ment may  be  relatively  enduring  or  transitory  depending  on  whether 
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critical  levels  ot  exercise  and  challenge  are  maintained  In  the  student's 
learning  environment  until  the  ability  gains  become  stably  consolidated. 

Since  coached  scores,  if  they  indeed  represent  inprovenents  in 
ability^  should  be  Just  as  valid  or  more  valid  than  uncoached  scores  in 
predicting  academic  success,  at  least  in  the  first  year  of  college,  one 
might  turn  to  such  predictive  data  if  it  existed  foc  evidence  of  improved 
abilities.    However,  such  an  approach  is  both  indirect  and  ineffectual. 
It  is  indirect  because  it  requires  not  only  that  reasoning  abilities  be 
improved  by  coaching  but  that  the  improved  skills  be  both  durably  main- 
tained over  the  freshman  year  and  effectively  utilized  In  college 
perturmance,  wtiereas  numerous  countervailing  factors  —  such  as  social  ^ 
adjustment  problems  and  heavy  involvement  in  athletics  or  other  extra- 
curricular activities  —  may  contribute  to  scholastic  underachieveaent 
and  the  gradual  erosion  of  academic  skills.    It  is  ineffectual  with  * 
respect  to  inferences  about  improved  abilities  because  the  validity  of 
coached  scores  might  derive  not  from  improved  abilities  but  from  improved 
accuracy  ia  the  assessment  of  existing  abilities  attained  through  enhanced 
test  wlseness.    Tims,  high  predictlveness  would  provide  positive  evidence 
that  Increased  test  scores  attributable  to  coaching  reflect  either  stable 
Improvements  in  abilities  or  more  accurately  assessed  abilities  which  in 
either  case  were  well  utilized  in  college  performance,  but  low  predictive- 
ness  would  constitute  negative  evidence  only  if  plausible  alternative 
explanations  for  poor  academic  performance  could  be  discounted. 

Despite  these  Interpretive  pitfalls,  one  coaching  ^tudy  —  that 
undertaken  by  MarXon  (1965>  at  ten  specialized  preparatory  schools  — 
tentatively  explored  this  indirect  route  by  appraising  the  extent  to 
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which  SAT  scores  after  long-term  coaching  predicted  freahman  class 
standings  at  the  U.  S.  service  academies  and  selective  colleges.    As  a 
further  complication,  however,  relatively  crude  and  approximate  methods 
of  equating  were  required  in  Marron»8  study  to  achieve  some  semblance  of 
distributional  comparability  across  the  service  academies  and  across  the 
widely  diverse  colleges  that  the  preparatory  students  dispersed  to. 
Although  the  outcome  is  thereby  rendered  admittedly  tenuous,  the  find- 
ings nonetheless  suggest  that  at  the  service  academies  the  students  did 
less  well  academically  than  the  test  scores  predicted,  whereas  at  the 
selective  colleges  the  distributions  of  class  standings  and  test  scores 
did  ''not  seem  to  be  inconsistent"  (Marron,  1965,  p.  22). 

Thus,  the  possibility  that  effective  coaching  may  genuinely  Improve 
the  cooprehensiofi  and  reasoning  skills  measured  by  the  SAT  is  neither 
strongly  supported  nor  strongly  countered  by  available  data,  mostly 
because  so  little  of  it  is  directly  pertinent  to  the  issue.    What  would 
be  more  germane  are  studies  relating  both  uncoached  SAT  scores  and  SAT 
scores  alter  various  kinds  and  amounts  of  coaching  to  multiple  measures 
of  developed  abilities  and  cognitive  processes,  along  with  indices  of 
test-taking  sophistication  and  test  anxiety.    One  might  thereby  determine 
the  extent  to  which  coached  and  uncoached  scores  reflected  the  same 
cognitive  ability  factors,  the  extent  to  which  they  entailed  format-specific 
variance  unrelated  to  other  methods  of  measuring  these  abilities,  and  the 
dtigree  to  which  they  were  different -aily  affected  by  t^st-taklng  skills 
and  anxiety  levels.    But  in  the  absence  of  such  studies,  we  have  little 
^recourse  but  to  glean  whatever  clues  we  can  from  available  analyses. 

To  assess  even  tentatively  which  way  the  existing  data  point,  we 


553 


549 


must  rely  on  indirect  signals  and  bits  of  circumstantial  evidence,  taost 

of  which  are  discernible  in  Figure  1.    After  all,  what  research  evidence 

there  Is  about  coaching  for  the  SAT  has  been  summarized  in  Table  1  and 
♦ 

statistically  integrated  into  the  curves  of  Figure  1.    Those  curves 
suggest  that  SAT  score  effects  —  as  embodied  in  a  logarithmic  model 
fitting  the  available  fragmentary  data  —  are  still  Increasing,  minutely 
but  steadily,  up  to  300  hours  of  student  contact  time  and  beyond.  Each 
additional  amount  of  score  increase  entails  geometrically  more  student 
contaot  timtj,  which  is  ^  pattqrn  more  suggestive  of  developijtig  abilities 
than  of  either  enhanced  test  wiseness  or  acquisition  of  subject-matter 
knowledge. 

Subject-oatter  achievement  ought  to  increase  at  a  faster  or  less 
diminishing  rate  In  response  to  tuition,  as  indeed  it  did  In  Marron's 
(1963)  study,  In  which  weighted  average  score  gains  on  achievement  tests 
of  English  composition  were  almost  one  and  a  half  times  as  large  as 
unadjusted  weighted  average  gains  on  SAT-V  while  gains  on  intermediate 
and  advanced  Math  tests  were  roughtly  one  and  three-quarter  times  as 
large  as  on  l>Ar-M.     In  contrast.  It  Is  most  unlikely  that  enhanced  test 
wiseness  or  anxiety  reduction  would  still  be  accruing  positive  effects, 
however  diminishing,  after  300  hours  or  even  100  hours.    Given  the 
circumscribed  nature  of  the  information  and  advice  to  be  imparted  and  the 
Inevitable  redundancy  of  repeated  test  practice  per  se,  coupled  with  the 
modest  results  ot  coaching  programs  emphasizing  test  familiarization  and 
Item  review,  one  might  expect  the  effects  of  test-wlseness  training  alone 
to  peak  and  level  off  within  10  or  20  hours  of  student  contact  time  or 
less.    After  all,  10  to  20  hours  of  test-wlseness  training  would  be 
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comparable  to  a  one-credit  college  courae  in  teat  taking. *  Consiatent 
with  thia  conjecture,  the  faster  initial  growth  ratea  in  the  curvea  of 
Figure  1  indeed  suggest  that  score  effects  associated  with  the  first  10 
,to  20  hours  or  so  of  student  contact  time  nay  possibly  reflect  a  combina- 
tion of  enhanced  test  wiseness  and  developing  abilities,  with  the 
former  becoming  progressively  less  important  and  the  latter  progrgsaively 
more  important  in  the  attainment  of  larger  and  larger  score  effects. 

Implications  for  Guidance  and  Admissions 

SAT  score  Increases  attributable  to  coaching,  if  xhty  occur  with  any 
certitude,  may  have  important  implications  not  only  for  testing  practice 
but  also  for  educational  practice  —  for  learning  and  instruction  as 
well  as  for  guidance  and  admissions.    Before  v/e  can  ponder  potential 
implications,  however,  we  must  confront  the  question  of  practical 
utility  —  how  large  does  an  obtained  coaching  effect  need  to  be  to  have 
practical  significance  for  various  purposes?    As  we  shall  see,  since  a 
number  of  factors  must  be  taken  into  acc6unt  simultaneously,  this  is  a 
complicated  question  which  can  only  be  answered  conditionally.  Nonethe- 
less, it  would  help  to  clarify  if  not  resolve  the  issue  if  we  could 
underscore  some  of  the  relevant  factors  while  at  the  same  time  discount- 
ing other  ostensible  answers  that  turn  out  to  be  largely  irrelevant  to 
the  utility  of  co^aching  effects. 

In  this  regard,  one  commonly  mentioned  benchmark  is  ti.j  standard 
error  of  measurement  of  the  test»  which  typically  hovers  around  30 
score  points  or  so  for  both  SAT-V  and  SAT-M.    The  standard  error  of 
measurement  is  the  standard  deviation  of  measurement  errors  from  whatever 
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source  —  of  major  concern  in  connection  with  a  muUiple-foro  test  such 

as  the  SAT  are  those  errors  incumbent  upon  taking  one  test  form  as 

opposed  to  other  parallel  or  equivalent  forms,    A  range  of  plus  or  minus 

one  or  two  standard  errors  of  "beasurement  around  a  student's  observed 

score  Is  usually  taken  as  a  confidence  interval  serving  to  bound,  with  a 

given  probability,  the  student's  true  score.    Compared  with  this  band  of 

plus  or  minus  30  to  60  points  of  expected  error,  most  of  Che  score 

efUcts  associated  with  coaching  programs  in  Table  1  appear  to  be  relatively 

small.    But  these  score  effects,  by  and  large,  represent  differences  in 

average  score  increases  of  coached  groups  over  control  groups,  which 

automatically  takes  the  standard  error  of  measurement  into  account  since 

It  operates  in  sim£lar  fashion  In  both  the  coached  and  uncoached  samples. 

From  this  perspective,  the  standard  error  j|f_meA<Uirement  is  irrel^evant^' 

to  the  appraisal  of  average  score  effects  associated  with  coaching, 

because  these  effects  reflect  differences  over  and  above  the  Influence  of 

measurement  error.     It  is  also  largely  irrelevant  to  the  appraisal  of 

individual  score  effects  attributable  to  coaching,  provided  they  are 

calculated  as  residual  scores  around  regression  lines  based  on  uncoached 

or  pooled  samples,  as  in  analysis  of  covariance  (Cochran,  1968),  Such^ 

residual  scores  also  estimate  coaching  effects  over  and  above  the  standard 

error  ot  measurement,  in  addition  to  being  adjusted  for  contaminating 

variance  on  any  covariates  included  in  the  regression  equation  —  although 

the  size  of  the  standard  error  does  affect  the  size  of  the  individual 
t 

residuals.  However,  the  standard  error  of  measurement  is  by  no  means 
Irrelevant  to  individual  score  gains  calculated  as  simple  differences 
between  two  testings  before  and  after  coaching.    In  this  case negative 
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errors  of  measurement  in  the  first  testing  coupled  with  positive  errors 
in  the  second  would  inflate  any  coaching  effect,  whereas  positive  neasur- 
aent  errors  in  the  first  testing  coupled  with  negative  errors,  in  the 
second  would  attenuate  it. 

Another  reason  why  the  standard  error  of  measurement  is  not  an 
apposite  yardstick  for  gauging  average  coaching  effects  is  that  measurement 
error  is  a  random  process  affecting  all  test  t^akers  irrespectively, 
whereas  coaching  is  a  deliberate  and  directed  process  selectively 
affecting  only  those  test  takers  who  engage  in  it.^  There  is  no  question 
of  unfairness  in  connection  with  error  of  measurement,  for  it  constitutes 
the  luck  of  the  draw  in  how  well  the  sample  of  items  on  a  particular  SAT 
form  happens  to  match  the  individual's  functional  capabilities  on  a  given 
day.    That  on  a  different  day  or  a  different  test  form  the  individual's 
score  might  be  somewhat  higher  or  somewhat  lower  is  what  is  meant  by 
error  of  measurement,  and  it  applies  to  everyone  on  a  randomly  probabil- 
istic basis.    In  contrast,  demonstrably  effective  coaching,  being  systematic 
and  selective  rather  than  random  and  universal,  would  inevitably  raise 
questions  of  unfairness;  as  we  shall  see  when  such  questions  are  addressed 
in  detail  in  the  next  section,  however,  they  are  neither  new  nor  unique 
to  coaching*    Nonetheless,  in  terms  of  social  implications,  since 
a  relatively  large  standard  error  universally  applied  might  be  tolerable 
while  a  same-sized  coaching  effect  selectively  applied  might  not,  there 
are  ethical  as  well  as  logical  and  statistical  reasons  to  avoid  comparing 
the  two. 

Other  oft  invoked  contexts  for  evaluating  the  size  of  coaching 
effccca  are  the  SAT  score  scale,  which  ranges  from  200  to  800  points. 
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and  the  number  of  additional  Items  correct  Implicit  In  a  given  score 
effect*    For  example,  a  coaching  effect  of  20  SAT-V  points  corresponds 
to  about  three  additional  Verbal  iteos  correct  while  20  SAT-M  points 
corresponds  to  roughly  two  additional  Math  Items  correct.    A  20-polnt 

coaching  effect  thus  seems  trivial  when  viewed  In  terms  of  additional 

I 

Items  correct  or  In  terms  of  a  600-point  potential  score  range.    But  the 
choice  of  a  score  scale  Is  arbitrary  and,  wlthlp  the  limits  of  adequate 

i 

reliability  and  feasible  testing  time,  so  I5  the  number  of  items  In  the 

test.  '  ^ 

Although  the  200-  x.o  800-point  SAT  score  scale  Is  Innaterlal  for 
gauging  the  size  of  coaching  effects,  the  distribution  of  test  scores 
along  that  scale  Is  definitely  not.    In  particular,  the  standard  deviation 
of  the  SAT  score  distribution,  which  Is  normally  l^n  the  neighborhood  of  100 
points  fov  both  SAT-V  and  SAT-M,  provides  a  highly  pertinent  yardstick 
for  assessing  coaching  Impact.    Although  the  numerical  value  of  the 
standard  deviation  is  tied  to  the  arbitrary  score  scale,  as  Is  the  metric 
of  the  coaching  effects,  what  Is  not  arbitrary  Is  the  number  of  standard 
deviation  units  that  a  given  coaching  effect  represents.    Thus,  a  20-poxnC 
coaching  effect  Is  roughly  a  fifth  of  a  standard  deviation  of  the  score 
distribution,  and  It  remains  a  fifth  of  a  standard  deviation  under  any 
linear  transformation  of  the  score  scale* 

By  casting  coaching  effects  in  standard  deviation  units,  we  3?c  In^ 
a  position  to  translate  score  gains  attributable  to  coaching  into 
corresponding  increases  in  percentile  rank.    That  is,  for  normally 
distributed  tesf  scores  in  general,  we  can  now  determine  the  Improvement 
in  a  student's  percentile  rank  attendant  upon  a  given  score  effect. 
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but  this  pei;centlle  change  U  variable,  being  contingent,  upon  initial 
•core  level  prior  to  coaching.    For  example,  if  the  initicl  uncoached 

*  Tabic  2  .  . 

— — — -^^rCMflU  CtU  AjMclat*4  with  20^9ni  XJ^f»lnt  C««thln(  C((«cta 


score  were  two  standard^ deviations  below  the  mean,  a  iO-point  score 

effect  would  yield  a  per^centil^  improvement  of  1.3;  if  one  standard 

deviation  below  the  mean,^a  20-point  effect  yields  an  improvement  of 

5,3  percentiles;  right  at  .the  mean,  7,9  percentiles;  one  standard  deviation 

above  the  mean,  4,4  percentiles;  and,  two  standard  deviations  above  the 

mean,  only  .9  percentiles  (see  Table  2),    Thus,  the  largest  improvement 

In  percentile  rank  ^^ccurs  for  initial  scores  at  the  mean  of  the  score 

distribution,  with  the  amount  of  improvement  falling  off  as  initial 
'  t 

\n  either  direction.    Furthermore,  a  given 

I 

score  effect  yields  slightly  l!?rgei  percentile  improvements  for  initial 
uncoached  scores  below  the  meai^  in  comparison  with  the  improvements 
associated  with  corresponding  scores  equally  far  above  the  mean.  Although 
the  SAT  score  scale  is  not  precisely  normal  and  the  standard  deviation 
varies  slightly  from  year  to  yea^  the  corresponding  percentiles  and 


scores  deviate  from  the  mean 
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-percentile  changet  In  the  1979-1980  national  percentile  tables  for 

college-bound  seniors  are  within  a  point  or  two  of  these  noraal*curve 
♦ 

values,  as  seen  in  Table  2. 

The  percentage  of  test  takers  that  a  student  sui^passes  by  virtue  of 

a  specific  coaching  effect  may  be  keyed  to  a  particular  reference  group 

of  interest,  whether  college*bound  seniors,  or  females  or  applicants  to  a 

specified  college  or  whatever.    This  is  accomplished  by  dividing  the 

obtained  score  effect  by  the  standard  deviation  of  test  scores  for  the 

corresponding  reference  j^roup  and  then  appraising  the  .att-endant  percentile 

gain  over  initial  score  by  means  of  normals-curve  tables  where  appropriate 

or  else  by  using  local  or  targeted  percentile  tables. 

1   '        ^  * 
With' respect  to  the  practical  consequences  of  such  percentile 

iaprovementt ,  we  should  note  that  low-scoring  students ,  ,wtio  most  need 
whatever  benefits  coaching  might  accrue,  gain  relatively  little  In 
percentile  rank  from  a  20'point  score  effect.    The  same  holds  true  for 
high-scoring  students,  who  nonetheless  might  strongly  desire  any  add- 
itional benefits  derivable  from  coaching  if  they  aspire  to  highly 

•  \ 

selective  colleges.    Assuming  a  20-point  coaching  effect,  a  student 

with  an  initial  uncoached  score  1.3  standard  deviations  below  the  mean 
would  rise  three  percentiles  (from  a  percentile  rank  of  7  to  a  rank  of 
10),  whereas  a  student  initially  scoring  1.3  standard  deviations  above 
the  mean  would  gain  about  two  percentiles  (from  a  percentile  rank  of  93 
to  93).    For  Scores  initially  at  the  30th  percentile,  a  2U-point  coaching 
effect  would  yield  dbout  an  8  percentile  improvement. 

Given  current  admissions  practices,  it  is  unlikely  that  percentile 

Ifflpcuvementb  of  ihei»e  adgniludes  would  substantially  influence  admissions 

\ 


5b0 


sic 

^tadM70  0-82—36 


556 


decisions,  except  perh«p»  for  scudenca  whose  scores  are  at  Che  narglns  of 
*  * 

adnlsslblllty  to  variously  selefctlve  Institutions  at  whatever  Icvel.^ 
Even  here,  other,  factors  are  Ukely  to  outweigh  a  few  additional  percen- 
tiles on  the  SAT,  u'nless  Vlgld*  cut-in?  scores  are  Mandated.    Nor  Is  It 
likely  that  such  Improvements  In  percentile  rank  —  from  7  to  10, 
from  50  to  58,  'from  93  to^  95  —  would,  dramatically  alter  student  self- 
concepts  and  aspirations,  although  any  Improveaents  l.i  performance  or 
ability  should  be  realistically  capitalized  upon  In  student  guidance/ 
Since  popular  usage  seems  fco;  stress 'gross  categories  —  suth  as  being 
In  the  top  half,, third,  fifth,  or  tenth  of  the  group  —  any  percentile 
changes  that  bridge  those  categories  might  have  sreater  personal  Import 
p'sychQ logically,  but  there  Is  little  evidence  ^hat  they  have  special 
practical  significance  over  and  above  the  percentile  change  Itself. 
For  example,  a  20-polnt  coaching  effect  would  move  a  student  Initially 
scoring  half  a  standard  deviation  below  the  mean  from  the  bottom  third 
to  the  middle  third  of  the  norm  group,  albeit  frbm  the  fop  of  the  lower 
third  CO  the  bottom  of  the  qlddle  tTiird,  but  it  is  doutftful  that  thl.s 
.  gross  charactetlTation  would  outweigh  In  practical  decisions  the  actual 
change  In  percentile  rank  from  31  to  38^^ 

The  outcome  for.  a  30-point  coaching  effect  is  not  .^dically  different. 
As  given  in  Table  2,  the  corresponding  percentile  changes  are^  about  5 
percentiles  for  initial  scores  1.5  standard  deviations  beloW  fhe  mean 
(frota  '7  to  12),  less  than  12  percentiles  for  Inftial  scores  at  the  mean 
(from- 50  to  62),  and  3  percentiles  for  initial  scores  1.5  standard 
"deviations  above  the  mean  (93  to  96),    In  this  case  of  a  30-polnt  coaching 
effect,  however,  the  percentile  changes 'close  to  the  mean,  having  exceeded 
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a  decile,  are  more  noticeable  "nd  taight  have  practical  significance  in 
selective  instances.    But  coaching  effects  of  these  magnitudes^  judging 
from  the  available  research  evidence,  are  not  easily  attainable,  especially 
in  Verbal  (see  Table  1).    According  to  Figure  1,  an  expected  2(hpoint 
SAT-V  score  effect  would  be  associated  with  about  37  hours  of  contact 

time  for  motivated  task'-oriented  students  in  a  Verbal  coaching  program, 

1 

while  a  20-'point  SAT-M  effect  is  associated  with  about  19  hours  in  a  Math 
coaching  program.    An  expected  30'point  score  effe^    would  be  associated 
with  260  hours  for  Verbal  and  43  hours  for  Mat^.    These  score  effects,  of 
course,  are  average  values  expected  to  be  associated  with  coaching 
programs  of  tKese  durations,  so  some  individuals  would  achieve  variably 
larger  gains  with  these  amounts  of  contact,  time  while  other  individuals 
i/ould  attain  variably  smaller  gains*    Moreover,  given  the  possibility  of 
Interactions  between  score  effects  and  various  personal  or  background 
characteristics  of  the  participants,  certain  groups  or  types  of  students 
might  experJ^ence  markedly  higher  or  lower  increases  than  that  typified  by 
the  average  score  effect,  but  such  intv^ractions  have  not  b^n  well 
documented.  f 

If  one  focusses  not  on  the  test  as  a  predictor  of  college  psrfor** 
mance  but  on  the  predlctetl  performance  itself  ,^ another  potentially  use*- 
ful  yardfitick  for  gauging  coaching  effects  becomes  apparent  namely, 
the  attendant  gain  in  predicted  criterion  performance  or  college  fresh* 
O'^n  grade-point  average  (CPA)  ussociatcd  with  an  obtained  score  effect. 
Howeve*',  sin^e^this  predicted  criccrion  gain  is  dependent  on  particular 
grade  criteria  which  vary  widely  from  college  to  college  and  on  the 
nu2ah<;r  and  validity  of  other  predictors  included  in  the  specific  regression 
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equation,  it  is  woefully  ad  hoc  as  a  yardstick  for  appraising  coaching 
effects.  ■  ,  '  - 

In  order  to^  get  sooe  inkling  of  the  likV^ly  oagiiitude  of  such  pre- 
dicted criterion,  gains,  however,  let  us  con5i(|er  sooe  characteristic 
n>!dian  correlattdns  based  on  Qt7  SAT  valiJity  studies  (Educational 
Testing  Service,  1980).    Tlie  median  validity  coefficient  in  predicting 
college  freshoan  grade-^polnt  average  (G)  was  .52  for  high  school  grade- 
point  average  (tol  .37  for  SAT-V  (V),  .32  for  SAT-M  and  .58  for  all 
t,  / 

three  predictors  c^oobined.    Thti  corresponding  multiplerregression  equa- 
tion in  stand4rd-score  foro  Is       -  ,^2Z^  +  .202^  +  .10?:^^^  . 
it  a  student's  tes^  scores  are  augoented  by  a  specific  coaching  effect 
m  Verbal  (Z^^.  in^standard  deviation  units)  and  a  possibly  different 
coaching  effect  in  Math  i^^^),  the  resulting  prediction  is 
2^    «  .43Z^j  -f  .20(Zy  +  Z^^)  +  .10(Z^  +  Z^^)     .        The  gain  in  predicted 
/criterion  pecforoance  associated  with  these  coaching  effects  is 
therefore  (Z^    -  V  "  '^S^VC  "**  '^^^C    *        Thus,  for  typical  SAT  stan-  , 
dard  deviations  of  .about  100  points,  a  Z^Jrpoint  Verbal  coaching  effect 
yields  an  increoent.  of  .OA  standard  deviations  in  predicted  freshoan 
grade-point  average  -;hJlle  a  20-i-oint  Math  coaching  effect  yields  ar^  In- 
crement of  .02  standard  deviations,  resulting  in  a  combined  gain  in  pre- 
dicted criterJLon  p|irformance  of  .06  standard  deviations.    For  grade-point 
aveifages  on  a  U-  t(>  ^-point  scale,  tb.  median  standard  deviation  over  A 
flfteen-ycar  period  was  approximately  .66  (Be jar  &  Blew,  1981).  Therefore, 
Che  combined  gain  in  predicted  criterion  performance  associated  with 
20-point  coaching  effects  In  both  Verbal  and  Math  wouli  amount  to  about 
.OA  units  of  GPA. 
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In  general,  foe  linear  regression,  the  gain  in  predicted  grade-point  average 
associated  with  coaching  is  determined  by  aultiplying  the  obtained  Verbal  or  Math 
coaching  effect  in  standard  deviation  units  by  the  respective  beta  coefficient  for 
SAT-V  or  SAT-M  (a  number  usually  less  ttian  one) .    As  a  consequence,  given  standard 
deviation  units  of  coaching  effect  will  typically  yield  less  than  half  tnat  amount 
in  standard  deviation  units  of  predicted  criterion  gain,  often  considerably  less 
—  a  single  test  predictor  with  a  relatively  high  validity  coefficient  of  .5  gen- 
erally has  its  unique  contribution  even  further  reduced  by  the  addition  of  other 


valid  correlated  predictors.    Thus,  even  with  relatively  high  test  validities, 
a  30-pqint  coaching  effect  (.3  standard  deviations)  would  usually  yield  a  gain 
of  less  tlian  .13  standard  deviations  in  predicted  criterion  performance.  In 
terms  uf  predicted  grade-point  average,  then,  in  contrast  to  SAT  percentile  gains, 
an  even  smaller  percentage  of  students  would  be  surpassed  by  virtue  of  a  particu- 
lar coaching  effect.    Furthermore,  to  the  extent  that  other  valid  predictors  are 
employed  in  addition  to  the  test  and  that  other  background  factors  influence  ad- 
missions decisions,  the  import  of  any  obtained  coaching  effect  would  be  corre- 
spondingly muted  in  practice. 

As  has  already  been  suggested,  any  practical  utility  that  coaching  effects 
might  convey  is  likely  to  be  greatest  for  that  subgroup  of  students  whose  uncoached 
scores  are  at  the  margins  of  admissibility  to  selective  institutions  of  their  choice, 
in  whatever  score  ranges  those  institutions  deem  marginal.    But  it  should  be  remem-* 
bered  that  score  increases  attributable  to  coaching  may  arise  in  three  possible 
ways,  and  although  any  one  of  them  might  move  a  student  from  inadmissible  to  ad- 
missible status  in  terms  of  test  scores,  they  have  different  implications  for 
Subsequent  college  performance.     These  three  types  of  coaching  effects  are  schema- 
tized in  Figure  Z  In  relation  to  admissible  and  inadmissible  ranges  of  test  scores 
and  to  Successful  and  unsuccessful  ranges  of  criterion  performance. 
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Type  A  coaching  effects  In  Figure  2  derive  from  enhanced  test- 
taking  sophistication  or  reduced  test  anxiety,  by  means  of  which  un- 
coached  scores  that  were  inaccurately  low  because  of  construct-lrrel- 
evant  test  difficulty  are  raised  to  levels  more  accurately  descriptive  of 
student  ability.    Some  students  Invalidly  deemed  Inadmissible  In  terms 
of  the  formerly  Inaccurate  scores  might  now  be  validly  deemert  admis- 
sible in  teros  of  the  more  accurate  assessment  of  ability  levels.  Type 
B  coaching  effects  reflect  genuine  improvements  in  the  comprehension  and 
reasoning  abilities  measured  by  the  SAT.    Some  students  validly  deemed 
inadmissible  in  terms  of  low  prior  ability  levels  might  now  be  validly 
deeded  admissible  by  virtue  of  Improved  abilities  sufficient  for  success- 
ful college  performance.    Type  C  coaching  effects  derive  from  test-taking 
stratagems  and  answer-selection  tricks,  resulting  In  Increased  test 
scores  that  are  Inaccurately  high  as  assessments  of  student  ability.  As 
,  consequence,  some  students  validly  deemed  Inadoiisslble  In  terms  of  the 
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acre  accurate  prior  gcorc»  night  now  be  Invalldly  deeaed  adoistlbie  by 
virtue  of  Inaccurately  high  scores  oasUng  Insufficiently  high  ability 
levels. 

Students r  especially  those  from  diverse  cultural  backgrounds,  stress 
type  A  effects;  commercial  coaching  schools  claim  type  B  effects;  and, 
professional  testing  organizations  denigrate  type  C  effects  (Hammond, 
1980).    As       Iiave  seen,  there  may  be  a  modicum  of  substance  In  all  three 
positions,  but  the  Important  point  Is  that  these  potential  effects  arc 
neither  equally  likely  nor  equally  consequential*    For  example,  types  A 
and  B,  If  realized,  should  enhance  both  student  performance  and  test 
validity  while  type  C  should  be  only  Incidental  with  professionally  made 
tests.    To  the  extent  that  they  occur,  type  A  has  Implications  for 
testing  prac^tlce  and  ty^e  B  for  educational  practice,  and  both  raise 
questions  of  equity  of  access  to  effective  coaching  programs,  which  Is 
the  next  —  and  final  —  set  of  Interrelated  issues  to  be  addressed. 

Implications  for  Educational  and  Testing  Practice 

If  coaching  were  to  substantially  increase  test  scores  without 
correspondingly  Improving  the  abilities  measured,  there  would  be  Important 
Implications  for  testing  practice.    Such  an  outcome  would  Imply  that  the 
test  or  the  testing  experience  entails  unintended  sources  of  difficulty 
that  can  be  at  least  partially  overcome  by  special  preparation  —  anxiety 
over  being  evaluated,  for  Instance,  or  unfamlllarlty  with  Item  formats  or 
test^taklng  strategies.     In  addition,  effective  coaching , night  reduce  the 
operative  difficulty  level  of  some  test  Items  by  teaching  answer-selection 
tricks.    As  we  have  seen,  the  latter  possibility  Is  unlikely  for  profession- 
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ally  made  tests,  but  to  the  extent  that  U  does  occur,  the  affe^cted  items 
should  be  revised  or  eliminated  and  the  procedures  for  test  development 
and  analysis  tightened.    Although  the  former  possibility  —  that  enhanced 
test  wlseness  or  anxiety  reduction  might  lead  to  sizable  score  Increases 
—  Is  also  unllkely-to  be  of  major  consequence  for  the  generality  of 
studctnts,  it  may  be  of  special  significance  for  certain  groups  or  types 
of  students,  such  as  test  novices  or  those  who  are  not  culturally  attuned 
to  standardized  testing.    This  suggests  —  even' though  the  available 
studies  find  only  small  average  effects.  If  any,  associated  with  coaching 
programs  stressing  test  familiarization  and  practice  —  that  In  the 
Interest  of  equity  all  test  candidates  should  have  an  opportunity  to 
faraiilarizc  cheoseives  with  approproprlate  test  formats  and  to  practice 
recomnended  test-taking  strategies.    Such  familiarization  might  be 
accomplished,  for  example,  through  the  diligent  use  of  practice  tests  and 
advisory  materials  similar  to  those  routinely  distributed  by  th*  College 
Board.     Issues  of  equity  of  access  to  such  test-wlseness  coaching  programs 
and  materials  become  important  aainly  to  the  extent  that  Individual 
differences  In  test-taking  skills  per  se  influence  t6st  scores. 

On  the  other  hand,  if  score  Increases  attributable  to  coaching 
represent  comnensuratc  improvements  in  the  verbal  and  mathematical 
abilities  measured  by  the  SAT,  then  there  would  be  Important  Implications 
tor  educational  practice  and  social  policy.    To  begin  with,  the  func- 
tional-characteristics of  any  SAT  coaching  programs  that  prove  to  be 
eftective  would  have  direct  Implications  for  Instructional  practice, 
tor  although  tnere  Is  little  question  that  the  comprehension  and  reason- 
ing skills  mwsured  by  the  SAT  are  learned,  there  are  large  questions 
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about  how  chey  can  ht  taught^    And  if  they  can  be  taught,  their  status 
as  explicit  objectives  of  school  learning  must  be  addressed.  Since 
conprehension  and  reasoning  abilities  facilitate  educational  accom- 
plishctents  geneVally- —  the  SAT  is  related,  after  all,  not  only  to 
college  performance  but  also  to  high  school  performance  —  school  pro- 
grams stressing  ability  development  as  well  as  subject-iaatter  learning 
should,  have  synergistic  effects  on  current  and  subsequent  educational 
achievement.    In  addition,  as  Cronbaqh  and  Snow  (1977)  insist,  "the 
most  important  safeguard  against  rigidity  of  streaming  is  to  make  the 
development  of  aptitude  a  deliberate  goal  of  instruction"  (p.  521).  All 
of  this  .ImpXies,  sssuoaing  comprehension  and  reasoning  skills  are  teachable, 
that  the  most  efficacious  approach  to  elementary  and  secondary  education  — 
as  well  as  the  soundest  long-range  mode  of  preparation  for  the  SAT  — 
would  be  school  progtams  that  integrate  the  development  of  thought  with 
the  development  of  knowledge. 

If  coaching  techniques  for  fostering  ability  development  could  be 
specified  which  were  not  an  integral  part  of  the  regular  school  experience, 
then  Che  issue  of  equity  of  access  to  special  coaching  programs  arises. 
The  SAT  measures  the  current  level  of  developed  scholastic  abilities 
facilitative  of  academic  learping.    Whether  this  current  level  of  devel^ 
oped  abilities  derives  in  part  from  special  coaching  programs  pointed 
toward  improved  test  performance  or  from  general  educational  programs 
pointed  toward  Improved  school  performance  or  from  extensive  expericntiafl 
learning  in  nonschool  settings  —  that  is,  from  coaching  or  instruction 
or  experience  —  is  indistinguishable  to  the  SAT.    Thus,  the  issue  of 
equity  of  access  to  coaching  programs  that  are  effective  by  virtue  of 
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ability  development,  If  fuch  could  be  identified.  Is  similar  to  the  Issue 
of  equity  of  access  to  effective  school  programs  or  effective  life 
experiences>  for  they  each  have  similar  consequences  for  test  scores. 
Such  ability-enhancing  coaching  programs  raise  important  equity  Issues  of 
educational  access,  to  be  sure,  but  they  are  not  new  equity  Issues  nor 
are  they  unique  to  coaching. 

Epilogue 

To  say  that  coaching  for  scholastic  aptitude  tests  such  as  the 
College  Board  SAT  is  controversial  is  certainly  true,  but  It  does  not 
come  close  to  conveying  the  depth  or  dimensions  of  disagreement  —  as 
In  any  long-standing  controversy,  there  are  deep-seated  value  issues 
entailing  multiple  value  Judgments.    Nor  does  it  help,  necessarily,  to 
trace  the  arguments  of  various  parties,  for  often  as  not  they  are 
speaking  past  one  another  by  virtue  of  different  assumptions  about  the 
meaning  of  aptitude  or  of  coaching  and  about  how  to  pose  the  basic 
question  of  coaching  effectiveness.    Moreover,  even  If  there  were  agreement 
on  tho  meaning  of  terms  and  on  the  nature  of  the  research  question,  there 
would  likely  be  disagreement  over  the  adequacy  of  the  evidence  and  its 
consequent  Implications.     It  does  help,  however,  to  spell  out  all  of  the 
issues  in  detail  as  best  we  can  discern  then,  s    that  a  case  may  be  made 
for  J  particular  position  in  contrast  to  rival  alternatives. 

Following  this  approach,  we  argued  that  scholastic  aptitude  was 
neither  fixed  endowment  nor  direct  learning  outcome  but,  rather,  de- 
veloped (and  developing)  ability.    We  accepted  as  a  working  conception  of 
coaching  any  intervention  procedure  specifically  undertaken  to  Improve 
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teat  icorci,  including  training  tftchniquet  ranging  froo  ahort-teni  teat 
familiarization  and  practice  to  long-term  inatruction.    Given  the  diveraity 
of  empirical  outconea  attendant  upon  thia  range  of  coaching  procedurea, 
we  felt  compelled  to  aak  not  whether  coaching  worked  but  tp  what  degree, 
because  the  averages  computed  in  purauic  of  the  former  categorical 
question  yielded  a  misleading  middle  ground  unchsracteristic  of  either 
short-term  or  long-term  programs.    As  a  consequence,  we  exsmined  the 
relstionship  between  the  size  of  score  effects  sttribu table  to  cosching 
snd  the  amount  of  student  contsct  time  entslled  in  esch  cosching  progrsm, 
revealing  in  the  process  rank-order  correlstion  coefficients  upwsrds  of 
.7.    This  relstionship  proved  not  toTe  linesr,  however,  but  approximately 
logsrithmic,  with  srithmeticslly  increasing  amounts  of  score  effect  being 
associsted  with  geometrically  incressing  amounts  of  student  contact  time, 
which  in  the  extsnc  studies  nay  slso  be  serving  ss  s  proxy  for  incrisasing 
currlpili*m-«mphaseA--a»-^owledge  and  skill  development.    Thus,  SAT 
coaching  effects  —  within  the  limitstions  of  the  svsilsble  frsgmentk.., 
dsta^^-  appear  to  be  subject  ito  ourkcdly  diminishing  returns. 

Ahe  magnitude  of  individual  acore  effects,  tranaformed  into  units  of 
the  atandard  deviation  of  the  score  distribution,  wss  interpreted  in 
terms  of  the  amount  of  improvement  s  student  thereby  sttsined  on  the 
sversge  in  corresppnding  percentile  rsnk  —  thst  is,  in  terms  of  the 
per^ientage  of  test  csndidates  thst  s  student  surpsssed  by  virtue  of  s 
partlculsr  cosching  effect.    Tliis  improvement  in  percentile  rsnk,  however, 
is  contingent  on  the  student's  initisl  uncoached  acore,  with  a  given 
coaching  effect  yielding  ita  largeat  percentile  improvement  for  initial 
acorea  at  th«  mean  of  the  diatribution  and  falling  off  aa  initial  acorea 
deviate  from  the  mean  in  either  direction.    For  example,  a  20-p9int  score 
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effect  Jor  a  student  Initially  icorlng  one  standard  deviation  below  the 
aean  would  yield  an  improvement  of  about  5  percentiles  (from  a  rank  of  16 
to  21);  if  InlMally  scoring  one  standard  deviation  above  the  mean,  the 
Improvement  would  be  about  k  percentiles  (from  84  to  88);  and,  if  initlaHy 
at  the  mean,  it  would  be  about  8  percentiles  (from  50  to  58). 

It  is  unlikely  that  percentile  improvements  of  these  magnitudes 
would  substantially  influence  admissions  decisions,  except  possibly  for 
students  whose  uncoached  scores  are  at  the  margins  of  admissibility  to 
selective  institutions  of  their  choice.    Nor  is  a  coaching  effect  of  this 
magnitude  easily  attainable,  especially  in  Verbal.    According  to  the 
iogarithoic  model  relating  student  contact  time  to  average  score  effect 
based  on  the  available  SAT  coaching  data,  about  57  hours  of  Verbal 
coaching  or  about  19  hours  of  Math  coaching  would  each  be  expected  to  be 
associated  with  an  average  of  20  score  points  or  so.    Thus,  dependent 
upon  the  initial  uncoached  score  and  its  relation  to  the  margins  of 
admissibility  to  a  particular  college  and  noting  that  geometrically 
increasing  amounts  of  studejit  contact  time  are,  required  for  larger  and 
larger  score  effects,  the  ultimate  value  judgment  with  respect  to  coaching  - 
Is  it  worth  it?  —  cooes  down  to  the  individual  case*    The  evidence  and 
and  arguments  suoaarlzed  here  offer  a  rational  framework  for  addressing 
this  issue. 

But  -if  obtained  percentile  incre«ises  attributable  to  coaching 
represent  enduring  ability  improvement,  then  the  question  of  worth 
takes  on  a  different  ctiaracter  Independent  of  initial  score  level  or 
questions  of  admissibility.    The  burden  would  shift  to  asking  when,  if 
ever,  ability  development  was  not  worth  it  and  how  we  might  incorporate 
facilitative  techniques  into  the  formal  educational  process. 
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'        ^  m2 

Mr.  Weiss.  Thank  you  very  much.  Mr.  Erdahl? 

Mr.  Erdahl.  Thank  you  very  much,  Mr.  Chairman.  Before  I 
direct  a  question  to  our  witness,  I'd  like  to  direct  an  observation  or 
questioa  to  you,  Mr.  Ghairman.  I  really  tliink  you  should  be  en- 
couraged by  the  response  to  your  proposed  legislation.  It  seems  like 
'2  you  have  struck  the  fear  oT  the  law  giyers  into  the  hearts  of  the 
test  givers.  My  point  would  be  if  the  voluntary  policies  of  other 
testing  associations  are,  I  guess  I  could  use  the  word  as  concilia- 
tory, as  ETS  they  seem  to  have  negated  the  real  or  imagined  need 
for  your.  bill. 

*    Mr.  Weiss.  If  the  gentleman  will  yield. 

Mr.  Anrig.  I'd  be  glad  to  second  that  motion,  Mr. -Chairman. 

Mr.  Weiss.  As  I  indicated  at  the  outset  of  Mr.  Anrig's  testimony, 
I  am  indeed  heartened  by  the  changed  attitude.  I'm  also  aware  of 
the  fact  that  had  it  not  been  for  the  potential  of  legislation  being 
enacted  I  doubt  if  we  would  be  at  the  stage  where  we  are  right 
now.  So  I  think  that  perhaps  legislation  and  perhaps  the  enact- 
ment of  legislation  may  set  them  on  an<even  straighter  path  than 
.  '  they're  traveling  now. 

Mr.  Erdahl.  I  m  sure  that  many,  as  I  am,  are  properly  impressed 
by  your  legislative  clout.  — 

Mr.  Anrig,  thank  ypu  very  much  for  being  with  us  today.  I  regret 
that  because  of  a,  I  n)ight  as  well  drop  a  name,  breakfast  meeting 
with  King  *Hussein,  I  was  not  here  for  the  first  part  of  your  testi- 
mony.       .     ,  * 

If  you  haven't  done  it,  could  you  give  us  a  brief  summary  of  your 
background  for  the  record  because  I  think  it's  relative  to  the  posi- 
tion that  you've  taken  today. 

Mr.  Anrig.  Thank  you,  Mr.  Chairman.  Through  the  Chair  to 
Congressman  Erdahl,  I've  been  a  teacher,  principal,  and  superin- 
tendent of  schools  at  the  local  level  of  government.  Then  for  3 
years  was  in  the  Department  of  Health,  Education  and  Welfare, 
first  as  the  Director  of  the  Division  of  Equal  Educational  Opportu- 
nities in  the  Office  of  Education,  and  subsequently  as  Executive  As- 
sistant to  the  U.S.  Commissioner  of  Education.  Following  that  I 
went  to  the  University  of  Massachusetts  at  the  State  level  of  gov- 
ernment, and  from  the  University  of  Massachusett^s  was^appointed 
to  commissioner  of  education  for  the  Commonwealth  of  Massachu- 
setts in  1973,  a  position  which  I've  held  up  to  September  1  of  this 
year,-  when  I  went  to  ET8.  This  is  my  first  experience  out  of  the 
public  sector  and  out  of  government.  I  must  admit  I'm  enjoying  it. 

Mr.  Erdahl.  Thank  you.  Mr.  Chairman,  another  question.  Does 
ETS  have  a  profile  in  the  New  York  situation  of  the  students, 
either  academically,  income  wise,  whatever  you  want  to  say,  a  pro- 
file of  the  students  that  request  disclosure?  Who  are  the  students 
that  are  asking  for  disclosure  an3rway? 

Mr.  Anrig.  Through,  the  Chair,  generally  with  regards  to  the  law 
school  admissions  test,  you  have  a  very  high  request  for  disclosure 
and  I  believe  it  largely  cuts  across  the  whple  spectrum  of  young- 
sters and  others  who  wish  to  go  to  law  school.  In  the  other  areas, 
however,  you've  had  a  much  smaller  request  for  participation 
which  either  may  be  a  resuJt  of  the  desire  for  the  test  or  aS  Con- 
gressman Weiss  indicated  the  forms  may  not  be  as  accessible  as  the 
law  school  forms.  But  whatever  the  reason  the  people  who  request 
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tend  to  be  from  upper  income  situations.  By  upper  income,  appar- 
ently it's  over  the  $30,000  a  year  bracket  which  is  pretty  upper. 

Mr.  Erdahl.  Mr.  Chairman,  tomorrow  we'jl  be  hearing  from 
some  people  discussing  and  I  think  responding  to  questions  about 
the  impact  .of  testing— not  testing,  excuse  me,  coaching.  With  that 
in  rhind,  looking  at  the  provisions  of  H.R.  1662,  this  requires  test 
agencies  to  furnish  a-statement  on  the  extent  to  which  test  prepa- 
ration courses  improved  test  subject  scores  on  the  average.  Could 
you  comment  on  that  kind  of  anticipating  what  we  might  hear  to- 
morrow? 

Mr.  Anrig.  Let  me  just  say,  Mr.  Chairman,  I'll  be  glad  to  do  that 
without  legislation.  We  have  a  document  hot  off  the  press,  "Issues 
of  Effectiv^j^s  and  Equity^  in  the  Coaching  Controversy,"  it  is  in 
my  mind  fflg  best  piece  of  information  I've  seen  on  the  issue  of 
coaching.  It's  comprehensive.  It  includes  all  of  the  previous  studies, 
Porter  and  Slack  aside,  it  does  include  all  the  previous, studies.  It's 
been  developed  by  Samuel  Riessick,  the  distinguished  research  sci- 
entist from  ETS  who  will  be  here  tomorrow.  If  the  committee 
wishes  to  question  hini,  he'll  be  available  to  answer  your  questions. 
With  the  Chair's  perniission,  ill  submit  it  for  the  record. 

Mr.  Erdahl.  I  wfvs  just  going  to  request  that,  Mr.  Chairman,  ask 
unanimous  consent  that  that  be  included  as  part  of  our  record  for 
the  committee  and  staff. 

Mr.  Weiss.  Without  objection,  it's  so  ordered. 

Mr.  Anrig.  Through  the  Chair  to  Congressman  Erdahl,  the  issue 
of  coaching  to  me  is  delbated  by  researchers  and  will  be  debated  by 
them  tomorrow,  I'm  sure,  I  look  at  it  as  an  old  teacher  and  I  know 
Congressman  you  do  too,  I've  never  told  a  youngster  not  to  prepare 
for  a  test  and  never  will.  You  know,  it  goes  against  the  American 
dreann  that  practice  makes  perfect.  We  all  believe  that.  The  impor- 
tant thing  isn't  whether  a  youngster  should  practice  for  a  test  or 
not,  of  course  they  should.  It's  a  matter  of  what  they  expect  to 
come  from  that  practice.  It  will  not  perform  miracles  and  it's  very 
important  that  they  realize  that  it  won't  perform  miracles.  Just  as 
vour  cramming  and  mine  the  night  before  an  examination  in'  col- 
lege didn't  make  up  for  a  semester  of  not  doing  our  work,  coaching 
isn't  going  to  make  up  for  4  years  of  not  doing  your  work  in  high 
school.  The  tests  measure  what  you've  learned.  The  aptitudes  are 
learned  aptitudes,  they're  not  genetic  aptitudes,  they're  learned  ap-^ 
titudes.  So  if  you  practice  youll  do  better,  but  if  you  practice  for  a  ' 
short  period  of  time  you're  not  going  to  do  very  well.  If  you  prac- 
tice for  a  longer  period  of  time,  you  11  do  a  little  bit  better^  but  it 
doesn't  make  that  much  difference.  For  instance,  if  you  spend  20 
hours  of  intensive  coaching  and  practice,,  including  the  homework 
that  goes  with  that,  you  probably  can  increase  your  verbal  scores 
about  13  points.  If  you  spend  20  hours  on  math,  a  total  of  40  hours 
now,  that  s  a  lot  of  time  in  addition  to  going,  to  school.  A  total  of  20 
additional  study  on  math  you  might  pull  up  your  score  about  21 
points.  What  that  ^ally  means  is  that  on  a  scale  of  600  points,  a 
lot  of  people  forget  that  the  SAT  score  is  on  a  scale  of  600  points, 
you  might  increase  13  points  on  one  hand  and  21  points  in  another, 
that's  two  or  three  questions  on  the  test,  that's  all.  That's  worth 
doing,  I'm  not  going  to  tell  a  youngster  not  to  prepare  for  that,  but 
I  v/ant  to  be  sure  that  he  or  she  understands  that  it's  not  going  to 


578 


574 

get  him  into  Harvard.  It's  the  4-year  record  that  counts  in  your 
perf6rmance,  not  the  record  of  what  you  do  in  one  3  hour  sitting  at 
the  test.  So  I  think  the  issue  of  coaching  from  a.  teaching  point  of 
view  has  become  exaggerated  beyond  its  importance.  I  also  think  ^ 
it's  important,  hqwever,  not  to  deny  that  there  is  a  role.  I  think 
that  coaching  can  take  place  at  home.  It  doesn't  have  to  take  place 
at  school.  As  I've  said  in  my  testimony  I'm  very  determined.to  pro- 
vide inaterials  readily  accessible  to  anybody  of  any  economic  level 
so  they  don't  have  to  feel  the  only  choice  is  to  go  to  a  school  and 
pay  $300  worth  of  tuition. 

Mr.  Erdahl.  Thank  you  very  much,  Mr.  Anrig.  This  ma^  be  my 
final  question  and  it  maybe  sounds  a  bit  facetious  but.  I  don  t  mean 
it  that  way.  I  would  think  that  ETS  could  financially  and  adminis- 
tratively handle  the  compliances  required  in  this  proposed  bill,  but 
what  about  some  of  the  smaller  testing  agencies?  Would  wd  see 
ETS/end  up  as  something  of  &  monopoly  m  the  field. 

Mr.  Anrig.  Well  first,  through  the  fliair,  I  wouldn't  want  to  see 
a  monopoly  out  there.  I  welcome  competition  We've  been  winning 
some  of  our  competition  and  we've  beenJosing  it.  We've  lost  some 
bids  recently.  The  image  of  ETS  as  a  monopoly  out  there  is  just  not 
true.  There's  about  3,000  different  organizations.. 

MrT Erdahl.  I  didn't  say,  sir,  it  was.  I  said  it  Could  become. 

Mr.  Anrig.  But  you  gave  me  a  good  opportunity,  I  wanted  to 
make  that  point.  There  are  other  organizations  out  there  and 
they're  competing  with  us  now.  The  issue  of  cost  is  real.  If  those 
organizations  can't  pass  tlieir  costs  on  to  the  clients  then  I  think 
that's  very  true.  If  they  make  their  costs  force  the  fees  to  be  exorbi- 
tant then  people  will  say  I'm  just  not  going  to  take  that  test  any- 
more. So  there  is  a  danger  of  that.  We're  not  at  that  point  yet. 

Let  me  hasten  to  add,  however,  that,  ETS  because  it  is  large 
should  not  be  viewed  as  invulnerable  to  that  point.  A  year  ago  ETS 
lost  money  for  the  first  time  in  its  history.  When  I  was  interviewed 
I  said  that  was  a  new  definition  of  not  for  profit.  It  made  me  a 
little  nervous.  But  our  margin  of  revenues  over  expenditures  is  a 
very  small  percentage.  We  operate  on  a  fairly  small  margin.  So  we 
can't  afford  that  any  more  than  some  of  the  other  organizations 
•  can.  The  main  point  that  you  raise  which  is  can  these  costs  m 
Effect  affect  the  welfare  of  the  testing  organizations  out  there,  the 
answer  to  that  is  clearly  yes.  •  ,   ;  ,  x-  -x- 

Mr.  Erdahl.  I  hope  that  you're  encouraged  that  your  definition 
position  puts  you  in  a  unique  league  with  the  U.S.  Government, 
the  Chrysler  Corp.,  and  others.  Thank  you  very  much  for  being 
with  us.  Thank  you,  Mr.  Chairman  * 

Mr.  WEiss.-  Thank  ypu,  Mr.  Erdahl.  'Mr.  Walhams. ,    .     ^  ^- 

Mr  WiLUAMS.  Thank  you,  Mr.  Chairman.  Mr.  Anng,  the  New 
York  Truth-in-Testing  IaJw  is  entering  its  third  year.  How  is  it 
working  from  your  viewpoint.   .  x,       \     j  t 

Mr  Anrig.  Congressman,  the  experience  I  ve  had  and  1  want  to 
stress  I've  only  been  in  office  since  September  so  I'm  new  at  this.  It 
seems  to  me  the  law  is  working  smoothly  because  of  good  faith  by 
all  those  involved.  Good  faith  by  the  testing  organizations,^  good 
faith  by  the  State  Commissioner  of  Education,  and  good  faith  by 
Senator  LaValle  who  is  as  you  may  know  and  I  believe  a^spoke- 
sperson  is  here  for  him  today  has  amended  his  law  to  take  care  of 
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some  of  the  problems  that  arose  immediately  after  its  passage  that 
everybody  recognized  wasn't  the  intent  of  the  law.  So  there  s  been 
a  good  deal  of  flexibility  both  oi)  the  law  sponsors  side  as  well  as 
those  that  are  carrying  out  the  law.  One  of  the  reasons  I  think  it's 
important  .not  to  legislate  at  the  Federal  level  is  because  there  is  a 
statute  in  place  which  by  voluntary  decision  of  the  test  organiza- 
tions now  applies  nationwide,  and  we  ought  to  just  see  how  that 
works  for  a  period  of  time.  I  think  it's  working  rather  well.  I  think 
some  of  the  cataclysmic  predictions  didn't  come  true.  I  think  some 
of  the  miracle  predictions  didn't  come  true  either.  So.  the  best  thing 
to  do  based  on  my  experience  is  don't  legislate  where  you're  not 
sure,  and  it,  seems  to  me  this  is  an  area  we  shouild  watch  for,  a 
while. 

Mr.  WiLUAMS.  Did  ETS  have,  a  position  on-the  New  York  propos- 
al prior  to  its-becomipg  law?  . 

Mr.  Anrig.  Through  the  Cllair,  the  Educational  Testing  Service 
was  in  opposition  to  the  New  York  State  law. 

Mr.  Williams.  But  you  now  support  its  implantment  throughout 
the  nation  on  a  voluntary  basis? 

Mr.  Anrig.  The  decisions  of  the  boards  which  contract  with  us, 
the  Law  School  Board,  the  Graduate  Management  Board,  and  so 
forth  that  I  mentioned,  and  the  college  board,  their  decisions  have 
been  to  apply  what  they  are  doing  in  New  York  State  generally  to 
all  States  so  that  there  s  not  one  State  treated  differently  from  the 
.others.  There  are  some  exceptions  to  that  but  in  general  that's  the 
position  they've  taken.  ^ 

Mr.  Williams.  If  the  various  states  are  allowed  to  voluntarily 
abide  by  the  New  York  State  law,  won't  that  present  vour  company 
and  other  testing  companies  with  a  patchwork  quilt  throughout  the 
country  and  make  compliance  and  coordination  very  difficult? 

Mr.  Anrig.  With  the  Chair's  position,  the  decision  of  the  various 
boards  to  wply  the  New  York  State  entitlements  nationwide  I 
think  largely  was  based  to  avoid  that^  If  each  State  started  to  pass 
a  New' York  State-like  law  then  you  would  find  differences  because 
as  you  well  know  from  your  own  experienqe,  going  though  the 
State  legislature  someone  always  wants  to  put  an  amendment  on 
that's  uniquely  theirs.  So  then  you  would  end  up  with  the  patch- 
work. I  think  that's  not  advisable.  One  way  to  avoid  that  would  be 
Congressman  Weiss'  proposal  which  is  that  of  a  Federal  law.  I 
happen  to  think  that  the  remedy  is^. as  bad  as  the  disease.  So  the 
way  to  do  it^  it  seems^  'to^%,  and  it's  an  obligation  on  our  part  to 
respond  is  to  say  we'll  respond  to  the  issues  that  you've  raised,  that 
the  States  are  raising  and  the  Federal  Government  is  raising.  We'll 
respond  to  that  and  do  so  voluntarily.  It  seems  to  me  the  record 
shows  that  that  has  been  the  case. 

Mr.  Williams.  So  the , thrust  of  the  New  York  law  and  Congress- 
man Weiss  proposal  is  agreed  to  at  least  by  your  testing  company, 
but  you'd  prefer  that  that  be  done— that  that  thrust  be  accom- 

Flished  voluntarily  throughout  the  country  r^ither  than  by  law.  Do 
understand  that  as  your  position? 

Mr.  Anrig.  Through  the  Chair  I'd  like  to  state  the  position  a 
little  differently  than  you  just  did,  which  ils  the  position,  of  the  Edu- 
cational Testing  Service  is  in  favor  of  openness  in  testing,  we 
commit  ourselves  to  that,  and  we  take^the  actions  that  I've  de- 
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scribed  in  my  testimony  today.  To  the  extent ^those  are  complimen- 
tary to  elements  within  Congressman  Weiss  bill,  then  Vm  certainly 
supportive  of  those  elements  which  are  complimentary  but  not  in 
general  with  Congressman  Weiss  bill,  with  all  respect. 

Mr.  WiLUAMS.  Do  we  agree  that  the  public  has  the  greatest  stake 
in  openness.and  truth  in  testing? 

Mr:  Anrkj.  Through  the  Chair,  yes.  Affirmatively  and  because 
there  is  a  public  interest,  I  believe  tbat  organizations  like  Educa- 
tional Testing  Service  h^ve  both  the  same  interest  and  ah  obliga- 
tion in, that  area. 

Mr.  WiixiAMS.  I  guess  that  the  question  for  the  committee  to 
decide  is  given  that  fhere  is  I  suppose  near  unanimous  agreement 
that  the  public  does  have  this  enormous  stake  in  testing  in  this 
Natioh,  the  decision  then  is  should  we  allow  private  organizations  . 
to  implant  the  rules  by  which  truth  in  testing  Vill  be  achieved  or 
should  that  be  done  by  the  public  through  their  representatives? 

IWr.  Anrig.  Through  the  Chair,  Congressman  as  I  said  in  my 
opening  testimony  Fve  been  inv  government  all  my  life,  and  Tve 
seen  the  problem  of  first  trying  to  legislate  a  remedy  and  then  ad- 
minister it  afterwards,  and  I  don't  have  to  describe  that  problem  to 
you,  you  face  it  all  the  time.  What  you  intended  isn't  necessarily 
what  ends  up  being.  The  issue  is  to  look  at  the  results.  Are  you 
achieving  the  results  that  yOu  want  without  Government  action?  If 
the  answer  to  that  is  yes,  then  don't  t^ake  Government  action.  Ifi. 
you  think  you  could  achieve  better  results,  and  that  means  not  just 
in  what  you  do  but  in  what  those  who  follow  you  will  do  also.  I  say 
this  as  a  lifelong  bureaucrat.  Then  you.  look  at  legislation.  But  you 
say  boy  we  might  pass  a  law  up  here  and  it'd  be  a  pretty  good  law 
and  we- wanted  to  do  the  right  thing,  but  look  at  those  laws  we  ve 
.  done  the  right  thing  on  before  and  what's  happened  to  them  and 
t^hat  ends  up  being  a  burden  on  l<fcal  people^  I  just  don't  think  I 
want  to  head,  down  that  way.  So  I  think  that's  a  very  appropriate  . 
judgment  foi^e  law  givers  of  this  country  to  make.  My  advice 
would  be  that  Vou're  achieving  your  goal  without  legislation,  don  t 
legislate.  But  that  decision  rests  with  the  Members  ot  Congress  and 
I  recognize  and  respect  that  fully.  ■        : .  , 

Mr.  WjixiaMs.  I  appreciate  that.  I  do  want  to  make  the  point 
that  as  a  lifelong  observer  of  government.  I  want  to  make  the  point 
that  not  every  problem  has  been  made  worse  by  government  in- 
volvement. In  fact,  I  really  think  that  a  historical  overview  of  the 

East  '50  years  «h6ws  that  most  problems  government  has  attacked 
as  been  made  better  by  the  Jaws  that  government  has  passed.  I 
don't  know  how  political*  that  is  to  say  that  in  today  s  climate  m 
which  government  can  do  no  good.  But  the  hard  fact  is  that  gov- 
ernment has  done  an  enormous  £hnount  of  good  in  the  past  50 
years  and  indeed,  has  achieved  results  that  were  almost  precisely 
what  government  intended  to  achieve. 

I,  like  you,  ^n  a  former  administrator  and  a  teacher,  I  ve  been 
impressed  by  what  can  be  achieved  through  testing  and  eoually  im- 
pressed and  concerned  with  the  inexactness  of  testing.  Whether  it 
was  grade  school  or  high  school,  !  could  move  test  results  simply  by 
moving  the  dav  on  which  I  gave  the  test  from  Monday  to  Friday.  It 
seems  to.  me  there  has  been,  and  Tm  going  to  take  one  side  of  this 
and  advocate  it  and  then  ask  for  your  response,  sir.  It  seems  to  me 
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the  tremendous  focus  that  we  have  placed  on  testing  in  this  Nation 
has  resulted  in  students  or  potential  students  having  success  or 
failure  based  on  a  test  or  a  very  few  numbers  of  tests.  For  example, 
admission  tests.  Tm  wondering  if  yoa  as  an  expert  in  this  area  can 
speak  to  whether  or  not  we  overuse  tests,  whether  or  not  we  apply 
them  incorrectly,  and  particularly  whether  or  not  we  rely  heavly 
on  admission  test. 

Mr.  Anrig:  Through  the  Ghair,  I  think  you've  raised  some  very 
important  points.  Congressman.  Let's  take  a  look  at  what  the 
result  has  been.  Js  it  true  that  some  thing  out^  there,  maybe  tests  is 
stopping  students  from  getting  into  colleges  or  getting  into  the  col- 
leges of  their  choice?  I  was  interested  in  the  letter  that  was  submife- 
led  to  the  committee  by  the  American  Council  on  Educati(m  that 
represents  most  of  the  institutes  of  higher  education,  Accormhg  to 
their  data  90  percent  of  the  students  currently  seeking  admission 
to  undergraduate- studies  are  admitted  to  the  college  of  their  first 
'  choice.  Morelhan  95  percent  are  admitted  to  some  college.  Tests 
have  not  stopped  people  from  getting  to  colleges  or  even  to  the  col- 
leges of  their  choice.  I  think  a  very  strong  case  could  be  made  qu|te 
the  opposite,  that  it  has  made  that  possible. 

Now,  the  situations  that  you  describe  and  both  of  us  know  that 
that  does  happen,  are  misuses  by  individuals  of  what  a  test  should 
be.  It  is  true  they  are  inexact,  absolutely  true;  and  if  anybody  were 
to  take  a  single  test  as  the  determining  factor  for  any  decision, 
whether  it's  promotion  or  diploma  or  admission  to  college  or  saying 
the  youngster  is  a  gQod  youngster  or  bad  youngster,  that's  a  wrong 
action.  To  my  knowledge  every  testing  organization  that  publishes 
tests  takes  that  position.  Now  the  question  is,  how  can  you  guard 
against  that  kind  of  abuse.  The  trouble  is  you  can't  do.  it  by  law. 
You  can't  legislate  attitude.  An  admissions  officer  who  would  let  a 
.  test  be  the  determining  factor  is  not  doing  liis  or  her  job.  I  say  that 
♦  on  the  record  and  anybody  else  in  favor  in  representing  the  admis- 
sion field  I'm  sure  would  join  me  in  that  position,  but  there  prob- 
ably are  people  who  do  that  trying  to  find  an  easy  way  to  deal  with 
a  Idrge  number  of  people.  That's  wrong.  .  ' 

Mr.  Williams.  Let  me  interrupt  there,  sir.  Last  year  I  believe  it 
was  last  year  we  heard  this  legislation  and  a  representative  of  ortfe 
element  of  the  medical  community  came  before  us,  I  believe  in  op- 
position to  the  chairman's  bill,  and  based  his  opposition  primarily 
on  this  point  if  my  memory  is  cprrect.  Since  the  use  of  admission 
tests  the  medical  colleges  with  which  his  association  dealt  had  a 
significant  reduction  in  the  number  of  drop-outs.  On  the  face  of  it 
thalUbunds  good  and  yet  when  I  asked  him  if  they  were  relying 
almost  sdley  on  admission  tests  to  reduce  that  dropout  rate,  his 
anW^^er  was  yes.  When  I  asked  if  they  dealt  with  the  relevancy  of 
curriculum  to  minorities,  his  answer  was,  no.  And  when  I  asked 
similjtr  questions  his  answer  was  no,  we  deal  just  with  admission 
tests.  Now  that  Was  from  a  representative  of  an  association,  that 
has  I  suppose  thousands  of  members  in  the  medical'  community 
across  this  country.  .  .  x, 

Mr.  Anrig.  Through  the  Chair  Congressman,  there  is  in  the  au- 
dience and  on  your  schedule  of  witnesses  somebody  from  the  Medi- 
cal College  Admissions  Testing  program  who  is  better  able,  I  think, 
to  respond  to  the  point  you  just  raised.  Let  me  just  ans.wer  it  more 
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in  terms  of  general  questions  of  admission.  Admissions  officers  wi 
general,  and  at  least  I  have  found  especially  so  in  the  highly  seleV 
tive  institutions,  bend  over  backward  to  find  out  additional  infoA 
mation  about  students  to  that  which  is  provided  both  by  their' 
grades  and  their  scholastic  aptitude  t^st  scores,  I  was  a  little  con- 
cerned on  the  recent  Phil  Donahue  ^Vow  that  you  may  have  seen 
with  Drs.  Porter  and  Slack  from  Harvard.  They  were  criticizing  the 
SAT  and  making  generalities  about  admissions.  I  wish  they  d  gone 
right  down  the  street  to  their  own  admissions  office  at  that  univer- 
sity to  see  what  they  were  saying  is  not,  in  fact,  what  is  done.  I 
have  sat  in  on  admission  discussions  at  that  institution,  and  there 
is-an  enormous  effort  to  try  and  find-  out  what  underlies  the  back- 
ground of  a  youngster.  What  more  information  could  we  find  that 
makes  it  clear  that  this  is  the  youngster  we  would  want  have  come 
to  this  institution.  Most  admission  officers,  I  think  very  much,  try 
to  do  that.  Certainly  most  principals  and  guidance  counselors  try  to 
do  it.  But  there  is  always  the  aberration.  I  would  hope  no  institu- 
tion would  take  a  position  that-would  say  that  its  sole  determining 
action  will  be  based  on  any  test  score  as  2f  single  determining 
factor  overriding  any  other  part  of  the  admissions  process. 
Mr.  Craig.  Will  the  gentleman  yield? 

Mr.  Williams.  Just  one  minute,  are  those  effortii  within  the  ad- 
,  missions  office  inclusive  or  exclusive?  Are  they  for  the  purpose  of 
bringing  in  the  student  or  excluding  those  students  that  may  not 
be  fit.  *  • 

Mr!  Anrig.  Through  the  Chair,  most  institutions  now  we  have  to 
remind  ourselves  are  inclusive  institutions.  They're  not  sorting  out; 
they/ re  looking  for.  students.  That  will  increase  over  the  next  few 
'  ye  \rs  because  of  the  drop  in  enrollments  which  is  characteristic 
certainly  of  your  State  I  believe  and  others  as  well.  So  the  number 
of  students  available  to  come  to  the  institutions  is  going  down  and 
will,  I  believe,  about  25  percent  nationwide.  So  institutions  are  not 
doing  the  sorting  that  may  have  been  characteristic  back^in  the 
I950^s  and  1960's  for  instance.  The  small  numbei^of  institutions 
that  are  selective,  maybe  50  to  90  institutions  in  the  country,  the 
highly  selective  institutions  are  very  careful  not  to  rely  solely  on  a 
test  score.  They  really  are  very  careful  not  to  do  that.  I  just  think 
that  we're  moving  out  of  the  period  when  that  could  be  a  potential 
danger  because  there  just  aren't  that  many^  students  and  schools 
want  to  maintain  their  enrollment. 

Mr.  Williams.  I  yield.  ^   .  , ,  , 

Mr.  Craig.  Ye^,  Mr.  Chairman,  I  was  wondering  if  it  would,  be 
possible  if  we  cbuld  have  the  gentleman  in  the  audience.  Dr. 
Cooper,  respond  at  this  point  specifically  to  the  question  of  the 
Congressman.  ,    ,  ,  ^     m  i.  i 

Mr  Weiss.  If  you  will  we  have  the  schedule  set  up  and  we  11  take 
it  in  proper  order.  Otherwise  I  think  we're  really  going  to  dislocate 
the  schedule. 

Mr.  Craig.  OK. 
«    Mr.  Weiss.  I  appreciate  the  suggestion. 

The  gentleman  from  Montana,  questions? 

Mr.  Williams.  Mr.  Chairman,  thank  you  for  your  generosity  and 
time. 

Mr.  Weiss..  Mr.  Craig?  •  - 
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Mr.  Anrig.  May  I,  Mr.  Chairman,  just  before  we  leave  the  Con- 
gressman from  Montana,  I  do  want  to  say  that  as  a  lifelong  Gov- 
ernment serv£(nt  that  I  do  believe  Government  has  done  some  good 
work,  pa(rticularly  in  Massachusetts. 

Mr.  Williams.  Esp^ially  in  Massachusetts. 

Mr.  ANRi^r  I  didn!t  want  to  in  any  way  deny  that.  It's  just  that 
we've  also  got  some  problems.  Thank  you,  Mr.  Chairman. 

Mr.  Craig.  Fll  let  you  two  discuss  that.  Thank  you  very  much, 
Mr.  Chairman.  A  couple  of  questions,  I  think  the  thing  that  con- 
cerns me  most  is  that  we  seem  to  be  saying  that  your  bill  and  the 
New  Y6?lc  bill  are  similar  and,  therefore,  certain  kinds  of  things 
that  have  resulted  from  the  New  York  legislation  have  already 
cdme^to  pass;  and,  therefore,  certain  kinds  of  expenses  that  would 
be^^essary  might  not  be  arrived  at  with  the  passing  of  federal 
^J^slation.  My  quick  overview  of  that  finds  seven  rather  jnajor 
areas  of  difference,  indicating  there  is  a  real  difference  between  the 
New  York  bill  and  the  proposed  legislation  we  have  before  us. 

One  of  those  areas  that  concerns  me  is,  and  possibly  you  could 
address  yourself  to  it,  the  bill  we  have'  before  us,  in  section  4,  re- 
quires testing  agencies  to  reveal  proprietory  information  in  the 
case  of  contracts  with..other  agencies,  rfnd  there's  no.  similar  provi- 
sion in  the  fJew  York  law  for  that  How  does  your  organization 
view  that  particular  provision  and  the  jwtential  "problems  with  it. 

Mr.  Anrig.  Through  the  Chair,  Congressman  the  position  I 
would  take  on  it  is  from  a  position  of  an  organization  which  ^al- 
ready takes  its  annual  audit  report  and  publishes  it.  So  we  put  but 
on  the  table  what  our  expenditures  are,  what  our  revenues  are, 
where  they  are,  and  Cooper  and  Liebring  comes  in  and  audits  it 
and  we  publish  it  as  part  of  our  annual  report.  We  do  that  by  our 
own  decision  though.  I  would  find  very  intrusive  Government 
saying  to  any  private  organization,  including  a  not-for-profit  orga- 
nization that  you  must  provide  what  one  could  well  call  legitimate 
proprietary  information  and  submit  that  onto  the  public  record. 
There  are  organizations,  our  own  included,  .that  have  marketing 
strategies.  That  if  competition  were  to  look  at  it  could  pick  out 
those  strategies  very  easily  by  watching  that  over  a  period  of  time. 
Fm  sure  if  the'Chair  were  in  a  law  firm  and  at  ^me  future  date 
returned  to  the  halls  of  Congress  and  Congress  were  to  say  we'd 
like  that  law  firm  of  which  you  were  a  partner— a  high-  partner  I 
might  add—we  want  you  to  put  your  finances  out  on  the  public 
record.  The  response  to  that  would  be  pretty  strong.  I  think  as  a 
matter  of  principles  that  is  intrusive.  That's  Government  intrusi6^ 
into  the  private  sector  that  I  think  is  not.warranged^  But  again  I 
say  :that  on  the  basis  that  as  a  pcactice  the  ETS  Board  of  Trustees 
has  always  put  on  the  record  its  finances.  But  that  is.  not  true  in 
general  throughout  testing  organizations  or  any  other  business. 

Mr.  Craig.  Mr.  Chairman,  Mr.  Anrig,  by  my  reading  of  the  pro- 
posed legislation,  are  vie  not  saying  in  that  section  that- if  you  con- 
tracted with  a  university  to  do  a  special  kind  of  study  for  them,  be- 
cause they  were  interested  in  the  type  of  student  coming  in,  should 
they  be  different  from  other  universities  ih  certain  respects  and, 
therefore,  were  seeking  specialized  information;  that  this  would, 
demand  your  disclosing  this  information  if  requested  by  the  public 
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•  ^     when,  in  fact,  it  might  be  the  university's  information.  Do  you  see 
that  as  a  potential  conflict?  ' 

.  Mn  .A'WRiG.  Through  the  Chair;  P  think  the  poteriti^  is  there. 
What  I  think  the  sections,  particularly  sections  3,  4,  5,  6,  7,  and  8 
of  H;R.  1662,  what  they  do  is  begin  to  cut  in  in  a'way  that . I  don't 
\  •    -  believe  is  true  in  any  other  sector  of  the  economy  tc  the  really  pro- 

•  prietary'  and,  private  information  which  an  organization,  which  is 
private,  js  entitled- to.  And  I  think  whether  or  not  it  would  be  true 

•  ^  you  jiast  interpreted  it,  the  fact  that  i^  raises  that  question  just 
.  indicates  the  problems.  How  many  law  cases  would  be  necessary  to 

resolve  that  matter.  How  many  lawyers  would  have  to  be  "hired  tO' 
'  fight  that  out  in  court.  It's  just  an  area  we  should  get  into  in  my 
judgment.   *  • 

Mr.  Ckaig.  Apparently  before  I  came  in,  Mr.  Chairman,  you 
asked  the^question  as  it  related  to  costs  and  compliance  with  the 
New  York  law  and  I  have  read  wliat  -those  answers  are.  Do  you  at 
this  time,  or  has  your  organization-  at  this  time  made  any  evalua- 
tion based  on  potential  of  additional  compliance  through  the  bill 
%  that  we-h^ve  before  us?  What  additional  costs  might  be  incurred 
obviously  by  the  consumer? 

Mr.  ANkiG.  Through  the  Chair,  there  are  some  differences  be- 
tween the  New  York  State  law  and  H.R.  1662  and  I'm  just  trying 
to  look  at  the  ones  that  have  a  particular  cost  impact. 

Mr.  Craig.  You  have  done  no  study  at  this  time?  . 

Mr.  Anrig.  Not  at  this  time.  Congressman. 

Mr.  Craig.  To  make  a  determination  as  to  potential  costs? 
.    Mr.  Anrig.  We  could  take  a  look  at  that  if  you'd  like  and  Td  be 
happy  to  try  to  do  so.  ^ 

Mr.  GraIG.  I  think  that  would  be.  important  for  the  record. 

Mr.  Anrig.  Surely.  More  importantly  though  the  earlier  line  of 
questions  you  had  is  alm9st  more  importqpt  than  the  cost  factor, 
.  which  is  the  intrusion  issue.  It  would  in  my  judgment  treat  one 
sector  of  the  economy^  in  this  area,  the  private  testing  development 
organizations  differently  than  any  other  sector  of  the  economy  is 
treated  by  the  government.  I  know  of  no  other  sector,  other  than 
.  federal  regulat^  drug  companies  perhaps,  even  there  I  don't  be- 
lieve it's  true.  I  know  of  no  other  sector  that  is  treated  this  way. 
This  is  extremety  intrusive.  *  ^ 

-  Mr.  Craig.  Thank  you  very  much.  I  might  say,  Mr.  Chairman,  in 
the  overall  consideration  of  this  question,  at  a  time  when  we  are 
making  an  effort  within  Government  to  deregulate,  instead  of  in- 
crease^ regulations,  (and  Congress  has  been  on  record  for  several 
years  as  moving  in:  thsit  direction)  that  we  move  out  into  the  pri- 
-  vate  sector  when  we  have  large  testing  activities  within  Govern- 
ment itself,  the  civil  service  type  of  testing  and  military*  testing. 
There  has  been  real  questioning  of  the  related  acts  that  may  be 
unfair  to  those  participants  in  those  tests.  Perhaps  we  ought  to  be 
directing  ourselves  to  the  problems  of  Government  instead  of  pfi- 
vate  industry,  and  I  see  nothing  in  this  legislation  tRat  encourages 
*  that  direction  or  offers  any  relaxation  of  potential  problems  that 
exist  within  Governmenjt.  I  see  nothing  in  this  legislation  that  does 
anything  to  guard  against  the  institutions'  inisuse  of  existing  proce- 
dure or  test  information.  I  think  ,  that's  another  area  of  concern 
tjiat,  if  we're  going  to  go  into  this,  we  ought  to  cover  the  water- 
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^  *  front,  as  the  case  may  be.  Misuse  can  occur  at  a  variety  of  levels. 
Most  assuredly  it  cpuld  at  the  institutional  level,  dependent  upon 
those  making  use  of  |he  test  score  itself.  Thank  you  very  much  for 
your  testimony.        \  • 

Mrl  Weiss.  Thank  yoXi  very  much,^,  Mr.  Craig. 

Just  on  the  last  point,  without  attem{)tirig  to  engage  in  debate 
between  us,  I  don't  want  to  tell  the  institutions  how  they  ought  to 
conduct  themselves.  I  doi^t  want  to  set  educational  or  admissions, 
policy.  I  don't  think  that's^ppropriate.  Indeed  what  this  legislation 
intends  to.do,  and  perhaps  in  some  instances  imperfectly^  is  to  pro- 
vide for  disclosure,  period.  We've  tried  to  limit  them  to  the  infor- 
mation surrounding  the  test^zohe. 

Mr.  Anrig,  I'm  riot  sure  loindeirstood  your  response  to  one  of  the 
questions  Mr.  Craig  asked  you.  Let  me  see  if  I  can  phrase  the  ques- 
tion-and  your  response.  Are  you  suggesting  that- if  the  intrusive  as- 
pects of  this  legislation  were  removed  so  that  the  only  thing  we 
had  left  were  areas  which  were  clearly  regarding  information  sur- 
rounding the  test  itself  and'discldoure  of  the  .tests  and  studies  relat- 
ing to  the  preparation  of  the  test  questions  and  analysis  of  them-— 
that  it  would  be  the  scholar^  arid  the  students  period— and  we 
would  have  the^  contractual  and  fee  and  cost  questions  and  all  those 
other  intrusive  things  aside,  are  you  saying  that  educational  tesr- 
in|  service  would' support  this  legislation? 

Mr.  Anrig.  No,  Mr.  Chairman.  ^ 

Mr.  Wejss;  Oh,  I  thought  we  had  arrived  at  a  point  of  agreement. 

Mr.  Anrig.  G6od  try.  No,'  Mf.  Chairman,  pur  position  is  clear, 
legislation  is  not  needed.  The  action  is  being-  taken  in  the  absence 
of  legislation,  why  legislate? 

Mr.  Weiss.  I  wanted  to  set  the  ret;9rd  straight. 

Mr.  Anrig.  I  appreciate  you  doing  so.  '  , , 

Mr.  Weiss.  I  didn't  want  you  to  walk  out  of  here  and  have  your 
Trustees  suggest  that  you  went  beybnd  their  position. 

Ori  the  coaching  question  that  has  been  alluded  to  earlier^by  Mr. 
Erdahl,  vou  are  aware  of  the  fact  that  before  your  assumption  of 
the  presidency  of  educational  testing  the  Federal  Trade  Commis- 
sioi)  came  out  with  .a  report  in  whidh  it  concluded  that  indeed  thcP 
claim  of  the  coaching  schools  were  more  accurate  and  valid  than 
that  of  the  testing  companies  as  to  what  the  beneficial  affects  :of 
coaching  would  be  as  far  as  test  takers  are  concerned. 

Mr.  Anrig.  Mr.  Phairman,  I'm  aware  that  there* was  a  Federal 
Trade  Commissipn  study  done  by  the  Boston  regional  office  which 
as.  I  understand  it  was  not  accepted  by  the  Federal  Trade  Coriimis- 
\  sion  itself.  Indeed  the  Federal  Trade  Commission  or  at  least  the 
fl  \  staff  of  that  Commission  in  Washington  raised  serious  concern 
about  the  study  that  was.  done  in  Boston.  My  understanding  is  that 
Miss  Lois  Pine,  a  candidate  for  Lieutenant  Governor  in  Massachu- 
setts, will  be  here  tomorrow  and  I'm  sure  she'll  take  an  opportuni- 
ty to  describe  what  she  did  and  why.  The  Federal  Trade  Commis- 
sion itself  has  done  some  further  study  \mt  my  understanding  is 
that  riob6dy  has— ihoy're  putting  a  lot  cf  disclaimers,  including  on 
the  covers  of/ those\tudies,  about  their  own  conclusions.  The  issue 
to  me  is  noi  13  poinl5r\14  points,  or  15  points.  That's  why  I  think 
thel  coaching  controversy  is  heading  in  the  wrong  direction  if  it 
goes  that  way.  TH^  issue  to  me  is  how  can  we  be  sure  that  a  stu- 


dent  and  his  or  her  parents  understand  the  limits  of  what  short- 
term  coaching  caij^  accomplish.  Understand  the  options  as  to  where 
the  infoi^giatiojq  for  such  coaching,  and  it  doesnVhave  tO  take  place 
•at  a  coach ing^SchooiJ  it  can  take  place  in  the  you;igs*^r's  study,  or 
bedroom, -pr  livftig  room..  That  there  ig^jnformation  availg(ble  to 
them.  And  third  that  we  help  youhgstrfs  who  want  to  prepare  for 
tests  to  do  so  jja  to  do  so  accurately.  Tm /concerned,  for  instance, 
one,  of  the  book?that  recently  came  out  suggested  that  on*  the  issue 
of  guessing  and'  there  is^  a  way  to  gues§  on  these  tests  when  you 
narrow  it  down  to  two  of  the  four  options.  It's  given  bad  advice.  So 
what  weVe  done  is  prepare  a  brochure  which  Til  be  happy  to  leave 
witn  you  today  which  deals  with  the  issue  of  guessing.  It's  all  right, 
it'e  iri  the  test  design. 

^  Mr,  Weiss.  Without  objection  that,  too,  is  made  part  of  t\ie 
record.  '  *  > 

[The  information  referred  to  follows;] 
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ifaelafcauraaa  thai  attanfthanvartol  and  ' 
miltmnaiteafakHitavarapariad  of  monfM  may 
alw  raauH  in  ac«>«  $tim.      ttmM  ^uaalion. 
hawavar,  whathar  Ma  intanaa  font-tarm 
»ra»afati6n  wUI  aetoaiiy  maM  a  ditfartnca  in  your 
aH«4flc  plana  far  caHaca  «  jraduata  or 
piaNaalanal  aelwol  and  la  worth  um  coal  and  t>ma 
tayau. 

Analyaafl  al  aM  Hia  awail^  raaaareh  aiudtaion 
ur  caaehln«  ahaw'thal  appraBTmaitiy  40  hoonrol 
ctaaa  ifma  <apan(  •«  *«h  vattoat  ind  math  «tod*aa) 
pUit  c9M'i*m1i^  hamawork  c»ay  ba  t«Hel»d  to 
yittd  acora.fatna  an  lha  awarafa  al  13  i^nta  in 
ina  Varbal  and  21  Mnt«  in  ino  Maltt  aaetiana  oi 
IM  lati.  da>andint  an  ina  lima  and  a«on  put  in 
by  tiia  tludani.  Each  aaelion  is  acorad  on  a  «caia 
ot  aOMOO  Thaa*  (neraaaaa  cwraipond  to  two  or 
ihraa  additional  carract  ana\«*r«  an  (ha  tS- 
auatlian  Varbal  aaciian  and  iwo  ar  Ihraa  on  lhaiO- 
•  quaation  Math  aaction.  Wihin  ihaaa  •vf^n.  il  l« 
tmpartam  Id  nala  lhalVot  all  aearat  riaa,  5amt 
todraa  alay  lha  aama*  <^  drop,  and  «oma  art 

rn  praparini  far  a  taat.  ihara  iTKauic^  fw^^f  lot 
yaarayl  natlKtad  studtaa  or  waahnaaaaa  in  tha 
curriculum.  Tha  aaundaat  praparation  for 
admiaaiana  mi*   •(u^  tn  a*i*d  acadamk 
eauraaa  and  axtanatva  wtalda  raadtng. 


laaL  Naad  lha  currant  buHatin  of  informattan  tor 
lha  apaelflc  laat  yau  ara  lakinf  la  laam  what  it 
aappetad.  lha  typa  of  laat  la  ba  fivamila  purpo4^. 
Ha  larmal.  what  linawt9doa  or  akiH*  *ro  bain^; 


 ^  ^   ^    .  kVoqriaal 

aapra  la  *mt  m  cambin*ii«n  with  yaur  Mfh  achoal 
I  faeorxL  raeammandaliana.  and  athaf 


m       fdif    «ft  NM  »M(  yr^  «»•  oaM*  laaM. 


biiimiiia  praylda  a  aiarahauai  af  fadarmahan. 
uauiMy  incHMla  P  h>ri  Mmpla  tcsVM  MN  what  ip . 
.dpW  yaa  NwpprtbUma  ba<y.dM>lnt;*raflariha 


Id  an  lha  malarial  about  lha  l«*l 
eaiafuNy.  p*ylnf  pa.ticwlar  a(ianli«:  lo  lha 
difvcliana  lar  aach  typo  •!  <«t»lian.  Talta  lha 
aanvla  laat  undar  timad  cwtdiiiana.  and  ravtaw 
ma dwoattana  that  yau miaaad  Myauwanimara 
practt^,  additiwialMmpla  maiartaia  ar*  a»a«aW* 
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c«nlar  lA  »tMiy  •(  Um.  IWm  vtiM  i2  p«neM*  tni 
—  1M«  e«M  tociM  m  mm  m\.  Whir*  • 

^^^^  ^''^^^^^^ISi^       ^^^y  ^wi^  ^'^^^  tt^#t 

l^hm  Tmi  ^1)  aittf  tttt  OratfuM*  Mioinrrxnt 
AOwtotitw  fat  am  icfX  »y  »mHwcttnt  « 
>r>c|t«w  tor  Mch  wr«nff  tfiMW  ffvm  M«  ruimMr  o< 

IMiMlm.<M»  iMt  <H>»>y»^  •  eormeiioft  f«r 
flMMtaf.  liMM  MM*  «umM«M  v^lWr*  can 
••t'wJ'NW^  choi^M.  Fit 

w#^ipla,f  M  MMfa  af#  tour  a^ttoiia  ia  ^  ^uatlian 


•vnwMn^  two  !•  (fMHy  htciVuMil.. 
On  MtHif'MM*.  audi  a«  IM  Lm  tchaol  A^mttatati 
Ttat  (uuTi  antf  ttia  Ofa*wta  Naaartf  CdMntnaiiw)* 
|«Nii)  Mttu^  IWm,  ttiati  is  na  ilanalty  fat  Wanf 
afiMwrs^  Ifiaratapa,  try  h  •mum  wmji  «Mation. 

fm  \m  yam  aMwar  itwai  aaiaMiy<  Maal  iwMHiM' 
«halca  taaif  mtimymi  la  M  li^  t#aaaa  an  a 
■am m  awyaar  aliaat.  inwiaiiii  toniatWii'a 

aMai  Chaak  fraoaaMiy  to  ka  auia  lha  mwriMf  of 
Ma  aatwar  ataaa  yau  aia  IWtnt  corraa^a  lo  IM 
nuM^Kar  a(  lha  tuaaOan  yau  a»a  anawarlnf  Oarfcan 
t>ia  w>artw  aa  iNr  eawpliialy  Wl  i>ia  a»aea,  ii^t 
ar  fartM  maito  ma^r  na<  baraMT  oarraet^  it>a 
aiartniNwaanTni.  N  yau  aiiait«a  an  anawaf.  »a  awra 
la  cam^Mtaiy  vnmi  ttia  a«#  cftatea  an«  madt  yaur 
oaw  ana.  Qhw  an»y  ana  anawa^  la'a  ^uaation.  Tna 
a«a(^  »rocaa»  tar  many  laaia  traaia  twa  anawar 
marda  at  an  amlttad  4ua«l>pn ' 
♦  '  ♦  « 

U«afu<  atfataflaa  far  taat  taUr?  lociu#a  o<>t  anfy 
f«nffa(  onaa.  itha,  inoia  akova.     »6ma  that 
cauW  tia>»  wHh  aavaral  i»acilic  hinda  al 
'Quaatiafia.  Many  tlandarcNiatf  taala  contain 
anianyma,  analoffaa,  aanlanea-camrMttan 
%u*aUana<  an4  awaatian*  baaad  «n  raatf  ing 
Maaataa,  Ha«a  ara  aama  ad(0Hional  swofattioni 
Ml  cauM  m»l  to  thaaa  taaia 


ia  carafwl  la  tUmtnaia  maaa  raiattantMpa  that  ara 
na«  amtiy  MralM  iothara»ai(an*tt(pa(tt>a 


r 


>  of  tta  wart  tn  4iiaati(Mv 
a^maHiMa  H  PM4IM  Ml  tn^  la  pravWa  a  cantaal  far 
in<anywia.TI*al  ia.  you  r^ay  nat  ba  aMa  lo  4iAha 
''tXa^war^wiMnyavcairaacfaaafi  ttandiof  toy 
(laaif ,  aa  tMnk  of  a  pnrata  or  tantanca  tn  whtctt  tt 
^vauM  ba  uaa«.  H  yau  can  jMawiila  a  contaxi  far  a 
wartftyawmaybaaMaloafNvaaiiit  maanmf 

ralaManaMy  batwaart^itia  mat  twa  worda  ^orinlnf 
\  Ilia  laiaHancM^  af  tan  haljM* 


t^Madtha 

aamanea  caNlwlty  Ip  fai  a  ««naa  of  what  it  bamg 
•aM.  In  chOaalnf  an  «nawar.  mtka  sura  tba  wor3 
ar  «a«4a  «w  tof  icat  wlitun  ina  fatal  «an(«fKa  Do 
nat  aalaci  an  anawar  Juat  kacauaa  ona  of  tna 
wartfa  fttt  in  ana  ^ata  or  ciaoaa.  It  may  f>a>p  >l  g 
yaw  fdOn  tna  mitalng  worH  bafora  loaKing  at  tf>a 
-aiiawan^  Tuair  cwacntia'CuaifCttnMaif.Apy'  ir* 
ciatf. 


_  w.  fiaadnat  only  for  tf>a  facts,  tut 
fortt>aatt)tiKiaai»raaafttatf.lot(Ctfaad  ai^dina 
basic  aaaumptions  prasaniad,  Cftoosa  your  answer 
on  Hia  baaia  at  infonnattan  In  ina  M«aa«a.  not 
your  own  knawiadfa  or  a^inion,  wn;a«»  you  <r« 
inaiructad  otharwisa.  M  a  quastfon  asKi  about  tna 
main  Maaa  of  a  paaaaga,  do  nat  b«  diatr^etad  by 
fttatamania  that.  wn4ia  Irua.  ara  only  sacondary  to 
tha  ma»n  |>oint 


k  If  diatrarna  or  fi^ufas  ara 
na(  prataniad.  ft  may  ha^  if  you  draw  your  own 


vfcalKiiary  in  artHwnatfi:.  al«abr«.  and  taa«nafr/„  ar 
wiiati>ar  lava*  af  iwainamatica  t»>rtaat  coiai  arTUg^ 
aam#la  Mala  can  ba,  waafwi  for  ih«a  pwr^ta. 


I  baaad  an  ffra^  and  taMaa.  Scan  ina 
data  b^^fy  lo  aaa  wnat  kind  of  information  >s 
fivan,  and  tnan  «•  Immadiaiary  to  tM  4ua«tK>rHt)> 
>W  wti(  bacoma  lamtilar  wliti  }h«  data  graduaUy  as 
yatriry  lo'arwwar  ina  4uatlion<a> 

wiwd  ppaMama.  far  maih«mat(cal  word  prooiems 
Ma  ona  atar  al  a  tima.  raaoirHi  aacft  aanianca 
caratuNy  artd  tranalating  ttia  information  into 
4uaaiK>na«  * 


ica  H  availabia  in  your  toK 
bcr^'   I  for  acratciHi«rH..WMftin«  a  ^rabtam  out  m 
wniinf  mair  fiaif*  yau  avoM        In  ii>a  aafuiion. 

AA.  «or  itiaisa*.  In  ofdf^  tx^  lo  wasta  lima 
uiuwca«»anry  on  fang  compuiatians.  chtck  lo  sat 
if  an  a##foximaia  anawaf  is  raqutratf^for  aismpia. 
doas  iita  ouastian  ash' for  'mora  iftan  7i  parcanf 
raihar  tiian  aractfy  "^71  Hr^ani^*? 


If  yau  ar«  cortcarnad  about  a  taat  Qutstion  aftar 
tha  last,  contact  trs.  Wb  wtif  ba  glad  to  considar 
your  ildaaa  and  wTii  rasbond  la  you. 

Hafar  to  yc^r  aiudant  butiatin  for  information  an 
how  to  ftandta  a  probfam^  and  if  yof  tm6  mora' 
fttip.  cantact  (it  at  ina  addraas  orTaiaphona 
numbtr  I'siatf  m  tha  bu>(at»n  ar  at  ti»a  ets  ganarai 
addiass'  HosadaMr  fk>ad.  fttncatoa,'h^  CtMl;  or 
taiabrton«:(ibl^ttt«000. 
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Mr.  Anrig.  The  key  issue  is  the  information  needs  to  get  out 
there  .and  get  out  there  more  bro^^dly.  I've  said  in  my  testimony  the 
educational  testing  service  along  with  its  client  board  will  take  the 
responsibility  to  do  that  and  we  are  doing  that  in  a  lot  of  different 
and  new  formats  than  have  traditionally  been  available.  I'm  very 
anxious,  for  instance,  to  get  to  community  agencies  on  this  issue.  I 
think  they  reach  more  kids  that  are  poorer  youngsters  than  even 
the  schools  do.  ^ 

Mr.  Weiss.  You  do  acknowledge  the  the  information  which  ETS 
had  provided  Hp  to,  let's  say,  2  years  ago  in  regards  to  coaching 
and  its  effect  could  not  be  described  as  the  model  of  clarity  as  far 
as  the  test  taker  was  concerned  as  t6  what  he  or  she  could  expect 
from  being,  coached  for  that  exam  or  SAT?  ^ 

Mr.  Anrig.  Again,  I  •want  to  be  clear  that  some  publications  that 
have  been  criticized  are  not  put  out  by  ETS  but  rather  Jby  those 
other  boards  that  I've  mentioned.  But  I  don't  want  to  walk  away 
from  that  issue.  I  think  that  in  general  the  testing  organizations 
have  tended  to  downplay  .he  effects  of  coaching,  They're  not  doing 
that  to  deny  coaching,  they're  simply  saying  it  s  not  going  to  haye 
that  much  effect.  Don't  get  your  hopes  up.  You  can't  make  up  in  40 
hours  what  you  didn't  do  in  4  years.  That  was  their  intent  in 
taking  that  position.  In  stating  that  position,  ,they  may  have  over- 
stated it.  My  own  feeling  is  the  debate  going  on  right  now  is  mis- 
leading' the  students.  It's  giving  them^hope  which  is  not  legitimate 
hope.  The  obligation  is  to  make  that  clear,  what  it  can  and  can't 
do.  I  believe  the  publication  which  we  have  here  is  extremely  clear 
on  that  and  it  traces  out  the  number  of  hours.  If  you  put  in  this 
number  of  hours  in  this  kind  of  preparation,  you'll  get  this  kind  of 
result  for  it. 

Mr.  Weiss.  Do  you  know  that  it  was  not  until  a  hearing  before 
this  subcommittee  about  a  year  ago  or  so  that  for  the  first  time 
ETS  explained  for  .the  record  what  it  meant  as  to  what  kind  of 
coaching  would  not  be  helpful,.that  in  fact  we're  talking  short-term 
cfcaching  and  that  it  defined  short  term  as  anything  up  to  4  hours. 

Mr.  Anrig.  Yes;  Mr.  Chairman,  as  I  started,  out  my  statement,.  I 
think  the  hearings  which  have  been  conducted  as  a  result  of  your 
bill  have  been  very  hopeful  in  a  variety  of  areas  including  on  the 
issue  of  coaching.  The  problem  is  to  get  the  information  out  and  to 
be  sure  the  information  is  getting  out.clearly.  Through  your  leader- 
ship I  think  that  the  information  is  clearer  now  than  it  has  been  in 
the  past.  It's  interesting  that  of  the  number  of  press  calls  I  get,  I 
get  more  on  this  particular  issue  than  anything  else.  I  think  it  is 
,getting-aJoLoLnationaLattention.and^that.s.gQod,,asJong^asjA?:e^ge^^^ 
accurate  information  out  and  not  inaccurate  information.  I  do 
think  it's  important  to  be  sure  to  look  at  the  conditions  that  were 
placed  both  by  the  Federal  Trade  Commission  itself  and  subse- 
quently by  the  regional  office  on  their  own  stiidy.  So  I  wouldn't 
take  it  as  gospel,  id  hate  to  have  misinformation  getting  out  now 
that  we'^re  beginning  to^get  clear  information  out. 

Mr.  Weiss.  Commissioner,  thank  you  very,  very  much-  for  your 
testimony  and  for  your  patience  in  responding  to  our  questions.  As 
I  said  at  the  outset,  I  think  that  the  attitude  which  you  evince 
really  is  heartening.  We  look  forwai'dL  to  the  implementation  of 
those  attitudes. 
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'  Mr.  Anrig.  Thank  you,  Mr.  Chairman,  it's  been  a. pleasure  to  be 
here.  I  thank  the  members     the  committee  too.  ^ 

Mr.  Weiss.  Next  is  the  director  of  the  American  College  Testmg 
Service,  Philip  Rever.  Will  you  correct  if  I  have  mispronounced 
your  name?  Is  it— is  it  pronounced  as  Ftfeever  or  is  it  River? 

Dr.  Revsr.  Mr.  Chairman,  congratulations,  you  did  a  wonderful 
job. 

Mr.  Weiss.  Yes?  OK. 

STATEMENT  OF  DR.  PHILIP  R.  REVER,  DIRECTOR,  AMERICAN 
COLLE0E  TESTING.SERVICE,  WASHINGTON,  D  C. 

Dr.  Rever,  Mr.  Chairman,  I  am  Philip  R.  Rever  and-I  am  the  di- 
-rector,"not-of>-the  entire  American  college  testing  program,  to  my 
dismay  sometimes,  but  only  to  its  Washington,. B.C.,  office, 

I  am  delighted  to  appear  before  the  two  subcommittees  at  this 
hearing  because  the  topic  of.  the  liearing  would  indeed,  have  a 
direct  bearing  on  the  American  college^  testing  program's  assess- 
ment, a  college  admission  and  placement  test  which  is  taken  by 
about  1  million  students- each  year.  It  would  affect  the  tests  that 
we  administer  or  develop  for  other  agencies^^with  which  we  have 
contracts,  for  a  variety  of  services.  We  do  adhiinister  medical  col- 
lege admission  tests  though  we  do  not  develop  their  exanimation, 
and  we  haye  recently  signed  a  contract  to^develop  the  law  school 
admission  test  though  we  do  not  administer  this  examinatioh.  How- 
ever I  will  restrict  my  remarks  to  the  effects  of  H.R.  1662  on  the 
ACT  assessment  and  in  that  regard,  I  have  prepared  and  submitted 
to  the  subcommittees  and  with  your  permission  I  would  like  to 
have  entered  into  the  record  a  printed  statement,  but  I  would 
prefer  to  summarize  the  points  that  I  have  made  in  that  statement 
rather  than  read  it.  x  x  i. 

Mr.  Weiss.  That's  fine.  Without  objection,  your  entire  statement 
will  be  entered  in  the  record: 

[Prepared  statement  of  Philip  Rever  follows:] 
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PmrAHED  Statemknt  or  Dr.  Phiup  R.  Rever,  the  American  College  Testing 

Program 

Msscs.  Chairmen: 

I  am  Dr.  Philip       Rcver,  Director  of  the  Washington,  D.C. 
Office  of  The  AjTicrican  College  Testing  Progcam,  inc.   (ACT)  .  Because 
H.R-   1662/  The  Educational  Testing  Act  of  1981,  would  directly 
affect  act's  Assessment  Program/  I  am  pleased  to  appear  before  your 
sabconunlttoes  to  present  ACT's  viovs  on  the  Bill^.     In  short,  ACT 
oppose;S  pacsage  of  H.R.  1662  ^ust  as  it  opposed  passage  of -«.r.  16,62's 
predecessor/  .H.R4  4949/  during  the  96th  Congress. 

act's  reasons  for  opposing  II. R.  4949  v^ere  fylly  discussed  in  a- 
coroprehensive  statement  submitted  to  the  Subcommittee  on  Elementary/ 
Secondary/  and  Vocational  Education  on  September  10/'  1979.  Nothing 
has  occurred  since  ACT  submitted  its  earlier  statement  that  has 
changed  ACT's  views  about  the  value/  necessity/  or  educational 
consequences  of  bills  like  H.R.  4949  on  the  ACT  Assessment  and 
Students.    To  the  contrary/  ACT's  experiences  in  <-omplying  with 
the  New  York  law  have  reinforced  its  concerns  about  the  utility  and 
desirability  of  legislation  modeled  after  the  New  York  laW/  e.g. 
H.R.  1662.    In  addition/  the  actions  taken  by  test  agencies  to 
respond  to  proponents'  concerns  about  tests  and  test  use  in  admissions 
have  made  H.R.  1662  unnecessary  in  the  absence  of  substantial  numbers 


The  Assessment  Program  is  the  formal  name  of  ACT's  college 
admission  and  placement  services.    The  Assessment  which  is  taken 
by  about  one  million  college  bound  students  is  the  formal  name 
of  the  best  that  is  the  foundation  of  ACT*s  services. 
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of  conflicting  state  laws  that  regulate  test  agencies.    To  ^ 
demonstrate  that  passage  of  H.R.  1662  is  ill  advised  and  unnecessary, 
the  experionces  of  ACT  in  New  York,  the  changes  in  ACT  policies 
governing  public  access  to  the  Assessment,  and  the  changes  in  hand 
scoring  policies  rfiade  by  ACT  since  the  effective  date  of  the 
New  York  law  will  be  reported  and  discussed  in  this  stateroont. 
ACT*s  Expor ijgnc e  in  New  York. ^ 

In  ti>sbimony  before  the  Subconunittee  on  Elen^entary,  Secondary, 
and  Vocational  Education  on  September  10,  1979,  ACT  reported  thnt 
coinpliance  with  tiic  Now  York  law  would  require  a  reduction  in 
'test  dates,  or  test  availability,  in  New  )fork,  thereby  serioudy 
inconveniencing  students.     In  addition,  ACT  predicted  that  advantaged 
ijludcnts  were  more  likely  than  disadvantaged  students  to  obtain 
released  test  materials,  a  result  of  the  legislation  that  was  clearly 
unintondcd.    Evidence  gathered  to  date  suggests  that  ACT's  concerns 
were  well  founded  with  regacd  to  the  Assessment.    ACT's  experiences 
are  summarised  below: 

1.    Because  of  the  United  avallabiUty  of  tests  for  release 
to  the  public  as  required  by  the  amended  New  York  law, 
ACT- reduced  its  test  dates  in  New  York  from  9  to  6. 
•2.    The  reduction  in  test  dates  has  been  accompanied  by  a 
reduction  in  the  number  of  students  who  take  the  ACT 
Assessment  in  New  York.     Since  the  effe.:tive  date  of  the 
New  York  law,  approximately  4,000  fewer  students  have  taken 
the  Assessment  each  year  th^  during  the  test  year  preceeding 
the  effective  date  of  the  law.    These  ^,000  students  did 
not  receive  useful  and  unique  data  about  themselves. 
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For  example/  they  did  not  receive  an  interest  profile 
which  is  a  integral  part  of  the  ACT  Assessment  and  .^hich 
is  useful  in  planning  for  college  and  careers. 

3.  -s6CT  will  spend  several,  hundreds  of  thousands  of  dollars 

to"incr>ase  test  production  to  replace  tests  retired 
at  an  a  ccel  ear  a  ted  r^a^e^as  required  by  the  New  York  law. 

4.  Since  the  effective  date  ot  tbe^ New  York  law/  very  few 
student^  have  requested  and  obtained^-COp^ips  of  their 
Assessment  test  materials.    Specifically/  less  Chan^ 

.2  percent  of  I  percent  (115  out  of  79,^723  students  who 
have  taken  the  Assessmdht  in  New  York  since  January  1/  1580) 
have  reques».ed  and  received  copies  of  their  Assessment  test 
materials.    To  paraphrase  Winston  Churchill  1^  never  has 
ACT  expended  so  much  for  the  benefit  of  so  few.  More 
importantly/  the  extremely  low  demand  for  Assessment 
materials  caused  ACT  to  carefully  consider  the  appropriate 
use  of  student  fees  to  support  changes  in  existing  policies 
and  procedures. 

5.  The  115  students  in  New  York  who  have  ordered  copies  of 

•    their  Assessirent  test  materials  are  not  representative  of 

ACT  tested  students.    For  example/  their  average  ACT  composite 
test  score  was  24.2  or.  a  scale  pf  1  to  36  with  an  average  * 
score  of  about  19/  85.9  percent  reported  having  a  P  or 
higher  grade '^average  in  high  school/  54.3  percent  reported 
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their  family's  income  as  $20,000  per  year  or  higher.2 
New  York  students  who  requested  copies  of  their  test 
materials  were  decidedly  advantaged  according  to  traditional 
indlcies  of  relative  -advantage." 
After  repeated  assurances  from  witnesses  during  previous 
Uegislafcivc  hearings  that  student  demand  for  access  to  test  materials 
Ls  very  strong,  the  exceedingly  small  proportion  of  New  York  students 
who. have  reguestod  copies  of  their  Assessment  materials  may  be 
surprising  to  some.    ACT  was  not  surprised. 

•      ACT  expected  Uttle  demand  in  New  York  and  would  expect  little 
nationwide  demand  for  access  to  their  Assessment  materials  wore 

H.R.sX662  enacted  because  relatively  few  students,  about  4  perceat 
of  cill  -toslod  students,  take  the  Assessment  more  than  once, 
i.e.  "retake"  the  tes\.    Given  the  relatively  few  students  who 
retake  the  Assessment,  the  low  demand  for  disclosure,  i.e.  access  • 
to  tost  materials  shoVtly  after  tests  are  administered,  by  New 

"Vork-^^tudents  was  expected. 

llTb^^hiuhc^  for  disclosure  by  New  York  students  was 

reported  by  the  Coll&gc^oar<J  in  previous  testimony.  Because 
stuJents  be-lieve,  often  mi^^Oy^at  their  performance  on  the 
SAT  determines  their  admissability^S^Ueges,  substantially 
greater  proportions  of  students  take  the  SAT^^an^  (eithor 


2comparable  data  for  all  New  York  tested  f  "^^"^^f.^^^^^  rep^rn 
their  average  ACT  composite  score  is  20.0,  56-0  percent  P 
B  or  Ivigher  average  high  school  gi^ade,  and  36  percent  a  ramiiy 
income  of  $20,000  or  higher. 
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by  taking,  the  PSAT  before  they  take  Ihe  SAT  or  by  retaking  the 
SAT) .    Based  on  the  greater  proportion  of  students  who  retake  the 
SAT,  it  would  be  reasonable  to  expect  greater  proportions  of 
New  York  students  who  have  taken  the  SAT  to  obtain  copies  of  their 
SAT  t.cst  materials.    To  avoid  misunderstanding,  it  should  be  made 
clear  that  according  to  figures  reported  during  the  previous 
hearings  on  H.R,  1662,  the  proportion  of  New  Yo*'k  students  who 
obtained  copies  of  their  SAT  test  materials  was  small,  about  5  pcrrcnt, 
but  substantially  higher  than  comparable  figures  repotted  by* ACT 
although  the  procedures  students  follow  for  obtaining  copies  of 
test  materials  were  similar.    Clearly,  differences  sin  student  demand 
to  , review  coi/ics  of  test  JiiiteriOls  are  directly  and  primarily 
related  to  students*  peicQptions  about  the  use  of  particular  tests 
in  admissions  decisions,  '  ^ 

In  sunypary,  ACT'j  experiences  in  New  York  have^ tended  to 
substantiate  its  concerns  about  the  Kew  York  law  and  legislation 
such  as  H.R,  1662,     To  the  detriment  of  tests,  test  agencies, 
students,  and  colleges;  such  legislation  doeS  not  respect  the 
substantial  differences  among  tests,  test  agencies,  test  usage, 
and  student  demand  for  disclosui^e.     Therefore,  passage  of  H.R.  1662 
is  ill  «idvisGd.  ,   .  ' 

Changes  in  ACTPpAiciesS^nce  January  1,  1979. 

While  act's  experiejices  in  New  York  support  its  view  that 
enactment  df  H.R.  1662  is  ill  advised,  ACT  has  taken  action^  that 
make  H.R.  1662  unnecessary.     Like  other  test  agencies,  ACT  has 
(a)  modified  its  policies  governing  public  adcess  to  the  Assessment 
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and  <b)  expanded  its  scoring  services  as  reported  "below. 

ACT  has  modified  its  policies  governing  public  access  to  the 
Assessment,  just  as  other  test  agencies  have,  according  to^its  test 
development  capabilities,  the  psychometric  foundations  of  its  test, 
the  primacy  use  oC  its  test,  and  student  demand  for  the 
disclosure' as  demonstrated  by  New  York  students.     Prior  to 
September  1,  1981,  ACT  routinely  provided  copies  of  the  Assessment 

^    to  scholars  and  college  faculty  members  upon  their  request. 

^     Beginning  this  Fall,  ACT  also  will: 

1.  send,  at  the  beginning  of  each  test  year,  a  copy  of  a 
recently  retired  ACT  Assessment  to  each  high  school  that 
received  one  oc  more  test  score  reports  during  the  previous 
test  year  and  to  any  other  high  school  that  requests  a 

e 

copy  of  the  test. 

2.  invite  students  to  order  up  to  two  recently  retired  forms 
'of  the  ACT  Assessment. 

Both  change^^ reflect  ACT's  experiences  in  New  York,  ACT's  retest 
rate,  and  the  concerns  ACT  has  raided  about  H.R.  1662  and  similar 
legislation  in  previous  legislative  hearings.    Under  these  changes 
students  will  have  access  Lo  retired  forms  of  the  Assessment  before 
they  take  the  test.     If  there  are  benefits  to  be  derived  from 
receiving  retired  copies  of  the  Assessment,  these  benefits  will  be 
.    realized  before  the  tests  are  first  taken.    ACT  will  not  encourage  or 
cause  an  increase  in  unjustified  or  unnecessary  retesting,  a  possible 
consequence  of  the  adoption  of  more  extensive  disclosure  policies. 

Because  the  two  forms  made  available  to  students  will  be  different 
forms  than  the  one  sent  to  high,  schools,  and  because  all  three 
forms  will  be  ones  recently  retired,  all  forms  of  the  Assessment 
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will  be  available  for  public  roview  after  they  are  retired. 
Consequently,  the  public  will  eventually  have  access  to  all  forms 
the  the  Assessment. 

In  addition  to  {providing  greater  public  access  to  the  Assessment, 
ACT  has  expanded  its  hand  scoring  services.    Prioxt  to  September  1, 
1981,  ACT  hand  scored  upon  request,  and  at  no  charge  to  students, 
answer  sheets  iit^ts  Iowa  City,  Iowa  headquarters.    Beginning  in 
the  Fall  of  1981,  AC^«Vill,  upon  request,  provj^de  hand  scoring 
services  at  loctjtions  wfhere  students  can  conveniently  observe  and 
»    verify  their  scores.    Should  the  hand  scoring  be  done  in  ACT's 
.   Iowa  City  headquarters  or  in  one  of  ACT's  13  Fegio»al  offices,  no 
fco  will  be  charged  to  students.     Hand  scoring  at  other  locations 
will  be  arranood  at  the  request  Of  students  although  an  appropriate 
—  f ^e  may  have  to  be  charged  if  additional  costs  are  incurred. 

Accordingly,  beginning  this  Fall,  harvd  scoring  services  have  been 
expanded  without  incurring  substantially  increased  costs  that  are  ^ 
disproportionate  to  the  demand  for  score  verification  as  experienced 
in  New  York.  " 

Although  the  changes  reported  above  may  be  characterized  *"»s 
expansions  <^  existing  policies,  they  wore  not  made  hastily.  They 
reflect  ACT's  concerns  about  the  consequences  of  disclosure  on 
tests,  tost  usage,  students,  and  postsecondary  institutions. 
Similarly,  actions  other  test  agencies  have  taken  in  response  to 
the  New  York  law  and  pre^jiious  state  and  federal  legislative^ 
initiatives  reflect  the  psychometric  characteristics  of  their  tests, 
the  uses  of . their  tests,  and  the  demand  of  students  for  their  test 
materials.    Consequently,  passage  of  H^R.  1662  is  unnecessary. 
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The  Future.  •  » 

Just  as  ACT  has  modified  and  expanded  its  policies  governing 
public  access  to  the  Assessment  and  its  hand  scoring  Services 
according  to  its  experiences  in  Now  York  and  its  best  judgment 
about  ways  of  responding  to  proponents}*  concerns  about  tests  and 
their  uses,  other  changes  such  as  accelerating  public  access  to 
retired  fornts  of  the  Assessment  will  remain  under  stody.  Such 
changes  will  be  made  if  ACT  is  confident  they  will  achieve  their 
intended  purposes  without  (a)  jeopardizing  the  quality,  value, 
and  availability  o£  the  Assessment,   (b)  burdening  students  with  * 
additional  cosp  for  unwanted  services,  Or  (O  adversely  affecting 
educational^^  admission  processes.    Using  the  same  criteria,  ACT 
has  a  lustrious  history  of  responding  at  its  own  initiative  to 
concerbs  about^ testing  and  improving  tests  and  their  uses.    The  ^, 
recent  changes  in  policies  as  reported  in  this  statement  are  the 
most  recent  additions  to  this  history  and  protide  the  foundation 
for  future  changes  in  policies  and  programs. 

Because  H.R.  1662  is  ill  advised  and  unnecessary,  ACT 
respectfully  urges  that  the  Bill*not'be  passed.    I  will  be  pleased 
to  answer  any  questions  the  members  of  your  subcoiwnittees  may 
have  about  ACT  and  its  position  on  H,R.  1662. 
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Dr. 'REvER^  .In  short,  the  American  college  tesling  program  op- 
poses the  passage  of  H.R  1662  for  the  same  reasons  it  has  opposed 
similar  legislation  introduced  in,  23  other  States  and  in  the  96th 
Congress. 

ACT  views  H.R.  1662  as  both  ill  advised  and  unnecessary.  It  is  ill 
advised  because  it  mandates,  uniform  test  disclosure  policies  on  all 
test  agencies  without  regard  to  tl^e  substantial  differences  among 
tests  in  their  psychometric  foi^dations,  their  purposes  and  uses, 
and  the  student  demand  for  disclosure  as  demonstrated  in  New 
York. 

H.R.  1662  has  been  made  unnecessary  in  our  view  by  the  volup- 
tary  efforts  of  test  agencies  to  Respond  to  the  concerns  about  tests, 
about  test  uses,  and  test  agencies  in  previous  legislative  hearings. 

Let  me  briefly  summarize  ACT's  experiences  in  New  York  that 
have  reinforced  AGT's  opposition  to  H.R.  1662. 

First,  you  should  know  that  ACT  has  complied  with  the  New 
York  law  within  its  capability  to  do  so  which  is  severely  con- 
strained by  the  number  of  available'^* tests  to  be  made— to  be  di^s- 
closfed'^'at^'ah'  ac^eterat^  rate*WTequifed~by^he-^New"York^^ 
Since  the  New  York  law  became  effective  on  January  1,  1980, 
79,723  students  have  taken  the  assessment.  Of  the  79,723  students 
less  than  two-tenths  of  1  percent,  or  to  be  exact,  115  students  have 
requested  and  received  copies  of  their  assessment  results  and  mate- 
rials. The  students  who.  have  requested  copies  of  their  assessment 
materials  in  New  York  are  clearly  advantaged  according  to  tradi- 
tional indices  of  relative  advantage,  and  I  have  provided  those  inci- 
dents in  my  .prepared  statement.  ^  ^ 

After  hearing  repeated  assurances  from  witnesses  in  previous 
iegislative  hearings  that  student  demand  for  disclosure  would  be 
very  strong,  some  may  be  .surprised  at  the  low  demand  for  disclo- 
sure for  ACT  assessment  materials.  To  the  contrary,  ACT  was  not 
surprised  because  only  4  percent  of  the  students  who  take  the  as- 
sessment each  year  take  it  oh  more  than  one  occasion,  that  is  they 
retake  the  test  This  low  re  test  rate  can  be  compared  to  higher  but 
low  retest  rates  of  higher  retest  rates  of  other  testing  jirograms. 
The  low  request  rate  for  ACT  assessment  materials  in  tht  State  of 
New  York  can  be  compared  to  higher  but  low  request  rates  re- 
ported by  the  college  board  during  the  July  hearings  on  H.R.  1662. 

Since  both  the  college  board  and  ACT  use  similar  procedures  for 
informing  students  about  disclosure  and  for  students  to  follow  in 
obtaining  copies  of  their  test  materials  and  because  other  test  agen- 
cies have  reported  quite  different  request  rates,  liotably  the  law 
scTf6^)l  admissioajcouncil,  it  is  clear  that  the  dominant  factor  that 
determines  request  rat^  for-testjnaterials  are  the  student  percep- 
tions about  the  use  of  particular  tests  and~admissions  decisions. 

In  summary,  ACT's.  experiences  in  New  York  confirms-its.^opin- 
ion  that  H.R.  1662  is  ill-advised. 

To  move  to  another  point,. ACT  believes: that  H.R.  1662  has  been 
made  unnecessary  by  the  voluntary  actions  of  test  agencies  to  re- 
spond to  ihe  concerns  that  have  been  raised  by  the  bill's  propo- 
nents during  previous  hearings.  In  fact,  in  light  of  its  experiences 
in  New-  York,  ACT  has  modified  its  policies  governing  public  access 
to  the  aSfijessment,  and  we  have  exj/anded  our  hand-scoring  services 
that  haverbeen  made  available  to  students.  " 
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Prior  to  September  1,  1981,  ACT  routinely  made  available  copies 
of  trACrlL88m.nt'to.8cholars  and  college  faculty.^^^^^ 
their  use  and  study.  Beg  hning  m  the  fall  of  1981,  this  iall,  AUi 
alS  wuT^Sd  one  copy  if  a  reSent  retired  assessment  to>ch  high 
^hooTin  the  countlVVhat  received  a  score  report  the  preceding 
tS  yel?  and  to  oth^  high  schools  that  request  a  copy  of  the  m- 
Sument.  ACTwill  ajso  invite  stu^nts  to  order  up  to  two  copjes  of 
rpcentlv  retired  forms  of  the  assesOTi^dnt.'    '      ^  i.  n 

changes  mean  that  all  forms  of  the  ACT. .assessment  will 
eventually  be  made  available  to  the  public.  Beginning  m  .the  fall  of 
1981  ACT  will  expand  its  hand-scdring  services^' provide  scoring 
Tulcations  stu^^^^  find  convenient  for  obsen^ing  and  vYifymg 
the  scoring  of  their  answer  sheet.  In  previous  years  ACT  has  hand-- 
sJSrS  at  So  charge  and  upon  the  student's  f  m 
in  its  Iowa  City.  Iowa  headquarters.  Beginning  this  fall,  ACT  will 
offe/thT^me^rvice  at  its  Iowa  City  headquarters  and  will  offer 
that  ii^iS^hrough  its  13  regional  oftices,  and  scoring  will  ^so  ^ 
conducted.at  .other  locations  as  requested  by  the  students  although, 
-a-small-fee  and-an^-appropriate-fee-may_J)e_charged  should 


costs  be 
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incurred  in  making  those  arrangements.  • 

In  summa^i!  we  believe  that  the  bill  before,these  twasubcommit- 
tee?  is  ill-advised  and  unnecessary,  and  let  me  just  speak  for  a^ 

"STL"  ACT  ^^^^^^^^  and.  expanded  its  policies -governing 

Dub^c  Mc^  to  the  assessment  and  its  hand-scoring  services  ac- 
?oSiy&  expS^^^  in  New  York,  and  its  best  J"dgnent 
about  Wavs  of  responding  to  proponent's  concerns  about  tests  and 
S  usS^other  c?anges%ucE  ^accelerating  pu^^^^  accey  t»  re^ 
tired  forms  of  the  asaessrnen  will  rtmam  . under  sjudy^  Suc^ 
rhanffes  will  be  made  if  ACT  is  confident  that  they  will  acnieve 
SSSteTded  puTp^  without  (a)  iecvardizing  the  f  ahty,^alue, 
and  availability  of  the  assessment,  (b)  ff?..7ni  Ju  • 

dPt^nal  costs  for  unwanted  serviqes,  or-(c)  adversely  affecting,  edu- 

*^UrifhT^me%STACT  has  an  illustrious  history  of  re- 
spond at  iteS.niniTiative  to  concarhs  about  testing  and  improv- 
iS  Sf  and  their  uses.  The  recent  changes  in  policies  as  reported 
5  m7?re  Ari  statement  are  the  most  recent  additions  to  this  his. 
toi^^^and  provide  a  foundation  for  changes  in  the  futurg 

1  would  be  .pleased,  to  respond-to  the  questions  that  you  and  your 
members  may  have,  Mr.  Chairman.  .     ,  , 

Mr  WeT^  Dr.  Rever,  thahk  you  veiy  much  Apm,  for  the 
recoJd,  let  me  see  if  I  can  get  from  you  <^^riain  factual  informatio^ 

What  is  the  number  of  students  annually  who  take  th^-the  ad- 

'TXv^rTffit&yffiffi^^^^^^^^ 

over  1  mill£n  students  took'the  ACT  assessment  nationwide. 

Mr  Weiss  Ahd^  would  you  have  any  information  as  to  how  much 
of  an  overlap  th^re  is?  What  Pe'-.'=«n*f?«iy°" 
know,  of  your  students  also  are  required  to-or  do,  in  tact,  taKe  tne 

'^Dr^^REV^E^ that  information  is  quite  elusive  de- 
soS^  ouflSt  efforts  to  obtain  it,  and  we've  not  been  successful  m 
Sg  that^ere  obviously  would  .be  some  overiap,  but  primarily 
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those  students  who  would  take  both  examinations  are  those  who 
probably  are  located  in  different  parts  of  the  country  applying  to  a 
nuipber  of  different  institutions  that  would  require  one-test  qver 
th?  other  or  vice  tersa.  For  example,  as  you  may  recall  from  our 
.previous  testimony,  ACT  tests  roughly  35,000  students  in  the  State 
of  New  Y.^rk.  I  woyld  guess  that  many  of  those  students  may 
indeed  also  take  the  scholastic  aptityde  test,  though,  I  don't^know 
what  that-proportion^may  be  simply  l>ecause  they  may  be  applying 
,to  institutions  in  the  State  of  New  York  which  would  typically  re- 
quire the  scholastics  aptitude  test,  but  at  the  same  time  they  may- 
be submitting  an*  application  to  a  school  say  in  New  Mexico  in 
which  the' typical  institution  will  require  the  ACT. 

Mr.  Weiss.  Agajfi,  for  the  record,  in  very  brief  shorthand  terms, 
can  yojn  give  us  a  description  of  the  differences  between  your  test, 
the  American  college  assessment  test,  and  the  scholastic  aptitude 
test?  , 

Dr.  Rever.  I  can.be  very  brief.  We  believe  o^rs  is  better. 
Mr'  Weiss.  That's  not  a  description. 

Dr.  Rever.  I'm  sorry.  Our  examination  was  developed  initially  in 
1959  and  it  has  four  subparts.  It  is  characterized  by  the  Burrough's 
Mental  Measurements  Yearbook  as  an  achievement  examination 
that  is  reflected  in  the  title  of  the  its  four-  sabtesfs.  We  have  One 
subtfisLjon  English  usage,  one  subtest  on  mathematics  usage,  one 
Snnatural  sciences,  and  one  on  social  studies.  The  examination 
was  not  intended  to  be  based  jDn  experiences  of  the  college  board 
and  ETS  in  their  examination  was  ni)t  intended  to  be  a  SQ-called 
aptitude  examination,  and  I  think  the  kinds  of  examination  item 
that  appear  on  the  examination  would  be  judged  by  most  observers 
as  highly  related  to  the  kinds  of  curriculum  content  in  high  schools 
and  are  less  abstract,  if  you  will,  than  the  scholastic  aptitude 
items.  / 

Now,  you  know,  that  those  kinds  of  statements  are  overgenerali- 
zations  obviously,  biit  I  think  there^  ave  some  recognizable  differ- 
'  ences  between  the  examinations  if  they're  laid  side  by  side  and  one 
can  review  them,  and  that's  quite  possible. 

Mr.  Weiss.  Have  you  done  .any  studies  or  has  anybody  done  any 
studies  ,fbr  correlation  as  to  the  scores  on  those  tests  and  perform- 
ance records  in  college? 

Dr.  Rever.  Indeed  we  have.  We  have  probably  some  studies,  and 
I  will  be  happy  to  make  them  available  to  the  .subcommittees  on 
the  relative  predictive  validity  of  our  examinations.  In  other  words, 
we  have  some  institutions  which,  and  this  may  in  fact  for  your  in: 
formation,  be  a  pattern  that  has  been  emerging  for  a  number  of 
years,  iii  which  institutions  will  acQept  results  from^  either  the  ACT 
assessment  or  the  college  board  scnolastic  aptitude  test  for  admis- 
sions purposes.  In  some  cases  we  have  identified  institutions  in 
which  there  were  sufficient  quantities  of  data  available  for  stu- 
dents who  submitted  scores  for  the  SAT  and  for  the  ACT  Assess- 
ment in  which  regression  equations  or  predictive  validity  could  be 
established'/In  essence,  I  can  summarizelhose  for  you. 

Both  examinations  studies  the  predictive  validities  of  both  exami- 
nations produce  comparable  results.  In  other  words,  both  examina- 
tions are  about  equally  predictive  of  first  year  college  grades.  That 
-may-vary  from  institution  to  institution,  and  I've  given  you  a  gen- 
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cralization,  biit  I  can  provide  you  the  data  we  have  as  a  result  of 
oUr  sCudies.  i i_  i 

.Mr.  Weiss.  Whatever,  materials  you  can  provide  would  be  wel- 
come. Have  you  submitt^  to  us  a  retired  test  for  purposes  of  inclu- 
sion? .      ,  *  ^  _ 

Dr.  Rever.  I  neglected  to  bring  some  but  I  will  see  that  they  are 
delivered  to  the  subcommittees  tomorrow. 

Mr.  Weiss.  They  will  be  entered  into  the  record. 

[The  information  referred  to  follows:] 
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TESTI 
ENGLISH  USAGE 

40  Minutes—yS  Questions 


:  \n  \h9  pauagM  that  lolW.  ;ctij«  ft 
th«  riflht-hiSlwiuiiin  yw»  will  Had 

prUM  »of  tiandard  writt*n  Enaliatn^j^lfiword^l  mo»t 
conMtantfy  with  tht  »tyto  and  tona  of  thTpw 
awtiola  ChooaathaaHarnativayoucontidarc 


btackan  tha  corraapondirig  spaca  on  you  anawaj 
shaal  H  you  think  tha  original  varaton »»  baat.  chooaa 
-fSo  CHANGE  -  Raad  aach  P<«W  thr.ough  onca 
teioia  you  bagin  to  anawar  tha.quwtiona  which 
Scomwny  itVou  cannot  datamiina  moat  anawara 
JSttSS?r!adViIvar»i  saotancaa  bayond  lha  phraaa 
In  qClatlon.  Ba  aura  ihat  you  hava  raad  far  anouQh 
ahMd  aach  tima  you  chooaa  an  attamattva, 


enin4 


M»ny  people  thint  of  Ihe  deKrt  a*  birren  *r 
dc4oUle.  but  a  vi»it  to  Death  Valley  dapeiwet  »Och  an 
opinion.  f)ealh  Valley  National  Monument  often  «  many 
ailfacttoni  /or  the  towwt  thin  any  >cenic  area.  \ 


The  valley  center  comiiu  of  a  mIi  like  that  had  almott 
dried  up:  close  tmpcciion  of  the  like 
revtaIi-4«ltjtry»laU  in  infinite  var«tion», 
Driving  to  I^nte^  Point  from  the  lake,  a  hatf  hqur'»  driye, 
where  you  can  view  the  highest  and  loW«»t  poinw  in  l 


continenul  United  Sute*.  In  an  hour'*  dnve.  you,can  m] 
a  fhott  town,  hike  upTekicope  Peak>  expionni  any  o^^ 
•Hhe  colorful  canyon*,  or  climb  down  into  a  volcanic  crater  i 
A  »hort  trip  will  take  you  to  the  cante  cowtrutied  by  \ 
miUionaire  Albert  Johnion.  iuiU  in  the  middle  of  the  ^ 
desert,  the  ca»tle  jock  ten  yean  to  complete,  Although  ^ 
[>eath  Valiey  remain*  open  all  year,  the  *ummer  i 
month*  e^endrng  from  May  through  October^  i*  too  hot  la 
be  enjoyable.  De*pite  thi*  extreme  heat  and  lack  of  raii. 


I.  A.  NO  CHANGE 

I.  dUpOK* 

C  diapeU 

D.  tmpeU 

X  V,  NO  CHANGE 

G.  from 

H.  a« 

'  J.  HMt 

\  A.  NO  CHANGE 

I.  hM- 

C.  had  been 

D.  was 


4.  F.  NO  CHANGE  ,      ^  ,  . 
•C.  When  you  dnve  to  Dante'*  Point  from  the  Uke.  a 

haU  hour'*  drive.         '      .  .  , 
H.  A  half  hour'*  drive  from  Ihe  lake  lake*  you  to 
'  "Dante's  Point,  where     t  r»  .  •  o  •  . 

J.  After  you  uke  a  half  hour'*  d  rive  to  Dante  *  Point 
from  Ihe  lake. 

5.  A.  NO  CHANGE  , 
B,  explore 

C  you  can  explore 
D.  can  explore 


A.  F.  NO  CHANGE  ,  „ 

C.  (Do  NOT  begin  new  paragraph)  Becauje 

H.  (Do  NOT  begin  new  paragraph)  Even  though 

J.  (Begin  new  paragraph)  Although 

7  A.  NO  CHANGE  ^  ^ 

B  month*.  exter.din|  from  May  through  October,  are 

C.  month*,  extending  from  May  through  October  are 

D.  months  extending  from  May  through  October  i* 
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vanou$  fornw  of  hfc  flourMh;  the  many  pl*m»  and  anicrub 
liviitf  in  Death  Va!te>Vra<>mtfatts  Dirwin'i  theory  (ha( 

lho*e  «l»o  $u:vivr  muil  adapt  to  jui  cnofOttmettt 


t,  F.  NO  CHANGE 

G.  dcmonttrated 

H.  >»i)i  dcmonMratc 
j.  demonstrate 

>^  A.  MO  CHANGE 
its 

D.  their 


FMMf*  It 

h\ef}  society  Ms  cuMom%  4nd  beliefs 
that  arc  m«ninflul  to  wme  people;  iirationat 
to  others,  These  notj^ns.  IfeHUcrttly  cajlcd 
»upeiM>tions,  are  often  based  on  fear 
of  Hie  utiknoi*n  or  oft  tcUg^wixi  behcfs. 
N«vertlKles».>it  «  considered  bad  lock  - 

f 

to  tpil!  Mit  inasmueh  *i  Judiif  spilled  it 

4t  the  Ust  Supper  Crossing 

onc\  ftnjers  4rc  PMot  ac«  acknowfcdfinR 

~~»""^  •  ^ 

the  exwtence  of  a  supernatural  being 

The  d^yatwn  of  most  *uper5t«ion> 
hat  been  forgot  I  en  People  wJKo  engage 
in  superstitious  pfact»ces  today  do  lO 
without  Knowing  qu«tc  why  Most  peopk  do  not 
seriously  beheve  i^at  breaking  a  mrrro^r 
v,i)i  bring  »<%cn  year*  bad  Juck.  but  ihe>  accept 
this  superstUwn  m  a  spira  ol  fun  Thi*  superstition, 

hovtcver.  originated  m  an  age  when  a  rellectton  » 
consrdercd  part  of  the  «>u!  MIrrof  breakage  >»4t  thus 


II.  F.  NO  CHANGE 

G.  people.  Artd 

H.  people. 

J.  people:  or 


II.  A.  NO  CHAN'Ge 
P.  In  addition, 

C,  For  cKample. 

D.  OMlT'and  begin  setHence  Swilh  If 

12".  F,  NO  CHANGE 

G.  due  to  the  faa  thai 

H.  because 

i.  for  the  simple  reason  that 

13,  A.  NO  CHANGE 

I.  tj  a  ph)sicaJ  act 

C  /cpre*eni$  phvsicai  acts 
D.  represent  a  ph>$ical  act 

14.  F,  NO  CHANGE  ' 

G.  (Hegio  t»cw  paragraph)  Dcnving 

H.  (Do  NOT  begin  new  paragraph)  The  deriving 
J.  (Do  NOT  begin  new  pA'agraph)  l>erivinf 


c-  15.  A.  NO  CHANGE 
I.  >ar>'  ot 

C.  >ear^of 

D.  year's  of 

U,  F.  NO  CHANGE 

G.  being 

H.  will  be 
J.  wnt 


GO  ON  TO  THE  NEXT  MGE. 
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a  scriow  McUcm.  Even  ibe  rilual  of  wunnf  a 

waddMBf  nnf  hMjf  btw  tn  $upcrititK>n. 

'A  wootfQ  wean  a  nng  on  the  third  finfer  of  her 

left  Imwl.  rt'«  an  ancient  belief  that  a  von  mm  from 
n 

O 

a  nairr  to  the  heart.  The  weddmf  nng  Mill 
** 

t^boiim  the  fivut(  of  the  heart  wtib  the  hand. 

s 


17.  A.  NO  CHANGE 

1.  hand.  lecauK  <A 

C.  hand  bacaiMC  of 

O.  handf  which  it 

It.  F.  NO  CHANGE 

G.  that 

H.  one 

J.  your 


ThM«  p«rMr*pt»  may  or  may  not  b«  in  iha 
mo«t  'ooical  order.  Th«  iatt  itam  will  aak  you  to 
chooaa  m«  moat  togtcal  ordar. 


The  formal  tradition  sififted  in  the  ei|hte*nlh 
ccnlary.  when  >lave  poew  began  to  u»e  contemporary 
fornu  to.wnle  about  featiiiic  Jubje^tt.  It  continued  into 
the  nineteenth  century,  a(  black  poeii  added  their 
voice*  to  the  clamor  for  abolition.  At  the  turn  of  the 
century.  F»ul  Laurence  Dunbar  wai  wrilinf 
lyrics,  for  capturing  »pectt  of  folk  life  »nd  that 
were  often  in  dialect. 

(2)  ^ 

Two  different  tradition!  have  Unlribuled  to 

the  development  of  modem  black  poeiiy.  The  VvtW  of 

these,  ^he  folk  tradition  beyni  m  the  seventeenth 

'  '  '  It 

centuiy.  shoriiy  after  Afncani  were  firit  brought  to 


If.  A.  NO  CHANGE 

i.  lynct,  to  capture 

C.  b^rKi  that  captured 

O.  Vrict.  that  captured 


2a.  F.  NO  CHANGE 

G.  tradition,  beginning 

H.  tradition  ha(  begun 
J.  tradition,  bepn 


00  ON  TO  THE  NEXT  MQC. 
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Anvrk*  itmifaif  to  $Uv«s.  Combmrng  tbetr  memories 
II 

-of  Africa  with  their  «»feri«ncet  in.Amena,  sUve  unfcr* 
composed  various  songs  »nd  spmtuals  to  express  their 
feelings  about  slaveiy.  ' 

(3) 

rhc  bfcisdtni  0/ ih<^  iraJitions  can  be  seen  in 

/noch  twentieth-<cmury  black  verse, 

iamct  WeUon  Johnson  praised  his  anon>moui 

predeocsiors  m  "0  Bbck  and  Unknown  Bards." 

Concaininy  many. allusions  (0  the  spuuuab.  this  poem 

^1$  a  ftne  example  of  the  um  oI  folk  nutcruls  by  a  formal 

poct>  Pwrwf  the  Harlem  Renaissance  of  Ih^  twenties. 
11  » 

black  poets  uaed  techniques  and  subjects  from 

folk  life  essentially  for  their  poetry. 
u  " 

t 

Thus,  ja/x  and  bfues  rhythms,  fhetto  experwnceti  and 

"■"W" 

black  sfeech  has  become  viul  elements  of  this  poetry. 


.  A.  NO  CHANGE 
1.  as 

C.  m  the  manner  of 

D.  just  Ike  ^ 


22.  \\  NO  CHANGE 

G.  Ken'dint  these 

H.  rhe  tridilions 

J<  Such  traditional  blending 


23.  A.  NO  CHANGE 

B.  poet,  dunnf 

C.  poet  during 

D.  poet  of 

24.  F.  NO  CHANGE 

G.  at  essential  elements  of 

H.  for  essential  elements  to 

J.  foi  the  elements  which  are  essential  to 

25.  A,  NO  CHANCE^ 

B.  Ho  woe  n 

C.  Nevertheless. 

D.  OMIT  and  begin  .sentence  with  ^azz 

U.  F.  NO  CHANGE 

G.  vn!f  become 

H.  became 

J.  have  became 

27,  Choo«  the  sea»ence  of  paragraoh  numbers  that  will 
make  the  esuy^s  stmcture  most  logical. 

A.  NO  CHANGE 

B.  1.3.2 

C.  2,  I,  3 
2.  3.  I 


IV 

Jane  Austen's  reputation  ha\j|rown 
so  steadily,  that  the  bicentennial  F.  NO  CHANGE 

■"  -  steadily 

celebration  bf  her  binh  confirmed  her  J|'  stSdyr 

5  00  ON  TO  THE  NEXT  MOC. 
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fum  u  *  wnMT  Ml  jttM  for  M  age. 
M  f«r  all  IMV.  BacMNt  Imt  ux 
sowifcycw  yfclitfciJ  aitowymou*.  her 

■NiMiiy         kcr  lilOtMe  «u 
Imr.  ahc  k  diinihii  «  few  writtn 


29.  A.  NO. CHANGE 

.  «aonymou»  (without  h«r  lunw). 
C  uoknown. 
0.  anonymouily. 

3$.  rl  NO  CHANGE  ' 
mmfku,  now 
H.  comftetc^-^  Although 
j.  complete.  Now. 


iom  m  the  year  of  ibe  Ameikftn  RevohrtwA* 

ih»  1*0  WM  icvokHioMfy  i«  hdng  Ensten^i  Hnt  lady 

of  IkciratHrr,  Dim  to  muniinj.  the  charted 
ji 

a  aew  oonne  for  the  novel  o(  raaUun. 


Sit  Wateer  Sco<t«  ty  the  twentieUi 

'  N 

•MMary.  iha  became  the  object  of 
«  orit  KapHit^t  term  for  such 


Jmcitae  contider  Autten  no  lew  a 
writer  rather  an  Mcue.  Thoee 


/    reoden  who  hii  lo  appreciate  her  art 
hMfced  ttpoa  a«  dcTidctH.  Not  to  like 
Jane  »  to  he  pencnaUy  aiadequate 
aad  to  lack  hwedim.  Therefore,  a- 
mder  h  conpetled  lo  make  not  lolely 

-  ^  Vhleraiy  jiidgreeirt J  hwt  hmead  a 
ehaiader  revcletion. " 


31.  A.  NO  CHANGE 

Due  to  the  fact  of  her  MMCCM, 

C.  lecauee  of  the  fad  of  her  uioceee. 

D.  lecauee  of  her  luceeu. 


n.  F.  NO  CHANGE  ^ 

G.  thoK  of  Sir  Walter  Soott 

H.  that  of  Sir  Waher  Scott. 
J«   (hoc  of  Sir  Walter  Scok's, 


Si,  A.  NO  CHANGE 
i.  wa» 
C.  are 
D*  wai  to  he 


NO  CHANGE 


but 


G. 
H. 
•J. 


31  A.  NO  CHANGE 

B.  readen,  who 

C.  leaden,  which 
O*  reader*  whoever 


34,  F.  NO  CHANGE 
G.  hui  alto 
H*  but  III  addition 
J.  at  well  a< 


QO  ON  TO  THE  HUT  PAOC. 
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Conic  kook»  miy  W  ihc  moti 
widely  f«a4  nuM  iwdium  m  the  UnilW  Statn.-  » 
Fro«  tbdr  i«|inniH  >a  (he  ^ 
1930k  (^r  to  VofM  War  UK  comic 
booVt  hftvf  »PK«M  both  lo  youni 
ivJden  *fKl  to  »*ui».  Today  imllioiu 
of  comic  boofciye       each  month,  with 
a  "pMS  on"  pfob»Mc  rcadmhip  of  At 

4 

least  thm  for  each  ^mdual  copy  sold. 

Comic  booki  in  Iheir  familiar,  maga/ine.  forinat 

did  no!  appear  until  1933.  when  Fumtks  on  hnJe  wii 
«■ 

conceived.  Thie  maiaiinc  coniitted  of  ori|inal' 

retuns  from  Sunday  newspaper  com* 

Wripa  and  loM  for  ten  ceott.  ^ 

The/re  imttnt  popularity  prompted  lie  puWicaiion 

two  ycafi  later  of  comic  hooks  to  uac  ori|inat  material. 

m  ' 

After  193$<  comic  book  publication  be|an 
to  underteke  tremendous  propoflions.  In  1931.  a 
personality  named  Superman  appeared  in  Attion  ComUs, 


}7;fA.  NO  CHANCE  ^ 

'v.  1930$  (four  decades  a|0), 

C.  1930s  (when  tbev  orifinaled). 

D.  19)0s, 


3t.  r.  NO  CHANC£ 

G.  probnbie  (Place  after  with  m) 

H.  probably  (Plaee  after  wah  m) 

i.  probable  (PUce  after  rttderih^) 

39.  A.  NO  CHANGE 

V.  and  every 

C.  purrhaiad 

D.  OMIT 

49.  F.  NO  CHANGE 

G.  familiar,  matavne 

H.  familtar  raMU"K. 
J.  famihar  imiajine 

41.  A.  N6  change 

'  B.  1933.  whkh  was  when 

C.  1933.  When 

D.  1933.  m  which 

42.  F.  NO  CHANGE 

G.  all  new  ^ 

H.  only  original 
i.  OMIT> 

4S.  A.  NO  CHANGE 

B.  stnpesetbni 

C.  striff  which  sou 
'  D.  sinpt.  they  soU 

44.  F.  NO  CHANGE 
G.  Hk  comic  strips* 
R  lU 

J.  A  maiazine's 

45.  A.  NO  CHANGE 

B.  ttting 

C.  10  utiliic 

D.  and  usiof 

44.  F.  NO  CHANGE 

G.  to  assume 

H.  >to  uke  on 
J. ,  OMIT  » 


QO  ON  TO  THi  NEXT  PAQE. 
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'TiipiiiMi  in  til  Mifr  for  ■  Uirti  nam  of  hcroMjnth 


MM  «i4t  wafc^dty  for  nvkw  ud  yO^ngta^ 
mMmmI  mmbM  far  ^vMnmhhi.  Hrvcm. 

iiiiiriiii  M  prirt  MMC  ta)*kB  of  ^y»<ioMl^ 

W  tu1—wirariM.  it  itml  Evn  ^  Unkerf  SUM 


Mni'apgl  MM  th«  cwMc  Wok  foraai  «  ow  drive 
\  m 

tafcfa^jMMk  titoto  fo  umIi  >dwtific  hiKOfic,  >W 


47.  A.  NO  CHANGE 
B.  heroM,  hsviac 

D.  hcroM  wkh  ^ 


41.  F.  NO  CHANGE 


for  itvie*  m4.  to  jtid|e 
H.  to  Kvicw.  aa4  to  }ii4«K 
J.  to  review  Md  jttdie  - 


4$.  A.  NO  CHANGE 
B.  coauMmkatkm  arc 
C;  coauMiaicatioa,  arc 
D.  MMOumkatian  jt 

St.  F.  NO  CHANGE 

G.  lier 

H.  one's 
J.  itf 

51.  A.  NO  CHANGE 

B.  forihe  rutpoM  oT  taachtng 

C.  la  oriar  to  tMch  paopk 

D.  to  tkcy  can  laadi 


ia  tiK  DaMMWr  coU.  a  man  walk* 

alM^  tiK  haadi  ud  mttM  tha  laad 

*Mfra«iaf  hi«.  Winter  i*  an  unaiual 

imifU  MroUiat  tk«  Atlantic 

b«di  af  New  Jcfwy^  ika  rMMM 
II 

the  MM  i  Ikert  w  even  mare  uaiuual. 

■< 

IWackke  carriM  no  metal  detector 
•r  aaderiater  a^ui^menl.  th!t  nan  ii  a 


\ 


52.  F.  NO  CHANCE 
^G.  JcTMyand 
H*.  Jkrwy.  but 


^  J. 

53.  A.  NO  CHANGE 

B.  However. 

C.  NcvertheltM. 

D.  Evcnakhottih 


QO  ON  TO  THf  NEXT  PAOE. 
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iy  the  ilrtt^  of 
** 

J  ^  N«w  Jcrwy  ihotdia«,  S^oUh  pieces  of 

'  'm 

after  winccr  uomw.  Nonet hckM.  there 

IS  i  tmuire  trove  lomewherc  juM 

off^rc.  Mid  the  wind  and  wave  action 
ft 

sA  pAe\  briogs  jl^a»hore  bit  by  biu 
BecMUK  of  tu  qrclonic  nature, 
the  wind  here  feneraUy  backs  aroHnd 
to  the  wc«t  after  a  |ak  from  the  northeast. 
Th>«  bnik  we«(  wind  btow»  land 
away  from  the  MJe$  of  a  com,  buiMmg 
It  Mf  mto  a  iiay  column  and 
walitnf  the  com  sund  out  in  relief. 

M 

Tw  the  cartful  observer,  the  tellule 

circle  m'the  land  '    mean  treasure  .  . 

<• 

Of  a  bottle  cap  or  rubber  washer 
» 

Treasure  huntiny  i»  boj 
uAfcwarduig  along  tjits  COast<  Ninety 
yean  ago  two  men  rowed  aihore 
N  from  a  sailing  ves«el  ^tnchored 

to^  ^ew  Jersey  inlet  and  later  returned  to 
theif  ^)^p  with  an  ironbound  xhest.  leaving 
a  scattering     Spanish  coins  around  a 
nastily  dug  hoi^.  Since  then,  anyone 
With  the  eyes  to  see  them,  has  been 


54.  F.  NO  CHANGE 

G.  Upttet 

H.  Odthte 

J<  ArouNd  a  . 

VS,  k%  NO  CHANGE 

r%i  havc'b«m>fva«htng 

O  iMwIwashed 

^  O.  were  iraahiag 

r;  NO  CHANGE 

G.  Ncverthetesa. 

H.  However. " 
J.  Apparently* 

57.  A.  NO  CHANGE 

b.  offshore, 

C.  offshore,  and  due  to 

D.  offshore  and  by  virtue  of 

5t.  r.  NO  CHAr^GE 

^  .G.  tbem 

H.  tbeK 

J.  some  of  them 


a».  A.  NO  CHANGE 

B.  has  blown 

C.  blew 

D.  had  blown 


M.  F.  NO  CHANGE 

G,  make 

H.  is  making 
J,*  made 

J 


61.  .A.  NO  CHANGE 

B.  (Begin  new  paragraph)  The  hunting  for  treasures 

C.  (Do  NOT  begin  new  paragraph)  Finally,  treasure 
huntiru 

D.  (Do  NOT  begin  new  paragraph)  The  hunting  for 
treasures 


42.  F.  NO  CHANGE 

G.  from 

H.  off 

J.  around 


i3.  A.  NO  CHANGE 
B.  them  has 
.C.  them,  have 
D.  ihem  have 
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im.  U^wnm,  m  «m  Ium  mmaMfti  to- 

pi— f  man  iiwa  »fcw  — «—  •! » tii»c^ 
*      i«       *  - 
Hiunfcilni.  *■  tmmit  walkert  <if  Um 

Hum  Mmj  N^fctt  wUI  i«ip»>fMt 


U.  F.  NO  CHANGE 

C.  iM  * 

J.  snyonc't 

19.  A.  NO  CHANGE 
i.  iiitk  riMft  Ikui 

C.  mmn  thu 

D.  M  MTf  IImI 

M.  r.  NO  CHANGE 


tky  if  19  MM*r  •  oty. 


 ■^-jg —  


— n; — 

•r  •wiiu»ii<«^  ud  cmtfmm,  the  uovw  MTwi  frMi 
tlM  dtjr  •!  htffi  a  at  hMi  VM  iafocuiM 
« tfwt  w  iitU  tiMH  of 


«7.  A.  NO  CHANGE 
I.  T*  fciciw 
C  WbM  kteoawig 
D.  WbM  MM  tmimm 

M.  r.  NO  CHANGE 

H.  MaM  at  ■  Mtrofolhu  iMivrniqr. 
J.  iwiit,  ai  ■  MrtrofoMaii  uahfcmty 


•t.  A.  NO  CHANGE.  '  '     ,  , 

B.  (D»  NOT         Mw.  yaninpk)  hffcMg.  for 


C  (»^  MW  puianHi)  Pvkwt  for  HUlMic. 
D.  (i^  B3W  pin«PiH>)  ParkMC  for  mmmx 


7*.  r.  NO  CHANGE 
^  C.  a  ainrairtoototv 

'  —  ! 


71.  A.  NO  CHANGE 

C 
O. 


71.  F.  NO  CHANGE'  > 

C.  wtyi  M  caiM***  * 

H.  ««y:  4M  oaafia,  thtf*  art 

J.  ««y  m  mmfmn  tl»m  are. 


10 


00  ON  TO  THE  NIXT  FAQE. 
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M  old-faihioMd  icnie  of  community.  Hm  Mnin|en 
Mcm  \o  •pymr  m>  thomh  ihcy  wtre  Icn  sutptciou*  of 

one  another  Uun  bu»y  city  su«ct»,  N«w«>men  need  not  be 

iimKll  «b<Hii         fot  Jitc^tonyihwth  huirxJ.  people- 
are  happy  u>  help,  even  ihdu^  no  ^ne  knowt  for  lure 
wbere  anythinf  is  beyond  hiv  own  "ituad"  or  stfrct;;  ' 


73.  A;  NO  CHANGE 

i.  to  appear  ai  if  they  were 

C.  to  fi>e  the  impreMion  of  bcrni 

D.  OMIT 

74.  F.  NO  CHANGE 
C.  then 

H.  then  on 
J.  than  on 

7$.  A.  .NO  CHANGE 

directions  ((houfh  hufned)  people 

C.  directJoflt.  though  hurried  people. 

D.  directions.  Diouih  hurried,  people 
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TMTJ 
MATMOIiATICS  MfA# 


0«  not  HMtr  «Mr  praMm  tfwt  Ilk*  too  much  tim*. 
toiv*  « fMny  «  yw  om;  mm  rtlum  K>  mo  olhora  in 

NMt:  MMMMMiflium  m  not  ntcpwrlly  drmim  to 
^    —  to  Mt  m  •  piano  untaM 


.1.  T*  l«y  ft      ctf .  iMJi  korr«Md  SSM  M  •  yearly      ^  DO  YOUR  PMUifllNQ  4iEIII. 

immnu  nM.*f  I  MrcnN.  Siaoc  Umk  wm  m  Mrly* 
ptyMtMl  MMhy»  Mc  maid  the  im  —t  hm^  »Mn 
•(  ilw  cwl  ftf  ^  MMtkf .  How  mcJi  mm^  Imtmx  M 

A.  I »  , 

C.  f  4»  ^ 

O.  S  M  ^ 

2.  Wlikli  af  in*  M#wii«  •rd«nd  pain  (jr^)  wiU  uiUfy 

1.  ( 0, 0>        •       '  ^  ♦  . 

111.  (-2,-2) 
lY,  (  VJ) 
r.  loaly  . 

C«  Uaaly  .      v        "  '         '  "   

J.  naarflllaaly  '  " 

K.  1.11.  Ill^aatf  IV 

'  A.  M 

B.  I* 

C.  0 

^ 


4.,TlwlM^«f  a  r  ailir  mu4  mrtmt  jwatar 

tlHM     «Ulk  fir).  hiW^  ii  2  mmm  1m*  ikaii  3 
tiam  il>  wML  Wlfa»:  eipriwiia  ftprtaiaii  tte 
^     viliiBi  af  Um  mM  uk<<We  MtartT 

r.    w(lW  -  2)<tr  ♦//»  ^ 

H.  wiiw  ♦  2)(w  ♦  4) 
J.  w4yw*mw''4) 


00  ON  TO  THC  NEXT  ^AQI. 
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S.  ir  the  radiui  of  » ctrek  b  h«lvcd.  Whai  happens  i»  ihe  DO  YQUN  FIQUNIHC  .HERC 

A.  It  reauiM  Uw.iMne. 
C.  Ivm4wAW. 


2.4 

H.  4^ 

K.  2,400.000,0 


7.  Am.  Bo^,  Caria,  Dave,  and  EUie  «ant  to  play  chcu. 
How  many  diff^renl  Z-penon  chcu  timet  an  be 
pUyad?' 


2 
10 
25 
32 
1)0 


t,  Whkh  of  the  folio«inf  (tuanlilici  is  NOT  equal  (o 

'  r.  :7|xi  ■ 

C.  7MI 
H.  7|jr| 

f,  Mary  has  4  of  h«  pa  pel  route  lo  fini»h.  ind  John 
offers  l^'  dcHvtr  i  of  what  remains.  What  iMrt  of  the  , 
oripnal  rouir  docs  John  dehvei^ 
A.  4 

D.  \ 

E.  T& 

I 

If.  The  ratio  of  Ihc  mea(ure<  otihe  2  sm^Ilcii  anftes  of  a 
trianik  it  1:2,  and  ihc  ratio  of  the  smalkjl  to  the 
larfest  anjtle  tx  l^y  What  h  the  meature  oi  the  targe^t 
an|le' 

F.  45* 
C.  77* 

H.   90*  ' 

J.  f«r.  • 
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11.  WlikkwiiMkMGon«ctlytn«UMe«dKfottomAg»tt^ 
■mi:       nmk  of  McrcMing  7  timn  a  ^ut^Qtity  by  4 
it  tlN  mmt  a*  12  &e«  thaa  twice  tiu  qwinmy"7 


A.  7jr»4  32»-  12 

B.  7(jr*4)3  I2-2a> 

C.  7(x  ♦  4)  =  12  -  (2  ♦  ;r) 
0.  7jr  «  4  s  12-  (Z  «  jr) 
1/  7af  ♦  4  s  (2  ♦  jr)  -  12 


13.  Ai^< 


[MM*  hw  M  ftfca  of  M  wiiaK  ccatimetm.  If  each 
M«B  it  mttuti  ^  bow  nwRy  i^usrc  etnti- 


4 

10 
3* 
44 
MO 


U.  On  A  JO  ^fuahm  t«t,Toiu  raonvW  5  pouiu  for  every 
oOTTWi  ummm  m4  3  foim  for  Vrtry  wrou , 
mmt.  M  akc  Mmmn4  all  ^ucmwm.  how  naay  M 
ttm  ummm  Mnwdy  if  Iwr  score  wm  6  ? 


DO  YOUR  nOUniNQ  HERE. 


I4«  X  IS  « lineair  fuMHon  of  Ifl  convening  to  *n  X 
iscore  of  5  IS  «^»iv«leiit  to  t  Y  score  of  35.  and  an  X 
score  of  1 1  ie'equivalem  lo  a  X  score  of  65.  What  Y 
score  ia  eqiiivBlent  lo  an  X  KOf  e  of  6  7 

r.  40 

C.  45 

M.  30 

J.  SS 

K.  40 


A.  -  7M 

B.  12^ 

O.  12)1 

«.  I3J  ' 

'li..The  iiHiw  of  eqiMlioiM  shown  below  has  a  solution 
7or  wW«i^r)tI.:,MMaher«  «  and  6  7 

ir**  3/  »  «  . 
3*  ♦  1^  =  6 
F".  (My  whea  «  ^  0.  6  ^  0 

C.  Oaly  whm  a  ii  0.  6  s  0 
Oaly  whMi  a  3  0.  6  It  0 

J.  Oaly  wh«i  a  s  0.  6  I  0 
Far  aay  a  and  ^ 


QO  ON  TO  THE  NEXT  RAGE. 
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17.  lf(jr»«)(jr«^)sjrS»5jr«-4roralljr.thenwh«ti>lbc  DO  YOUII  FIQUflINQ  HERE* 


/ 


value  of  «6 

A.  a- 

B.  J 

C.  5 

D.  i 
C  30 


lt.'ictb  WnCh  to  <ut  the  («r|»i  po«>ibk  orck  dom  a 
square  piece  of  male  rial  Whkhequation'ex  presses  the 
numerkal  reUnofMhTp  between  the  skJeofJhemaierw! 
()>  and  ihe  radius  of  the  <i'rc>e  (OT  ' 


H. 


T 


J.  rs  sy/2 
It.  f  =  I 


H;  Ihe  formula  I  tC-»  J2  is  used  lo  convert  Celsius 
leffipcraiures  to  Fahrenheit  temperatures.  What  Cet< 
sius  temperature  is  <t)U4valent  lo  6t*^ Fahrenheit? 

A.  IWO*' 
1224* 

C.  400» 

D.  300* 

E.  None  of  the  thovk 

it.  If        s  2t  ♦  I.  what  IS  Ihe  valOe  o(x  ! 
f.,2 

H.  t 


31,  Mr.  Siokes  waxes  i  of  a  gymnasium  floor,  and  Mr. 
Wi$ner  waxes  i  of  the  remainder  What  pan  of  ihe 
Hoor  remains  to  be  wated? 

».  i 

CM  . 

D.  \ 

£.  If 


21.  How  IS  .00634  wr.lien  in  scieniirtc  noution? 
fi  ,  6J4  }f.  I0» 
C.     .634  ;i  I0»  • 
H.     .634  X  10  ' 
J,    6.34  X  |0-» 
K.  M.4    X  10'* 

15  'GO  ON  TO  THE  NEXT  PAGE. 
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n,  UX  year.  JaiK  eariwd  $1000  mowinj  »av*t»,  Thu  DO  YOUR  FIOOWMQ  HERE. 

'  year..>be  earned  S«0  00.  Compared  (o  her  carflinfslair 
year,  wbal  pcrccnut^  did  her  carnTnfS  lh»  )ear 
decrease? 

A.  10 

B.  3P 

C.  25 

D.  33 
I.  73 

*>  « 

M.  David  wiiMs  to  cut  KnpaoT  equal  width  from  a  ^rd  9 
'niclM»kH«,Hf  iMketicvtlwiiliaHwihatwatlcft  * 

»Bdiofwoodwnheachc«,Howi«aByuid»e»wtdewiU  » 
the  Mfipt  b«  >f    ends  tt^  with  a  icrap  peer  of  wood -i. 
of  an  lAchrwide? 


I  

li 

J.  m 


25.'  TwrA  /(0.4)  U  the  center  ofa  circle,  fomi  A  (-2.6) « 
.      ofK  erid^otnt  of  diameter  Af  of  ihi»  circle.  What  are 
Ihc  eoordina^f  of  point  #?  (Auume  a  Cartettan 
coordtaaieiytiem.)  . 
A.  (-4.  t) 
i.  (-2.  2) 
C  (-1.  5} 
iX  2) 
(  2.14) 


M.  If/ 

from  to  to  3  7 
r.  3.0 
G.  1X3 

J.  23j0 
K.  223.0 


how  much doeardwraie aaxdecreaaci 


The«  are  3  numfcan  wch (hat  the  iwwnd  «  3  time* Che 
fifK  BndihcthirdU5morethan4ttmetthcrtnt.iftbe 
Hiai  o(  the  number*  U  103.  what  U  the  larfett  number? 


».  12 

C.  I2i 

D.  43 
B.  34 


GO  ON  TO  THE  NEXT  V»AQE. 
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M.  in  the  ^ittraM  Mow.  Iiik  L  n  Mmttci  to  tine  M.  Of 
tmn^'i^XT,  7VY,  WVZ,  and  ZKC/.  wbkh 


DO^YOUR  FIQURINQ  HERE. 


t  V- 

T-  y 

V 

z 

I.  wvz  and  if;rr 

II.  TYY^vAZVU 

III.  irc;z«jid  rrr 

F.  loniy 

G.  11  only 

H.  llloiUy 

I.  1  Md  fl  only 
K.  11  Md  III  only 


2f  .  Which  expre«siot<(  Mow  are  AL  WAVS  equal  when  x, 
y,  and  z  arc  all  ^tiive? 

^    '  A.  1*  ♦  >|  -  r  and  I*  ♦  >»  *  z[ 
».  jx^jfj  -  X  and  |jt|  ♦  W  -  z 
C.  |jr*>*i|7aad  jt*/*I-z|  V  _ 

^  O.  ;r  ♦ }/  -  z|  aad  Jf   /  ♦  j-i] 
I,   x^  jK^I-ij  and|jf|  ♦!>! 


M.  If  dinner  rolls  co«t  c  cents  per  roll,  what  is  the  cost  in 
dollars  of  d  dozei^  rolls  for  any    >  0  and  for  any 

cm 

HXle 
"IT 

K.  1,200  <(/ 


31.  A  wM  roUtoa  15  timaa  per  minute^  How  many 
dc|rec<  does  It  route  in  4  saconda? 

A-  <0 

B.  110 

C.  240 

D.  340 
I.  730 


QO  ON  TO  THE  NEXT  PAQE« 
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3X  U  h6w  mmny  difTcrtnl  ordm  can  Joe  mtnm§t  9 
dffr«rcai  h&Dk$  on  a  tbdf  ? 

A.  5 

B.  10 

C.  M 

D.  JO 
I.  1» 

34.  Tow  ma  30  fMl  of  fwriiig  to  cadow  ft  frtamuhr 
fvint  tf  To«i  ii—H  tlir  jputtM  to  kc  •«  lurpi  •« 
l^ojftMt,  ■«tMt  iiM|>Miifti  m  fMt         the  firriai 

R  15.0  13.0 

C.  7.3  by  7.3 

H.  9jO  10.0 

J.  3.0  by  10.0 

K.  LObyXO 

'If.  Wkkk  gra^  ibowt  tkc  equfttioii  X  - 7 


D. 


VI.  'X 


DO  YOUK  FIQURINQ  HERC 


C. 


7X\' 


00  ON  TO  THE  NEXT  ^AQE. 
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llu  Tte  tf^MMUr  «( the  ttnli  u  tMrMMftieW  4  ti^ 

fawiiir  if  tilt  mjim'  V"  •* 

'  MiwoiiiMlily  wiMit  frartftm  fff  thr  rVi-r  — 
Mrth?  (PMr<  Tlw  Mvfim  ra    a  i^lwrt  of 

I.  i 

37,  Whal  are  the  valun  of  x  that  satUfy  the  inequality 

D.  ;rS7<Jr*I 

JiL  ThalMgborarectaasfeH^kMtiiaaiwkviUwidth, 
jr.  If  tht  ana  of  Um  n^anfle  u  35/ which  aquatum  can 
ha  mti  to  find  ir^  ' 

6.  Ir  ♦  a(lr)  -  3  s  35 
.  H«  jr»  >(lr-  3)»  =3$? 
J.  lr»-3jr*35  »  0 
K.  2Jr».3x-35  ^  0 

J».  7^  rhomhuy  i(  a  parnllelogrim.with  equal  i'Mft*.  In  the 
ftf  urc  bctow^.  A  kCDi%  a  rhombui,  and  the  measure  of 
LEBCt^M*.  What  i(  the  meati%  of  ^JfD^  ? 


A 

A.  I7» 

c.  7r 

D.  TT 


DO  YOUK  FKUIflINQ  HBIIE. 


4i.  V65»-56' 


A3 
III 
*33 
ill 
tI2I 


END  OF  TEST  2 
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TEST  3 

SOCIAL  sTUoms  heaoinq 


OWiCnoWflfe  Each jwiyyjn  Ihit  >gjtoy^^ 


ImM  tnvwtf  lo  Mch  QUMMon  snd  Mtofttn  1 
tpoiKHup  tpiot  Of)  youf  WMwcf  thtiM.  You  mty  rtlof 
to  Ih^  poviii^i  M  Qnlsn  Mr 


AMmmt  Marks  Ui»  tnaikMMftl  period  biiwica 
cWMhMtf  u4  ■<riifco«<  T1mi«  it  bo  ni  »t  wkidi 
*  aMMMMt  'tatiM  or  mdK,  tte  Am  lifM  of  ^okctty 
aMoiMM  iiroaHLaa^  WMtl  Mativity  MMliitocoachi* 
li— .  MoitM  pll|iiid,iooirt,o>itM>tiOMlcliMiiiiOicor 
Mm  oMmmh*.  Tko  OMM  of  Mikorty  fa  ikt  aoM  ilrili- 
iag  MMMit  kMMMcWMhM^  m4  MofaMMot.  Diving 
fSknUft  ikt  priMin  Mi  I 


"iOVllo^.  PlMUJf  MX  dMlMMrirtiM  9M9  thf  mmimI  oM 

MitrMi  fifaiiiji  MX  ^Mtfi  ikit  CMTy  o«  rafKo^activt 
-fMMtioM.  SoMMMy  MX  cfeoneMifalkt  an  tha  cteiactcr- 
Miks  Umc  Mafofali  hmIm  frooi  liawlii  <Mki  aotioMMa 
aai  ra|M<aMcal  cImmm  4mmg  aioiMiiaii  aflact 
Miht,  waidM^  aai  My  ftra.. 


'AtfalHaMaa  aka  MvalvM  awtaia  4ii«loyiMNlal  tasks: 
i^adflc  >alM<iaral  ^olima  aW  ikiBi  IMI  sodaiy  txpacu 
ia#Ti<Mli  la  m  Mr  it  ssrtaia  pirisii  ia  Ikwr  Irfi  i^sai 
Saaaaa^U  aMimaasai  af  iMm  tasks  l(«4s  to  kappasM 


riaaka,  wkitfackaCa 


MkapfiMM  aai  WioM  «llk  laMr  isnalaf mmmI  lasfcs. 
Tka  priMa  iavalapaNaial  Maks  of  aMiMaMe  tadoria: 
f  0  Mriavlag  anMiaMl  kitfipsaMaaa  fraai  aaiMts* 
Cb  aaeiMlM  aM^  ka4y  aai  iMrniaf  to  nm  it  aflaaUvaly, 

M?'*^(^ariiHS'2i^^ 
4  prapafkn  fv  aniiMapaiiia.  aito  M)  ackkvMf  ac^ 
fliic  iaMpaaiiMai  CMMacarf  to  Ika  cwMt  tha  arioisaaaiM 
kM  tfapaMaal  m  aadlsM  nflaaMii  ky  aaiMrts.  Tkc 
olasaaal  fa  iMraaaki||y  mgiositi  ia  Ika  larpr  m 
MUs  tka  kooM.  fmf  iioiip  aesaMaaae  fa  mssMmI, 


ExMliaaaly,  aiofasasMt  fa  ckaiacMriastf  as  a  aaiioi 
af  sifssi,  stoTM,  aad  coaflkt  kacauM  of  pkysiolof^ 
r  Uakka  Ika  ckiU,  the 


atfaisascal  fa  aol  m  coalral  of  kfa  liCs;  ks  m  Isaasr  looks 
kka  a  ckM  km  fa  ao«  iiaiy  for  adakkoa^  aad  iu  Amanis. 
AMisaml  ckaracMrfalka  ai«  extiaMr.  conlraiietory 
naiiwfai  wkiek  aMka  Ikfa  pkaM  of  icvclopoMnt  oas  of 
iasMkilky  aarf  variaMa  Mao<s.  Sons  of  tksM  contfa•^ 
iktory  isaiiaiisi  are  tocii^ility  and  loUtadc,  iode* 
paodcMT  aad  dapc»dan«,  sensitivity  aad  MwensitivHy^  Cfo- 
aeirtndty  aad  aknifaM,  oonfonaiiy  aad  noMoaformity. 


rissaents  Might  typicaUy  advfac  a  frfand  to  "join  tke 
» ladsM  yan  want,  to  ke  kfl  out  of  everytktni" 
priawrily  kecatoa  of  tksir 

A«  natural  kadsacy  toward  sttkafasioa. 

B.  arsvious  traiaiag  ia'ooaforainf. 

C.  uMkiiity  to  ka  salf^dicaetad.^ 

D.  aaad  for  astaptaaM  aad  sacarity. 


\  souroei  of  gratification,  the 


2.  UaUke  tke  ckiWs  i 


I  froM: 


G.  aafMls. 

H.  iMSjfcairy  oOm 
J.  oUarckiUraiL 


i.kout 


3.  Aosbrdtog'to  tke  paiMgi,  wfakk  it 
ds^ils|Msalsl  taaks  fa  aMst  aocurats? 
,  TkeydavstopiadaiMadaaclyoftkcaUturf  <n  wtuck 
oa«  MvBs. 


OM  BVBS. 

B.  Tkey  aia  lakttad  priaMrily  to  kekavioral  pattarai. 

C.  Tkay  an  a  oomkinatioa  of  cottwal  patterns  aad 

f^ifft  ttet  ^"^l^*  atf^aM 

D.  They^  ars 


I  Haass. 

'm  Dot  invalid 


4,  All  of  tka  foMowlag  statiMiati  ckaractariia  tke  ado- 
Isasaat*!  psar  group  EXCEfT  tket  it: 

F.  repraients  an  iacraaeing  inteiaet  in  the  outeide 
worid* 

G.  pro^^dM  aofal  w^oft' 

H.  coneamM  taersasiag  acaouots  of  time. 
h  iaterfsTM  witk  tke  adoletecnt's  gMfa. 

5.  Aceordiag  to  tke  passage^  Ike  search  for  a  Mlisfying 
vocational  goal  aan  raoel  closdy  be  linked  with  the 
adokscMt  driva  toward:  • 


A<  devalopMg  a  phUosopky  of  life. 

B*  lainini  peisonal  independence. 

C.  achicviag  sekolastic  soooeu. 

D.  devetopMg  pkyaical  competence. 


00  ON  TO  THE  NEXT  PkM. 
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A^cordms  to  the  ptsMfc,  which  statraient  about 
Mtoktceiit  penofwtity  chan|et  »  true? 

F«  they  Mtt  iaAucaoed  by  cuHiuml  dcinamlt. 

G.  They  mnu*  lUWe  until  early  aduhbood. ' 

H.  They  result  primsriiv  from  iriiysioil  development. 
They  reMitf  priimrily^from  pArental  influence. 


tathe  ftamffit  on  what  levcli  doet  idolef* 

occur? 


I.  EmoiioMl 

II.  Phytkal 

III.  CuMlinl 

IV.  S^irUUi 
I  and  II  only 

I.  il  aod  111  only 
{,  II.  aad  IV  only 
1. 11<:.MU  aod  IV^ 


The  author  lugiettt  that  developmental  tatki  include 
thoae  skills  and  goals  that: 

F.  an  individual  must  possess  before  reaching 
maturi^. 

G«  the  social  group  exMcts  an  indivKtual  to  master. 
M«  are  acquired  entire^  as  a  result  of  physiological 

maturation. 
J.  are  none  of  the  above. 

9.  Adokaeence  can  be  contrasted  with  childhood  upon 
the  ^ipearanoe 

1.  primary  sex  chanctenstics. 

M.  secondary  aex  characteristic*. 
111.  emotional  aUbiltty. 
I y.  feelniii  of  dependency. 

A.  HI  only 

B.  I  and  A  only 

C.  U  and  IV  only 

D.  I,  li;  and  III  only 
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TV  iNCTiMt  in  Wtck  votitkal  tAfluence  dunng  the 
IfTQi  muk*  t  iMowl  crt  of  Mack.power  in  Amenei.-iy 
IMO.  iwo  WKk  MpwWiMM  Kty94  it  the  United  Sutet 
S«MI«.  m4  tweirty  Mack  rvfretentMivcf  from  ei|fac  »outbef  n 
Ma^i  lewd  J*  CoutreU,  Tlwc  dmmttk  ekcior*:  Wwlf 
UvMdM  oC  lUoomtniciMHi.  whea  fonner  ttftves  hcU  office* 
nwM.rrofli  selMol  M^mradent  to  Mtlni  tovernof. 
MfSlfl  the  ^f««iu  MicctM  or  WKk  c^idaia  in  state  and 
local  govc^nneiM*  it 

Dctfilt  tlMC  aaralkli.  the  cifoimaunces  of  political 
cKiMte./Mrty^airiliatioii.  location,  aad  ieptt  of  lode- 
MdcMC  dirte.  Durinf  RccMirtnictkw,  Wacki  were  efcaed 
U  a  radM.dMMli  where  aMny  touthara  whiiei  had  heen 
dMeafraochiMd.  Taday.  Macks  have  hara  elected  tn  urban 
caiMcn  whaia  hoth  Wack  and  whke  voiert  »a  to  the  polb  in 
free  eledioai.  la  1 174,  Wacks  ftithfully  tuf ported  ahe 
lUaaMicaik  tkkel  hvt  their  dMceaaaM*  have  «w«ched  to  the 
oaMUtnii.  THrin  Hecoaalnicti^i,  the  rwal  So«h  wm  the 
aUcr  h«c:  la  Uw  ccMiwy.  aorthera  crtw  providad  the 
great  aolitkal  OK>ortuaiti«».  More  Unporum.  Wack  con- 
atimean  i«Aiianc«<d  paiaar  of  the  Votint  R'fhts  Act  of 
IH5:  the  FoorteeaUi  and  FifUcnth  Araendmenti  were  the 
baaiga  work  of  the  whke  lUdical  RepuWkaae. 

DMHe  these  iaif«taai^diflef«»c»,  tone  pcopjf  fear 
tha  occaraae  of  a  whke  hacUaah  bke  that  of  1176.  In 
order  to  wia  the  pra«<a«cy.  Ruthaiford  B.  Hayes  agreed  to 
wkhdnnr  todaial  liaofa  f fO«  the  Soul%  T>t  C<«P^^ 
•r  It7«  crsaiad  'MMMMTaMa  opfortiimtMS .  for  duen- 
fraachiicaisttl  ttet  eUaetively  sHawwlad  iiaonty  voters 
frofli  the  rolb  aad  rcaaM  Uack^  offictali  froin  govtrn- 
maat.  WHh  the  aaquieaosac^.ol  the  SuprMnc  Court,  the 
Founaeath  AaisaiMnit  gaakataes  of  •^jwljwiion 
»T*«»»  iiMaaii^laM  sad  the  enactment  of  "Jim  Crow 
tews  lad  t«  the  creation  of  two  separate  societies. 

Ilfiispsli  laday  saek  to  avoid  a  repetition  of  that  fate 
by  striving  far  mcrsnsed  bkck  paniapation  to  achirw 


aWM      plMgl^W     ISWBI*      •  Mb  Ik     •Wpf  WW-      ^n-  wm-w— 

laderafapM'»'"«"«'-  The  existensa  of  Mack  mayors  at  the 
local  IrvM  and  tha  Hack  Cancus  in  Congma.mdicaies  that 
civa  ri^  pralafi  haa  matarad  into  tha  traditioaal  forms  of 
pUtical  iwvolvanisal  sucsissfally  used  by  other  ethnic  and 


fal«i0MB  aMontiss.  FinnUy.  the  maior  c*»"^ 
mdetad  a  very  diffsfcnt  louihlaad  from  that  of  the  tt70s 
encottra^  the  hope  tJiat  America  wiU  live  up  to  Ms  heritage 
of  phirabsm  aad  not  revert  to  the  pattern  of.))os(  Recon- 


stnctioa  reaction. 


It.  Which  activity  represents  a  traditional  form  of  politi- 
cal invoh^ment? 

F,  NAACP  voter  registration 

G.  Bteck  Libention  Army  stuck  on  white  police 
tlteck  Panther  party  community,  brcakfsst 

J.  None  of  the  above 


11.  Which  title  best  exprtsaes  the  author's  y»ewpoii»t? 
A.  Black  Power  in  Dixie 

i.  The' South  WiU  Rise  Agam 

C.  Racist  Triumph  in  U.S.  Politics 

D.  Black  Power  Reyisitad 

12.  ne  whtte  Radteal  Repubfccans  wouW  probably  have 
k«cn  opposed  to  the: ' 

F.  'l5ih  Amendments 

C.  Jim  Crow  tews.  ^ 

a  CivU  RithU  Act  of  1964. 

J.  Voting  Rigbu  Act  of  1965.  \ 

11.  If  federal  registrars  were  withdrawn  from  the  South,  a 
backtesh  reaction  would  be  Olustratcd  best  by; 
A.  soutbem  white  ofTidals  andtng  ways  to  reduce  the 

bteck  etectorate.  .  , 

I,  bteck  poUticans  rcsutmg  any  loss  of  power. 

C.  bteck  voters  organiting  registration  dnves. 

D.  the  Supreme  Court  protecung  bteck  voting  rights. 

14.  During  the  post^Reconstruction  backtesh,  southerners 
would  probably  NOT  have  kgistetcd: 

F.  liiera^  tests, 

G.  graadfslher  cteuses. 

H.  white  primaries. 

J,  compulsory  voter^regiitfation  tews. 

15.  TV  American  acceptance  of  pluralism  is  best 
illustnted  by  the: 

A.  WorM  Wat  11  detention  of  Jspanesc-Amencani. 

B.  .  etection  of  an  Irish  Catholic  to  the  presidency. 

C.  Ku  KIttX  Kten^anti^mitic  activities. 

O,  lequiitmem  that*all  who  wish  to  vote  pass  tests  in 


16^  Which  future  bteck  stnlegy  would  the  author  probably 
^  favor? 

F.  Ma£  demonstntions  _ 

G.  Conventional  political  campaigns  and  voter 
registration 

H.  Nonviotent  pnlesCs  and  civil  disobedience 

J,  Court  challeages  under  the  14th  Amendments 
•qual  protection  cteuie 

17.  According  to  the  first  paragraph,  whkh  statement  best 
applies  to  bteck  political  power? 

A.  Ceruin  paralleii  can  be  drawn  between  the  post- 
Civil  War  era  and  today.  ^  . 

B.  There  J»s  recently  been  an  unprecedented  growth 
in  bteck  power,     o  "  _  ^ 

C.  National  poUtia  ^has  always  provided  greater 
opportunities  for  bteck  advancement  tKan  has 
local  govemmeht.  , ,  ^.  . 

D.  Limited  success  at  the  federal  level  indicates  a  need 
for  btecks  to  focus  on       politics.  ' 
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It.  ibckftcxwU 
acito  at  t 

Maibcr  of 


tWMty  pmcm  of  Ike  deltfBte 

ConvcnUM  piimuify  kacuite  . 

lWf«l0M  ittiM  mill  the  Itftett 
til  votct. 
tjr  iiMlimprmMiwI  ui  tlw  pan.  / 
who  ImU  «  hifh  pM«f«Uar  of  lUte^ 

ft  fiMi  of  tlw  vote  for  Deaio/ 


If.  1ft  the  tlufd  pomgrapb;  the  tuthor  imfim  Uuit  tke 
SjuprMtt  Court'*  role  co«ceniinf  Mack  ri||Hs  4tirin| 
•  Hftyid*!  ftdMintHntion  wot  to: 


A.  btooow  the  tirly  cfciwfiow  of  dvil  riditt. 

•.  rfsolvc  the  imfiu  om  tlw  im  elo^o«. 

C.  UftdthaiM  Um  14ik  AMataoiL 

D.  iMHi  <m  oqiial  protectioft  of  kw«  rctii<dtoM  of 
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l»  ItH  Commodore  Matthew  C.  ferry  forced 
JifM  to  0fc«  iu  doort  lo  the  West,  the  Und  of  tlie  Rkint 
Sm  ^  ruM  by  a  nUit«ry  dicutor  called  the  jhogun. 
HoWm  kMwa  M  dmmyos  employed  warrior*  calkd  Mmurmi 
in  Uwir  lervicc^  The  nmm  practiced  a  code  of  conduct 
kMwa  M  BuMtf.  whkh  called  for  seppukn.  or  ntuat 
smode,  if  one  were  diihoaofvd.  The  sword  w»i  still  the 


23.  European  fetidalniadiffered  fromJtpftMtt  feudalism 


.  Euroacai 
mainly  ■ 


the: 


The  shocua's  inahiUiy  lo  resist  Perry^  demands  led  to  a 
reheHion,  and  pmr  paaeed  into  the  hands  of  the  Emperor 
MtttaulMo  la  IM7<  Ass»tcd  hy  aa  informal  pwp  of 
•dvison  kaowa  m  the  |enrp.  Mutsubilo  saw  that  the  only 
way  f  tfvoid  cimint  ander 'Western  control'was  to, 
aMdcrnae.  Dnrim  hit  reign,  Japan  emharked  on  program 
which  convnnad  iilo  a  modeni  nation  hy  1900. 

-Takii^  'the  advanced  nation*  of  the  world  as  their 
example,  the  Japaaaae  transformed  the  Mmurat  into  a 
^  B  army  and  nayy.Th««\  armad  forces  were  tested  i- 


menern  army  ann  navy,  i  nmux  armeo  ivrcv*  m 
the  Sin«-Japancsc.  War  oiHt^^S,  which  established 
Japanese  hcfmnny  over  Kor».  The  tnate  intervention  of 
iaasin,  France,  and  GdiNnaay  prevented  Japan  from  laining 
what  i<  considarad  ta  ht  its  ^ust  reward  for  this  victory— 
canaeaeioM  tn  southern  Manchuria. 

Japnaese  reaenlmeni  imrd  Kuiata.  comhined  with  a 
claah  of«inierests  hctwecn  England  and  Russia  in  vanous 
parts  of  the  world.  M  to  the  Anglo-Japanese  AJhance  of 
t9t3.  This  afrcenem  proiacled  J^n  against  Russia^  allies. 
J^anjhen  provoked  and  won  the  Ruiao-Japancse  War  cf 

When  Japan  cstaWtthad  the  puppet  state  of'Man- 
i.«ukuo  ia  Manchuria,  its  condici  with  the  United  States 
hcMn.  Japan's  further  incursion  into  China  lad  to  war  wrth 
thai  nnlian  in  19)7;  the  United  Suiet  responded  with 
economic  sanctions  againet  Japan.  On  December  7,  1941, 
Japan  reacted  by  atlackii«  ?earl  Harbor,  the  American 
nrvai  base  in  Hawau.  Uhimaldyt  the  industrial  msght  of  the 
United  States  began  la  prevail,  and  Japan  was  JruMnted  in 
iii'cfrortt  to  dominate  the  Far  East  by  force. 


'M.  Maachufia  was  onc«  desciibad  as  *nbc  cra^kof  con- 
fhd."  What  made  Manchuria  so  attractive  Ao  Japan 
and  Rusam?  \ 

It  was  underpopulated  and  thus  attractive  to' over- 
crowded  Japan.  .  ^      « »  . 

It  could  prcvide  a  shortcut  for  the  Trar^-Siberun 
Railroad  to  Vladivoetok. 
It  WM  rich  in  coal  and  iron,  which  Japan  lacked. 
All  of  the  above 


6. 


R 
i. 


21.  loth  the  "oaening"  of  Japan  and  its  ultimate  defeat  in 
World  War  11  can  be  atlnWted  in  part  to  the: 
'  A.  superiority  of  the  individual  Western  fighting  man. 
West's  advancad  technology. 
C.  Chinese  influence  on  Japanese  society. 
0.  poor  choice  of  allies  by  Japan. 


F.  role  of  the  daimyo*.  , 

6.  weapons  eadi  uaad. 

H.  rok  of  the  peaMntry. 

J.  practice  of  seppuku. 

23.  ^  Other  than  Thaliand.Japan  was  the  only  country  in  the 

Far  East  to  cscnpe  donunation  bylhe  West  dunngthe 
nineteenth  century.  According  to  the  author,  this  is 
best  attnbutad  to  Japan's: 
A.  rehgiotts  homograeity. 

E.  system  of  atliancet. 

C.  hirie  popttlaiton. 

D.  astute  Indership, 

24.  According  lo  the  paauge.  since  Jnp»n  reacted  to 
American  economic  aancUontf  by  aiucking  Pearl 
Harbor,  it  is  most  bkdy  that: 

F.  imporu  from  Japan  were  important  to  the  V.Si 
economy.  ^    ,  . 

G.  the  sanctions  were  efrecUve,forangJapanlo  react 
to  them.    '  « 

H.  Japan  was  ecooomicalty  Klf-sufTictent. 
J.  the  U.S.  wu  appeasing  Japan. 

25.  The  Anglo%lapaneK  Alliance  o(  1903  resulted  in  part 
from  the  dash  between  England  and  Russia  over  such 

,  issues  as: 

A.  RukSiaa  support  for  the  Afrikaners  in  the  Boer 

I.  tha  bottiklary  dispute,  Sn  •ntish  Guiana. 

C,  Russian  efforu  to  oppose  the  Pan^lavic  move- 
ment in  the  lalkans. 

D.  Rustian  expansion  in  central  Asm,  which  posed  a 
threat  to  the  borders  of  India. 

26.  The  fvnro  was  roost  similar  to: 
F.  the  Iritish  civil  service. 

Gi  Andrew^Jacksoo*s  Kitchen  Cabmet. 
H.  the  U.S.  Congress. 
J,  the  aecretaiy  of  suu. 

lT.-^T^^rA^^J■^^BWt  Aifaiiw.  nhiah  '^/Jg^.**'*?^^ 
chaage  w  Britain's  oentury-old  policy  of ''Splendid  Iso- 
lation,^ most  dearly  indicated  that  Britatn: 

A.  recogniicd  the  dangers  to  its  interests  in  the 
devdoptf^  system  of  European  alliances. 

B.  would  surrender  its  claims  in  China  in  order  to 
protect  its  imerests  in  India. 

C.  was  uonble  to  mainuin  its  naval  strength. 

•    D.  shared  the  goals  of  the  Open  Door  Policy. 

2$.  At\he  beginning  of  the  iwentt^lh  century.  Jepen  felt 
hampered  by. lack  of.acccss  to  raw  materials  for  its 
rapidly  growing  industries  and  by  a  shoruge  of  living 
space  for  its  rapidly  growing  population.  Which  other 
nation  believed  ilKlf  to  be  in  the  same  position  at  the 
uiM  tim^ 

F.  Germany 

G.  Great  Vfiuin 

H.  Russia  ^ —  — 

J.   Spain  .  _ 


24 
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* 

QuMilora  2M3  «•  not  ktM 

d  on  a  faadkiQ  pat* 

You  aro  l»  mrnmr  thai 

lO  Quaattona  on  tha 

taiio  of  your  pfwfout  tclMK 
iluiiM. 

ilwortc  In  tha  aodal 

W.  T¥t  tirai  c»tf  iMf  nim  to  tht: 

A.  an  <tf  iCMiaa  h&tmtm  tht  Soviet  Union  aW  tke 

U.S.  Mlo«««  WorU  Ww  U. 
^1.  ■iraiilf  tawM  'ttevSiwiM  Uwoa  ud  Cluu 

Mi«tkt  IMOi.  |.         4    .  . 
C  fcrilwaparttof  aaMMpitdaa»ipw<  wihcSovitt 

Uiiaa  aad  Om^nmljkt' inST, 
D.  piM  ar  fmtdH  MlaWtey  aflw^YorU'Wtr  I. 


'  i>>  -l«wtad>actmiy,TOMM 
piafcaMy  haw  i^Mt  the  : 

9.  m 

6.  rraetiii^the 
IL 

J.  9laiyii«phtfi 


Jl.  The  Uaii 

eeadaet  «f  feral^  alitun 

Ao  it-  IMi^      Ps^vir  t0 
the  Howe  af  Rayn 
I.  k  hai  the  yewif  to' 
[  C. .  the  teciatMy  tt 


•aerdMi  aaattol  over  the 


D.''m  rilitivefy  mmU 
hoay  to  edviie  the 


he  cufifwed  by  the 
k  ^  eyproynaic 


were  imA  tr  iiafna 

ckiiifiie  the: 


G.  tocMl  daeiBi  the  iodety  _ 

H.  accefffer '  of  itjertiaa  patteiM 


J.  froip'i  ycnrioai  ia  ■  fonaal  acpaiTertta. 

31  NauM'i  uljiLtiiM  ta  the  1904  treaty  hy  wlieh  the 
Uiiied  SlelBS  taak  eoatrol  of  the  PkaaaM  Caaal  ZoM 
weia  haeed  aa  the  coalr1ie«  thet: 
A.  riidieit  ThM4of«  Rooecvdt  ttoeetiaii  iatec^ 

vtBtioa  hy,  U.S.  troofe  if  Faauaa  dU  aac  aeeefC 

thetiaaty. 

I.  CoMNa  vae  the  riahtfal  omr  of  the  CbmI  - 
Zoae. 

'C.  the  VS.  km  faiM  toahide>y  theyrovideM  af  the 

tmty. 

O.  the  tnaty  k  aa  iafriapaaat  af 


menwv  lathe 
lia  eaifhodaed: 


iatheSaviet 


Hfar  II;  Stalia 

F.  ^Mta  plue  for  heavy  iadaetry. 

G.  private  iaiiifail  to  ■ri—lile  ladaetfiai  activity. 

H.  the  fradaetiao  of  ooMaaMf'  faode. 

J.  aeMarae  to  'ooeaerva  aaMval  leeoaici 


32.  The  Iheiaai  Aatkraet  Act  wee  itimiti  \ 


G.  hnek  af  exietkif  Monofoliee  oarf  jpreveot  the 

f ofwkMii  af  sew  oaee» 
H«  rafdoie  the  pridi^policiee  of  noaofoUitic  eater- 


J.  pffvwa  tmet  coapaaiee  from  nwtfing  with 


33.  A  luheieatkl  ierreaii  ia  the  inim  rate  on  coaeumcr 
toaae'  woaU  reeuk  in: 

A.  a  ridaf  dmud  fot  tcmvmtt  loaas. 

B.  a  aeclaiiaa  Awmuni  for  coaeaitr  loaae. 

C  a  riec  ia  tie  kgel  retttve  foquireoMnt  nte  on  lU 

deaaatf  dtfomU. 
D.  the  fiirnl  aeveraiaeal  iacitaeiaf  sis  horrowiog 

fyoai  the  rtaUc 


37.  SwMt  Raeda  altfcfca^  Fkdaa4  ia  t$n  aaualy 
beeaaee: 

^iiJFilliari  nihil  (jMOTTflik:! 


B.  Nad  Oerwaay  Made  each  aa  attack  the  coaikiaa 
for  eeiaUiehiat  the  "Mia-Moeoaw  axie.** 

C.  SoviA  RMeia  waa  amdy  tiqriaf  to  repia  torntacy 
which  had  heca  aader  {(ueeiai  oootrol  ^ariag  the 
re^a  of  the  carLr 

D.  Fialaad  nimai  to  fraat  Soviet  Raeda  jkoidor 
tarikoriee  aad  ri|hM  to  forts  Bad  aavtl  bases. 

3t.  WhkhexaaifleheMsaMortstheaotioathtt^MHivt 
traks  eorrdata  podiivcly*7- 

F.  DriakiM  too  mudi  coffee  aMkae  oiis  Mrvoae. 

G.  McatkaT  twins  fraqueatly  4nes  ideatkally  whea 
they  are  yoaag.  ^  ' 

H.  One  fre^ueatly  carries  aa  tuaWafta  whoa  dark 
doads  tkfsaiea  raia. 

J.  High  IQs  art  uaaally  anodated  with  safetiar 
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99.  Tte  mttkoi  o(  ebctiac  tlw  president  hy  wmm  of  ui 
It  kie  crilkuffl  becauae:  , 


L  MiMi  with  mmU  popukuone  arc  oVer- 


II.  pieeiiiBtiii  clectort  cauKK  excrciae  indt- 
pta4nn  judfiaeat  ainoe  Ike  Cooalitution  Mnda 
tlicai  to  caal  th«ur  vou  for  the  caadidatc  to 
wImoi  tkcy  are  pled^Ml.' 

III.  a  cu^ta  BiflM  be  electad  president  with- 
owl  fMting  a  majority  of  the  |M^Hilar  votes 


A.  llottty 

I.  1  a«l  11  only 

C.  1  awl  111  only 

D.  I.  II.  and  111 


m,  Pitnj^>the  finl^ century  AD.  the  Christian  Churcl 
OMid  he  chamctcfixad  as  oeing: 
f.  a  hifhly  Mnictured  orjiaoUation  with  widespread 
support. 

C.  a  popular  orfaa^    oft  endorsed  by  the  Roman 
Empire, 

-K.  aa  undergrottad  j^oup  of  believers  supported 

iminly  by  Um  Mban  lower  classes. 
J.  a  hwiarcfcical  orpnUation  under  the  pope's  rule. 


41.  An  amendflient  added  to  a  congressional  b;!!  that  is 
irrtlevaat  (o  the  bill  is  called: 

A.  a  filibuster. 

B.  a  rider. 

C.  an  eogrotsmcnt.  , 
'  D.  a^  quonim. 


43.  ReMrdaif  tbcir^  tegal  basis,  local  tovernmcnu  m  the 
'    Uattad  Slates  arc^ 

F.  Icfal  ciealiOM  of  the  U.S.  Constitution. 

C  coinpietcly  independent  of  suie  fovemments  in 
almost  every ^tf. 

H.  legal  crstlioos  nf  the  different  stales. 

J.  jncwasingly  ind  indent  of  both  slate  and  feder.. ' 


43.  Clau  mobility  in  the  United  Statn  has  been  aided  by 
the:  I 

I.  geographic  mobility  of  the  p6puiili6<v^ 

II.  avaikbiliiy  of  plentiful  nauonat  t^uurcet. 

III.  consututional  eliminsiion  of^titlesql  nobility. 

IV.  policy  of  iwiversal  educaiion, 
1. 11,  and  111  only  ' 

B.  I.  II.  and  IV  only 

C.  i,  III,  and  IV  only 

D.  I,  II,  III,  and  IV  ' 


Critics  of  the  petrdeum  industry  cfawrar  that  K  is  aa 
oligopoly,  domiiMted  by  th^  "majorsr— d,  lew  huge  com- 
panies which  niOe  free  compet:tiof  l  Thnr  charge  that  rwag 
gasoUne  prieas  and  the  n^lpct'  hi^  iMits^  ladkale 
oUgopoUslk  controL      "  «  \ 

Most  critics  argue  >  that  this  control  r^ults  from 
wrtkmi  fnugr^loK.tnmtfi^  m  production,  refinina.  dia- 
tnbuiioo,  and  marketing*  the  maiors  control  tl*  oil  from 
wcU  to  ffu  purop^.This,  critics  argua.  allows  the  Ijoi^rs  lo 
squeexc  out  smaUer  oompanies  oMrating  in  onlyone  phase . 
'and  thus  ta  dMife  and^Uy  high  prices.  Fo^axAmpie.  a 
major  jqouU  set  crude  oil  wioas  at  a  high  level,  Uiereby 
nakiag  a  large  enough  profit  ia  vrodoction  to  offseU  loss 
ir,  refining.  An  umat^alcd  refining  cohipcay,  however, 
could  not  afford  to  pay  the  major  such  high  prices  for  ttude' 
oil  and  would  be  foraed  out  of  business.  Fmiilv.  ^mm 
miuors  produce  coal  and  uruuttm.  Opponer^^of  this  Abif*  > 
nw/W  Jivmifie^iipn  vguc  that  this  will  prmnt  com(»^ 
tion  bclwcdi  diflertol  energy  sources  and  ^'ve  the  <  >ajon 
control  over  the  entire  enerfy  market.  Tbese  cnucs  urge 
U^^tioii' orden'i^  the  nuuors  to^-opentc  in  only  onk 
phase,  which  would  require  the  divestiture,  or  seUtng.  of  all\ 
their  as»?to  and  fadbtiss  bi  other  phasT/^  The  legisktioa 
would  also  forbid  horiaontal  dtveruficiaon. 


Industry^  spokesmen  argue ''that  ,  these  charges  are 
groundless.  They  agree  that  the  majors  are  enormous  in  sue 
>  and  waakh  but  argue  that  size  in  itseK  docs  not  produor 
oUiopolistic  power.  They  point  out  that  there  ait  over  a 
^ttadrad  coauaaies  involved  in  producttoo.  simUar 
numbers  m  both  rcfming  and  transport^  and  several 
huadrad  thotttaad  retailers.  ThcV  also  clum  that  4he 
indiHlry's  c^itetmniHon  ntkh-iht  pereentage '  of  the 
market  controUad  by  the  top  four  compaiiZs^ts  below 
thirty-three  percent  w  aH  phases  of  the  industry,  crsuwred 
to  \}urty*niae  peicKttcfor  all  industries  in  the  United  Stales. 
These  spokmmsn  also  assert  that  vertical  integration  pro- 
vides muor  cflfidencics  which  ultimately  Wwer  the  pnae  of 
their  final  products,  la  addition,  several  federal  tagulations 
arc  soppossd  to  prevent  the  orAjors  from  sqiiscxiag  out 
unintegrated  companies.  Tbsy  also  claim  that  rsqpM . 
increases  in  their  profit  margins  are  due  to  a  lifuagof  some 
goveramemal  controls  which  had  unfairly  deprcssedpiofits 
and  to  the  aeed  to  fmaoce  new  explomtion  efforto.  Findlly. 

iU  jnd^nb'i^aw  often-found; 


together,  and  their  devdopownt  rsqutrssc.«uml-r  capa- 
bilities. Horizontal  dtvertification  would  therefore  lead  to 
lower;  not  hig^r,  prices  for  energy. 


44.  The  oil  companies  claim  -  that  some  aovemmenUl 
regulations  have  depressed  their  profits,  which  regula- 
tion would  be  most  likely  to  do  so?  ■» 

F.  f  lacing  a  ceding  on  the  price  of  domestically  pro- 
duced cfudc'oil  >      .      .  . 

G.  Allowing  immediate  deduction  of  drilling  costs  in 
computing  taxable. income,  which  would  rnake 
exploration  for  oil  cheaper  .  . 

H.  Gmiitinf  permission  to  build  the  Alaskan  pipeline 
J,  Gmnting  the  depletion  allowar.ce.  which  wouU 

reduce  the  oil  companies'  taxes 


<4o 
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4S.  Whidi  iituation  i!Iustrites  vertical  mtcfration? 

A.  A  UkU  comptny  seUi  salt  for  both  eattnf  aod 
industrial  purpose*. 

B.  A  food  proocMnf  company  grows,  package),  and 
xlU  its  product, 

C.  A  glfeM  company  makes  window!  for  both  houses 
and  automobiles. 

'    O.  None  of  the  aSove  * 

According  ta  xhc  passage,  most  critics  of  the  oil 
iodustry.would  pfoNiMy  agree  thatr 

F.  co«)  and  uranium  are  b^ter  sources  of  energy  than 
*  petroleum. 

G.  increased  competition  in  the  oil  industry  raises 
gMoline' prices.  ' 

H.  policies  aimed  at  conKrytng  gasohne  are  fuUle  and 
countefproduaive. 

>  J.   the  oU  compantCB  are  gaming  control  of  the  entire 
energy  market,  given  present  trends. 

47.  According  to  industry  spokeMnen.  horizonul  diver- 
sification by  the.  major  oil  compilnies  would  result  In. 
I.  more  eHkient  development  of  energy  re- 
sources. I 
n.  an  end  to  competition  between  different 

energy  sources. 
Ill,  lower  prices  fOr-energy.  * 

A.  II  only 

B.  !II  only  * 

C.  ^1  and  II  only 
Vtri^nd  III  only 

4i.  Production  of  oil  and  gasoline  from  deposits  wtlhin  the 
United  Sutes  has  declined  in  the  last  d.*cade.  Oil 
industry  spokesmen  would  probably  argue  that  this  is 
due  to  all  of  the  following  reasons  EXCEPT  (hat: 
F»  federal  .Uw  requires  post-1975  cars  to  burn 

unlcAdecl  pioline.  which  is  harder  and  more 
y        expensive' to  refine. 

fovemmentai  regulations  discourage  exploration 

lor  new  deposits. 
H;  oil  companies, are  holding  back  production  in 

order  to'^dnve  up  prices. 
J.   new,  offshore  Oil  fields  are  much  harder  to  develop 

than  those  on  land. 


49i  When  the  author  speaks  of  an  "unintegnied*  oil 
company  (second  paragraph),  she  means  a  company 
which:  < 

A.  does  not  inake  a  big  enough  profit  to  suy  in 
business. 

B.  operates  in  only  one  phase  of  the  industry. 

C.  charges  artificially  high  prkoi. 

D.  contrail  only  a  uny  percenuge  of  the  industry's 
^rket< 


,  Spokesmen  for  the  oil  industry  argue  that  horuonul 
diver^fication'will: 

F.  avoid  unnecessary  and  expensive  duplication  of 
effort'in  developing  energy  sources. 

G«  counteract  the  artificially  high  prices  i  presently 
being  charged  by  the  coal  mdustry. 

H.  yieU  more  cfHaencies  than  doc*  vertiail^totegn- 
tion. 

J.  answer  ihe^ public's  greater  demand  for  oil  than  for 
coal  tad  uranium*  * 

S  - 


51.  Spokesmen  for  the  oil  industry  would  probably  agree 
with  all  of  the  following  sutements  EXCEPT  that: 

A.  vertical,  integration^  is  a  very  efficient  forr.i  of 
industrial  organization. 

B.  governmental  control^  are  necesury  to  protect 
consumers  against  exceuive  fuel  pnces. 

C.  the  oU  industry  is  more  competitive  than  most 
Amencan  indus|pes. 

D.  oil  companies  need  a  good  profit  margin  to 
iupport  costly  exploration  efforts. 


52.  By  ^Artificially  high  prices"  (second  paragraph),  the 
author  means  prices  that  are: 

F.  high  enough  to  produce  a  larfc  profit  fo(  the  seller. 

G.  hi^er  th^n  free  nurket  competition  would  allow. 

H.  the  result  of  high  demand  and  low  supply. 
J.   the  result  of  low  d^nand  and  high  supply. 
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TEtT4 

MATUPiAL  SCIENCES  RCADINQ 

'  35  Mmutts—52  Questions 

DiniCnONS:  Each  p«M«o«  in  mit  tMt  ft  followed 
MV9f  ai  quMtk>n«.  Attar  rtading  a  paaiaga,  chooaa  tha 
baat  anawar  to  aach  quaation  and  Mackan  tha  corra- 
sponding  tpaca  on  your  anawar  »haat.  You  may 
to  tt)a  paaaaga  at.ottan  a»  n^oaaaary.  t 


A  volcano  k  an  opcniog  in  the  eaith't  cnisMbrough 
which  mtigmm  (amajftmated  ^volcanic  |ai«*  and  molun 
rock)  ttdiwharpeduhva.  The  vofcaaicfuei:  thai  arc  aUo 
eniittwi  are  believed  to  be  a  oombtnatton  of  waur,  hydrcK 
fcs,  carhon  moaoudc  and  dioiide,  nitrofen,  argon,  lullur 
anfl  iu  oude  coiapottBde.  and  cUonnr.-^^ 

'»      The  laieaMty  of  a  vokankexpkwion  depends  upon  the 
number  and  size  of  the  |U  bubblea'fonned  m  the  mohen 
^  rock  beneath  the  earth's  cruet.  Tiny  bubbles  of  volcanic  fas 

^  rise 'within  the  maaba,  collide,  and  merte  to  form  larger 
bubbles,  until  a.bubble  of  coMiderable  size  and  murnal 
mseurt  forms  near  the  surface  of  the  mohen  rock.  Thu 
MW  buhWe  exraada  untU  the  piatsure  ewrted'«fainst  the  i 
wall  of  the  bubUe  overcomes  the  surface  tension  of  the 
mohen  rock,  whereupon  the  bubbb  explodes.  The  burst- 
ing of/a  nmm  of  hrfe.  hifh-pretsure  bubbles  produces  a 
volcanic  eruption.  * 

-  'Volcanoes  are  claasifwd  mtoi  citeforia.  ranjihg  front 
least  to  moet  intenaive:  Fissure.  Hawaiian,  Stromboban, 
Vulcanian,  Plinian.  and  Pelcan. 

A  FiiMire  volMao  expela  large  amounts  of  lava 
through  loAgMrizQMal  cracks  in  the  earth's  surface. , 

,  The  eruption  of  a  HawaiianvoI»nd  is  couiparativelf 
,  quiet  and  nay  form  tekcs  of  very  fluid  molun  lava. 

A  Siroiabolka  vokano  emits  lominoua  cloudt  during 
rcktivdy  aUd,  lacurrent  ecuptiona.  It  shoots  ash  and  hot ' 
lava  hi^  into  the  air,  where  the  hva  cook  into  round  dr 
spindle  slopes  before  faOing  to  earth. 

•ctwara'^tueocMive  eniptioos;  a  Vukanian  volcano 
forms  a  plug  of  hardeaad  lava  that  is  blown  out  by  uitcnse 
■MMM  prosure  aa  large*  dcMructive  blocks  of  rock.  It 
tmks  a  large  cloud  of  gas  and  ash  and  may  produce  a  thick, 
thoft  lava  flow  or  noae  at  all.  Vofcanie  durt  permeatw  the 
aiinoepheiv  and  causes  changes  is  the  color  of  the  sky. 
1  I 

t '  Gaa  within  a  PliniaD  vokaDo  rushes  through  great 
inUaes  of  hva.  puffing  it  up  aad  solidifying  it  into  a  light 
ind' porous  rocfc.that.coattini  numerous  tiny  pockets  of 
^  Froth  and  Uva  flow  in  glowing  rivers  down  the 
vcHcaaoV  exterior. 


1  The  f  clean  volcano,  mosi 
•U|  is  characteriud  by  (he  gr^t 


expto'stve  and^tructive  of 
)wtn  0^  a  volcanic  dome,  it 


'  63J 


er|c 


emits  incandescent  clouds  of  steam  and  ash  and  extremely 
mobile  avalanches  of  lava  that  desuoy  everything  m  theu"  - 
paths,  / 

1.  Which  type<s)  of  volcano  would  emit  small,  spindle- 
tike  pieces  of  >ock? 

I.  Stromboliao  / 

II.  Vukanian  / 

III.  Pliaian         ,  * 

IV.  Fissure 

A.  I  only 

1.  I  and  IV  only  / 
C.  II  and  III  only  / 
p.  I,  III.  and  IV  onl^ 

2.  The  greatest  probable  danrr  at  the  time  of  a  Fissure 
volcano's  eruption  the: 

r.  rapid  lk)W  of  Ifva. 
.C^.resultmg  toycr  .of.vokani&^th  - 
H.  reaction  of  hot  volcanic  ^bes  with  cool  air. 
i.  rcfcase  of  large  amounU  of  vokanic  gases. 

3.  Which  meteo/otogical  phenomenon  most  immediately  ^ 
follows  a  Vuioai^n  eruption? 

A.  Rain,  bacauM  climatic  conditions  arextisiupted 
n.  Cookr  tem^turca,  because  new  knd  m  form^ 

C.  Spectacular  sunsets,  because  a  large  cloud  of  ash  la 
emitted  ' 

D.  Drought,  because  the  lava  flows  absorb  moNture 

4.  Why  is  knowWdae  about  the  composition  of  vokaaic 
gsaea  incomplete? 

No  safe  method  has, been  devis«i  forcolkctiag 
sampks  of  ^scs  from. the  cone  of  aa  erupting 
volcano.  v    .  . 

C.  Methods  for  studying  volcanoes  are  so  new  that 
very  few  gas  samples  have  been  collected. 

H.  Methods  for  separating  one  gas  from  another  are 
quite  inaccurate.  .  '  ^ 

J.  Some  of  the  gases  contained  within  the  magma  an 

w  not  inert. 

5.  the  surface  tension  of  magma  allows  a  gas  buhbte  to 
escape^only  when  the  pressure  ansing  from  surfioc 
tension: 

\       A.  equals  the  pressure  of  tbe«r»  ^^bk.  , 

B.  if  excaedad  by  the  pressure  of  the,  gas  bubbk. 

C.  is  exceeded  by  the  pressure  of  the  molten  rock. 

D.  iii  exceeded  by  the  pressure  of  the  surroundmg  air. 
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tfb.Wlucil  ty^e  oC  v<^cmo  maim  a  freai  dome? 
r.  Pdnn 
C.  'Stroifcotim 

i.  fUwaiuut 


,  Which  tei)uenoe,comclly  orders  Hiwtuaii«  ftinian. 
and  Vuicaniai)  voioinocs.  from  the  volcano  that  eimu 
the  mott  fas  and  viscous  lava  to  the  one  that  emits  the 
kas(  gu  and  viscous  lav^? 

A.  HaiMiiian,  f  Unian.  VuJcanian 

B.  fluuBn.  VuicaDjiAO^  Hawaiian 

C.  PVnian.  Hawaiiap;  Vulcanian 
0.  yulcanian.  flinian.  Hawaiian 


/ 


I.  Larfe  Uodts  of  rock  JUt  ejected  from  Vulauuan  vol^ 
caooca  Wcauae  fa^  preasure: 

F.  tracts  loose  ^rock-'around  the  exterior  of  the 
voloaM« 

G.  causes  virfcanic  ash  aad  dust  to  solidify  into  larfc* 
rocks^ 

n  il,.  dianifU  the  cone  of  the  volcano,  blowing  rocks 
into  the  air. 

J.  expels  lava. with  such  forcer  that  it  la  returned  to 
earth  as  Ught  an^^  porous  rock,  . 

[    9.  Why  do  vokanic  gas  bubbles  rise  within  the  magma 
under  tbe  earth's  crust? 

A.  Heat  within  the  magma  ttanafen  energy  to  the 
bubbles*  aUowiiy  therik  to  rise. 

B.  Tbe  surfisoe  tension  of  tiny,  bubbles  causes  them  to 
riae  to  the  surface  of  the  magnia. 

C.  Since  volcanic  gas  U  lighter  than  mohen  rock,  the 
bubbles  rise. 

D.  The  gas  bubbles  are  too  large  to  be  constrained  by 
iht  magma. 
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Nilrofcn  ts  «; useful  and  versatile  elemetiL  Found  in 
many  vital  iutHtancei.  nil rof en  compounds  are  important 
pHLinany  btologicat  and  Cheinica)  reactions. 

Atomic  nhrogen  (N)  ts  i)e%er  found  free  irr nature,  but 
always  in  a  combined  siate.  As  a  dialomic  (J^i)*  <i 
constitutes  ib<iiar|es(  fradion  of  the  earth's  aimocphere*  The 
Nj  /nokculc  is  held  together  by  3  covakni  bonds,  each 
containing  a  pair  of  electron*,  which  make  it  t;iiremely 
lUNc-  Dttipmic  niifOfcn  can  be  ttquefied  at  I95.f  degrees 
CeIs)U(.^whKh  ii  a  uiefMfcooIani  m  low>iempetaiure 
experimentil 

When  nitrogen  u  combined  with  oxyfcn.  compounds 
whJsc  properties  depend  on  (he  molecular  raito  of  N  to  0 
atom  J  resuh.*  Nitrous  oxide  (NjO),  commonly,  called  laugh- 
ing gas, »  a  colorless.  sweet'Smelling  gas  ihat  easily  decom* 
poses.  NjUic  ox'kJe  (NO)  and  nitrogen  dioxide  CNOj)  are 
loxic  almospheric  poUuunis  released  in  the  exhausts  of 
combustion  engirKS.  Nitrogen  dioxide  combines  wjih  water 
vapor  to  form  nitric  .acid  (HNO,).  which  corrodes  the 
exteriors  of  buildings  and  statues.  Nunc  oxide  and  nitrogen 
dioxide  are  involved  m  a  Sequence  of  reactions  thai  convert 
o7one  in  the  upper  atmosphere  to  ordinary  Oj. 

When  nitrogen  oxidci  combine  wtlh  catbon  com> 
pounds,  the  resulting  compounds  can  be  explosive  Nitro* 
glycerin  (C,H>N>0,)  was  far  too  difficult  lo  handle  safely 
until  Alfred  Nobel  found  a  way  lo  absorb  it  onio  finely 
divided  clay;  ihis^prcduct  is  ealled  dynamite  Tnnitroioluene 
(TNT)  is  another  hydrocarbon  compound  into  which 
niirofcn  oxide  groups  are  incorporated. 

/ 

Nitrogen  is  also  important  in  a  biological  cyck  catied 
llhe  nitrogen,  cycle.  A  special  group  of  bacteria  can  "fix" 
mokcular  N;.  transforming  it  iniO  nitrate  (NOf).  which 
plants  absorb  for  food.  These  "niirogen-fixing**  bacteria  live 
in  ihe  soil  on  the  roots  of  certain  pealike  plants  called 
legumes  fftnti  transform  the  niiraies  into  plant  protein, 
and  aninuls  fat  the  pbnis  and  transform  plint  protein  into 
animal  pfoiein.-O^nimal  wastes  coniain  urea  (CCHNHi)!}  ^O"* 
ammonu  (NH,),  which  are^  converted  to  nitraie*  through 
oxidation  and  bacterial  action.  Nitrogen-depkicd  soil  ca  n  be 
feriili/ed  with  these  or  similar  compounds  or  routed  in 
leguminous  plants. 


IX  Which  deicription  define*  the  propcrtiei  of  a  diatomic 
-  nitrogen  molecuk? 

F.  It  k  extremely  corrosive. 

G«  h  conubf  it.  triple  bond. 

H.  h  explode*  when  reacted  with  carbon  dioxide. 

J,  It  quickly  reacti  to  decompose  ozone- 

13.  The  htatoric  architecture  of  many  cities  is  sWor  erod* 
int  because  of  industrial  air  pollution.  Which  chemical 
if  in  part  reaponsibk  for  this  corrosion? 

A.  N: 

B.  NjO 

C.  NO 

D.  >M0) 

« 

14.  The  most  likely  composinon  of  TNT  is. 

F.  carbon,  ntirogen.  hydrogen,  end  oxygen 

G.  carbon,  nitrogen,  and  hydrogen.  * 

H.  carbon  and  nitrogen, 
i.  ^  nitrogen  and  sulfur. 

15.  S6me  persons  believe  thai  ihe  operation  of  supersonic 
aircraft  will  deplete  the  o^one  layer,  since  nunc  oxide 
from  exhaust  fumes  may  tcact  with  the  ozone  This 
reflects  concerft  aboui  which  chemical  reaction'' 

A.  NjtJHj  ^'2Nlb 

V.  Nj  +  Oj  2N0 

C.  H20tCO(NH2)2  -*C02+2NH, 

D«  NO  +  03-^02i-N02  ^ 

U.  The  molecular  property  known  as  pararoagneium  is 
generally  exhibited  by  compounds  conUintng  unpaired 
ekctrona.  If.C,  N«  O,  and  H  have  6.  7«  1,  and  1  elec- 
tron!, rctpeciively^  which  lubsuncc  is  paramagnetic' 

F.  N2, which  has  U  elecir0n«  * 

G.  N2O.  which  has  22  electrons 

H.  NO2,  which  has  23  electrons 

J.  CjMsNjOt,  which  has  116  ekctrons 


1^.  A  panicttlar  chemical  reaction  occurs  onjjv  after  ihc 
subaunces  are  cookd  below  ^190  degrees  Celsius.  The 
coolant  uaed  for  thk  experiment  is  most  probably: 
f,  riaaeoua  N2O 
0,  bquid  K2. 

H,  gnaeou*  Oi,  « 

J.   bqukt  Nfl). 


il.  A  eeriain  compound  contains  O  and  N  aioms  in  a  2.1 
ratio.  Another  compound  contains  these  elements  in  a 
52  ratio.  One  conclusion  thai  can  be  reached  about 
these  compounds  is  thai  they. 
A«  are  exploiive^ 

V.  have  different  mokcular  properties. 

C.  are  identical  compounds* 

D.  have  similar  rates  of  reaction. 


17.  Which  of  the  following  \\  NOT  an  integral  part  of  the 
nitrogen  cyck?  ^ 

A.  Charcoal 

B.  Air 

Ci  Ammonia 
D.  Legumes 

\ 

|g.  In  nitroglycerin  (CjH,N»0»).  every  oxygen  aiom  is 
bonded  to  \  nitrogen  aiom«  and  each  carbon  atom  is 
bonded  to  I  oxygen  atom.  How  many^oxygcn  atoms  are 
NOT  bonded  10  a  carbon  atom? 

F-  0  ^> 

C.  3     ^  \ 

H.  6  ^ 

J.  9 
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1 iir*  not  b«Md  on  « rMcHng  pM- 
Mg«.  YoiTaKt  to  imm_tb9m  quMttont  on  m# 
bMis  of  your  pr«viou«  achoolwoffc  tn  tho  ncturil 


23.  WhkhftMcaieatexpkiiuwhy.uapenMtoctiipini 
ktUMt,  the  *tciikpiiefaturt  of  tlK  tyrrouiidiQC  air 


•trtkTEui  tlK  bwer  air. 

B.  iWre  M  kti  btatfivini  mdioactlvity  in  the  upper 
air. 

C.  Tht  uppcT'air  ii  dcMcr  than  the  surface  air< 

D.  None  of  the  ahove 


,  A  laboratory  experiment  rcquirw  that  a  culture  hav«  a 
"maimal  matfiufli'  f:imt«hed  for  the  irowth  of  an 
orianiM).  Jhia  neani  thai  tiie  nM^nim  should: 

A.  provMc  oMinal  growing  oonrfitione. 

B.  live  Mpflenemal  notnenu  for  growth  aooekn- 
tao«/ 

C.  oootain  only  thoee  rtefntisli  naadrd  for  growth. 

D.  contain  a  cMBical  which  WMid  inhibit  reproduc- 


tive activitiea. 


M.  The  photocynthc^  activity  <^  a  plant  could  be 
iacreansd  by: 

f.  adding  nagnMium  to  the  loil. 
C. '  incraajing  the  humidity  in  the  air. 
H.  reducing  the  aiQoti^^of  light, 
i.  increaiias  the  amount  of  Ijght. 


21.  Which  flyttcm(i)  couU  be  used  as  a  thermometer? 

1.  A  li<^uid  that  expands  as  it  is  heated  I'n  a 
^ '  container 

IL  An  ekctricarresistor  that  increases  Its  restsuncc 
as  it  is  heated  ' 

III.  A  Junction  of  diMimilar  meuls  that  generates 
an  increaiiflg  vohage  as  it  is  heated 

IV.  A  gas  that  increases  in  pressure  as  it  is  heated  in 
a  closed  container 

A.  I  only 

B.  II  only 

C  I  and  M  only 
O.  1 11.  111.  and  IV 


24.  Heat  is  added  at  a  uniform  rate  to  a  beaker  of  ice  that  ts 
at  a  tenpenture  below  the  freezing  point.  A  record  <^ 
the  temperature  bf  the  system  is  )cept»  from  the  time  the 
heating  process  is' started  until  the  subecquent  water 
evaporates.  The  graph  depicts  the  system's  temperature 
until  the  melted  ice  water  has  evaporated.  Why  a  line  D 
longer  than  Une  B? 


F.  More  heat  is  needed  to  change  a  |ram  of  water  to 
steam  than  to  change  a  gram  of  loe  to  water. 

G.  There  ts  more  water  to  be  hcatad  than  there  had 
been  ioe.  * 

H.  Steam  and  water  cannot  exist  at  the  same  temper- 
ature. 

J.'  Staam  conducts  heat  better  than  water  does. 


25.  The  xylem  and  jAloem  tissues  of  vascular  plants  are 
analogous  to  blood  tissues  in  animals  because  these 
tisaues: 

A.  provide  structural  support. 

B.  carry  dissotvad  minerals  and  nutrients. 

C.  supply  oxygen  to  the  cells. 

D.  carry.cartMn  dioxide  from  the  oelU< 


22<  A  saltwater  solution  could  be  separated  into  salt  and 
water  by  means  of: 

^    F.  fUtration. 

G.  dilution. 

H.  distillation. 
J.  electrolysis. 


U.  When  the  moisture  content  of  the  air  is  high  and  tem- 
peraluRS  are  about  77  degrees  Fahrenheit,  which  situ- 
atton  will  most  likety  occur? 

F.  OUukr  division  in  airborne  bacteria  will  be 
inhibited. 

G.  Seed  phints  will  become  dormant. 

H.  The  nite  of  trarupiration  in  foresu  will  increase. 
J.   Fung^  win  fioi^rish. 


41 


QO  ON  TO  THE  NEXT  PAOE. 


834 


'    630  / 


17«  In  the  crott  tection  of  rock  shown  below,  (be  /ode 
Uy<n  at*  cut  by  «n  intrutive  rock  body  and  by  a  fault 
a£  Which  tw^ycnce  bett  de«cnbes  thc.chronolotical 
occurrtttcc  of  the  evtnti  dcptctcd,  from  okktt  to^ 
youoicst? 


I.  Dcpotition  of  layered  uniu 
n.  Fauhtnf 
Ill.Jntrusion 

A.  >.  H.  Ill 
•.  J.  111.  U 

C.  tU.  I 

D.  11^.  11 

.  Which  twhniaue  should  he  uicd  to  conitruct  a  penna- 
ncnt  mai^  from  an  unmagnetized  iron  b^r? 
F.  irii^ini  (he  Iron  bar  near  a  coU  through  which 
»hcmatu)|  current  u  flowing 

'  C.  Sawing  the  ertdi  off  the  bar  to  expoie  iti  magnetic 

\i,  Stroking  the  bar  rqjiatadly  in  one  direction  with 
one  pok  of  a  strong  magiwt 

J.  Placing  (he  bar  in  a  urong  electric  field  at  a  tem- 
perature of  0*  C 


3a.  In  the  experiment  depicted  below,  the  «y«P0U  of 
cuglaia»«are.r«Dovcd.  and  the  euglenas  are  placed  m 
beaker  f  loder  can  f.  leaker  which  conuint  nor- 
mal eugienai.  it  placed  under  can  A,  Both  cans  are  then 
placed  in  the  light.  After  24  hours,  it  is  observed  that 
thc^euflenai'in  besker  A  have  congregated  near  the 
light  source;  but  the  euglenas  in  beaker  f  are  evenly 
dispersed  throughout  the  water. 


One  of  (he  purposes  of  this  experiment  is  to  determine: 

F.  the  effect  of  Uiht  on  euglenas. 

G.  the  function  of  the  eyespots  of  euglenas. 

H.  whether  euglenas  always  require  light. 
J.  if  euglenas  can  photosynthesize. 


33.  Which^type  of  reaction  is  illustrated  by  the  chemical 
equation  ^ven  below? 


ClliCH«CHaij*Br, 


*  cHsCU-aiciij 

Kf  Br 


A.  Elimination 
1.  Addition 

C.  Substitution 

D.  Replacement 


29.  Because  thc.spccific  heat  of  water  is  greater  than  the 
specific  heat  of  a  meul»  one  knows  that  water: 
A.  has  a  higher  specific  gravity  than  moet  meuls, 

•    B,  has  more  mass  than  most  metals. 

C.  cools  more  auicklyjhan  an  equal  mass  of  any 
metal  when  the.souroe  of  heat  u  removed. 

D.  naads  more  heat  than  an  equal  mass  of  metal  to 
experience  a  rise  in  temperature  equal  to  that  of 
the  meul.  / 


3«.  Which  statement  does  NOT  dejcnhe  a  property  of  a 
baK?  V 

F.  It  ionizes  to  give  hydroxide  ions. 

G.  It  turns  htmu  paper  blue. 

H.  It  tastes  bitter. 

J.  It  reacts  with  metals  to  give  off  hydrogen  gas  (H]) 

31,  The  great  strength  of  the  carbon>carbon  bond  in 
diamonds  is  a  result  of  which  kino  of  chemical  bond"^ 

A.  Ionic 

B.  Metallic 

C.  Covalent 

D.  Amorphouii 


In  nuclear  Ass'ion,  the  nucleus  of  an  atom  is  snht  into  2 
pieces.  Two  forces  are  involved  in  this  process:- the  strong 
nuclear  Jbrct,  which  is  a  powerful  attraction  among  neigh- 
boring neutrons  and  protons,  and  the  electric*!  force* 
which  is  a  repulsion  between  pain  of  protons  in  the 
nucleus.  The  nuclear  force  ia  the  strongest  force  that  occurs 
in  nature;  however,  its  range  is  limited  so  that,  like  glue,  it 
acts  between  2  particle*  only  when  they  are  touching  each 
other.  On  the  other  hand,  the  electrical  force  acts  upon  «// 
protons  regardless  of  the  distance  between  them.  Splitting 
the  nucleus  into  2  parts  leaves  the  nuclear  attraction 
between  the  nuclear  particles  within  each  half  almost 
unchanged,  but  permits  the  electrical  repulsive  force  to  tep- 
arale  the  paru  of  the  nucleus.  The  energy  of  the  fission  frag- 
ments is  released  aa  motion. 
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Fmitm  M  MMubfe  only  lor  xktm  oucki  OMt  teve  • 
•ymhcr  ««  protom  tW,  thciifore,  a  kife  imbtkooe 
of  ritctrical  trntfy.  But  lk«  proWbibiy  that  a  oucUiuwiU 
ifoimotttly  fiMMD  ii  dttcmM  ky.ihe  tnterntl  scrue- 
tiire  of  the  aiaclMH.  Even  tliough  iborium  and  oranium  arc 
the  heavieM  etementa  found  on  «anh  (that  h,  they  have 
brie  muabm  of  neutfoas  and  protons),  they  have  low 
proteMiiice  for  ^NHitaneoa*  fwaioo.  Otherwiic  their  nude! 
would  have  finionia  away  (at  have  much  heavier  ele- 
roento)  in  the  5  biOion  ycnra  lince  the  ebnenU  were  formed 
in  a  MSkr  «   '  ' 


Adding  neutrona  to  heavy  nuckt  can  induce  nuclear 
raaion.  However,  the  proceia  of  adding  neutroni  is  effec* 
tivf  in  inducing  fiaijon  for  only  one  kino  of  naturally  occur- 
ring Audeus:  uranium  Toe  other  naturally  occurring 
elements  hiving  heavy  nucki  limply  "swallow*  or  absorb 
neutrons  witlymt  splitting  and  form  different  nuclei. 


37.  The  etactrical  force  betwcca  2  proton*  that  are  <w 
opposite  sides  of  an  atomic  nodeus  cause*  the  protons 

to: 

A.  neutralize  each  other"!  charges. 

B.  attract  each  other. 

C.  repel  each  other. 

D.  change  into  neutrons. 


31.  if  an  eknsent  heavier  than  uranium  were  ditcover*d 
among  tbe  energetic  particles  from  outer  space,  the 
author  would  probabiy  coochidc  that  the  element  came 
from: 

F.  th«  ftssion  of  an  element  in  the  earth's  atmo* 
sphere. 

G.  debris  from  a  nuclear  reaction  on  earth, 
,H,  a  resent  stellar  explosion. 

J.  a  comet. 


tccause  every  fission  event  in  an  induced  nuclear  Hs- 
jion  reaction  rdeaies  one  or  more  neutrons,  secondary  neu« 
trons  can  also  induce  fission,  if  adtiitional  fissionable 
materia!  is  present.  Thus,  m  chmht' r**ctton  can  be- pro- 
duced. In  a  nuclear  nMctor^  the  chain  reaction  is  cont/olled 
so  that  precisely  one  neutron  from  each  fission  event  resuhs 
in  one  other  fusion  event<  If  it  is  not  controlled,  the  reac- 
tion will  proceed  expioiivel/F  * ' 


39.  Which  elefflent;hai  the  highe  it 'probability  of  spon* 
uneous  fission? 

A.  Hydroaeo  2 

B.  arbon  12 

C.  Oxygen  76 

D.  Americium  243 


34.  Possible  sources  of  darijer  in  the  operation  of  nuclear 
reactors  include: 

F.  tW  release  of  fisiion  products 

G.  an  uncontrolled  chain  reaction. 

H.  excess  heat.  ^ 
J.  all  of  the  above. 


4g.  When  nuclear  fission  occurs  in  a  larye  nuus  offtaston' 
able  material,  the  energy  of  the  fiaeton  frsf:.Aents  is: 
F.  released  as  motion  and  dissipated  as  heat. 
C;  destroyed  by  fission. 
Hf  used  to  reconstruct  the  nucleus. 
J.  used  to  attract  the  fragments  into  one  mast. 


35.  If  nuclear  fission  did  not  produce  seccndary  neutroni. 
whidi  of  the  following  would  NOT  occur? 

A.  A  Cham  reaction 

B.  Nuclear  fission 

C.  An  electrical  fo/ce  between  protoni 

D.  Natural  thorium  or  uranium 


41.  The  age  of  the  earth  can  be  estimated  bv  deterniinin| 
the  relative  amounts  of  uranium  235  and  uramum  23i 
in  rock  samples.  Such  an  estimate  wouUhe  INVALID 
if  the  samplei  had: 

A.  under)|one  chemical  analysis. 

B.  conUined  a  Urge  percenuge  of  thorium. 

C.  been  irradiated  with  neutrons. 

D.  been  heated  to  a  high  temperature. 


34<  The  energy  relented  m  a  nuclear  fusion  radion  hai  iti 
ongin  in  which  Yorce? 

F.  Electrical 

G.  Gravitational 

H.  Frictional 
J.  Magnetic 
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42.  According  to  the  pAisage,  the  prima ty  difference 
between  spontaneous  fitsion  and  induced  nstton  is  that 
sponUneoui  fiiiion: 

F.  releases  a  great  deal  of  energy. 

G.  produces  a  chain  reaction. 

H.  docs  not  iplit  the  nudeu*  into  2  parti. 

J.  does  not  require  the  addition  of  neutrons. 
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In  the  muMtOCK  Henr^.  Uu%  obseiv«d  (hat  ccruin 
Mtoubk  buiietflici  of  the  uimtly  PierkUe,  which  cioMly 
rcicmbled  Hxcimcnt  of  the  butterfly  family  Heliconitfue, 
ittccettfvUly  protected  themselves  from  being  eaten  by-act- 
ini"  hke  unpalatable  and  Ufuccemabie  Helicpniids. 
This  phenomenon,  whereby  a  .harmleu  and  paiauble 
orfamim  adaptt  to  the  appearance  or  behavior  of  a  dis- 
tableful  specks  in  order  to  evade  predators,  has  been 
'termed  mtrsmn  m/mlTcr/..  Three,  animals  are  usually 
involved  in  this  refcitionshipJ  the  mothi,  the  animal  that  is 
avoided  for  iu  unpalatability;  the  mimic,  the  animal  (hat 
successfully  imiutes  the  waminf  stimuh  of  the  model,  and 
the  rtctwtr,  the  animal  that  notes  and  is  deceived  by  these 
likenesses* 

Mimicry  is  not  restricted  >^»ely  lo  appearance.  The 
development  of  mimetic  colo?  patterns  u  often  accompa- 
nied by  other  changes.  MimetiC  rcKmblancrt  show  adapta- 
tions  involving  posture,  movement,  and  sound.  These 
modiHcations  arc  usually  accomplished  without  any  alter-  ^ 
ation  of  the  organtsm's  anatomy.  It  is  incredible  that  such 
striking  similantici  «n  be  produced  in  the  niimic  by  differ- 
ent  Mructures  and  chemicals  than  those  in  the  model 

Since  the  mimic's  success' depends  upon  the  receiver's 
awareneu  of  the  disusteful  model,  the  adaputions  that  the 
mimic  seKts  are  related  to  the  receiver's  learning  abilities 
and  Knsory  capacities.  The"  receiver  misukes  the  mimic  for 
the  model  because  the  recaver's  senses  are  confused 
,  Sufficient;,  protection  may  be  provided  even  il  the  resem- 
blance  of  the  mimic  to  the  model  \t  not  ewict.  For  instance, 
in  localities  where  the  model  is  found  very  "rely,  the  iden- 
tifying  stimuli  of  the  mimic  need  not  be  perfect.  The  prcs-  ^ 
ence  of  both'  model  and  mimic  at  the  same  time  and  in  the 
ame  area,  however,  requires  the  mimic  to  display  a  greater 
degree  of  similarity  to  the  model  than  when  the  model  is 
absent. 

Scientists  theoriie  that  mimetic  resembtances  have 
originated  in  a  manner  similar  to  other  type*  of  adapta> 
tions.  ittai  is,  as  response*  :o  environmental  situations,  ine 

Sobability  of  mimetic  adaptation  is  influenced  by  several 
ctors. /including  the  sire  of  the  model  population,  the 
amount  of  predation  of  the  mimic  and  the  number  of 
mimics  resembling  the  same  model,  Throu;^  time,  protec- 
tive characteristic*  are  adapted  by  jh- mimic,  modinca- 
tions  are  contihued  until'the  organism  achieves  a  satisfac* 
tdry  likeness  to  the  model. 

43.  Which  organisms  wbuld  be  expected  to  have  evolved 
the  largest  numbers  and  vaneties  of  mimics? 

A.  MammaU 

B.  Birds 

C.  Amphibians  . 

D.  Insects  < 

44.  The  receiver  is  important  m  Batesian  mimicry  because: 
F.  the  receiver  protects  the  model  from  predation 
C.  the  receiver  propagates  the  model  and  the  mimetic 

species.  .  . 

h.  without  the  receiver  the  adaptations  made  by  the 

mimic  are  unneces«ry.  ,  , 

J.   without  ,the  receiver  the  bfe  cycle  ur.ihe  mimic  is 

incomplete. 


45.  As  a  member  of  a  mimetic  relarionship..a  mode]  can,l>e 
described  u  an  organism  that; 

A.  escapes  predation  by  some  animals  because  of  its 
unpalaubibty.  ^  , 

B.  looks  like  another  animal  because  It  IS  a  member  or 

the  same  ^cies. 
C  adapts  to  the  appearance  of  another^an'mal. 
D.  recognize*  the  warning  characteristics  of  an  ani* 

mal  before  eating  it. 

44.  For  the  purposes  of  mimicry,  which  charactensUc(s) 
might  an  organism  eventually  adapt? 
I.  A  body  pattern 
M.  A  digging  behavior 
III.  A  buzzing  sound 

I  only 

G.  Ill  only 

H,  I  and  II  only 
J.  I.     and  III 

47.  If  a  receiver  did  not  have  good  eyesight,  which  charac- 
terislio(s)  iiiight  a  mimic  and  a  model  share  lor 
protection? 

I.  A  very  tntncate  body  pattern 

II.  A  spiked  appendage  under  the  body 

III.  A  peculiar  strong  odor  v 

A.  I  only 

B.  111  onlv 

C.  I  and  i»  only 

D.  I,  II,  and  III  . 

41,  According  to  the  passage,  mimetic  species  have  evolved 
in  order  to:  > 

F.  camouflage  the  model  from  the  receiver 

G.  increase  the  amount  of  unpalatable, prey. 

H.  protect  tliemselvcs  from  predators. 
J.   distract  the  receiver  from  the  model. 

4»,  Under  which  circumsUnce  wduW  mimicry  of  a  bird 
specie,  most  bkely  evolve  over  a  long  penod  of  titiK? 
A   A  severe  drought  devutates  the  foliage  of  an  entire 
area,  thereby  elimihii.ing  the  food  supply  of  cer^ 
tain  birds.  .  , 

B.  A  forest  fire  denudes  «  hillside  and  permanently 
destroys  the  nesting  sites  of  nuiny  birds. 

C.  A  chemical  is  sprayed  on  certain  bushes,  and  birds 
that  eat  the  berries  of  these  bushes  produce  eggs 
with  brittle  shells.         .         ,       .  , 

D.  -  An  earthquake  forces  predators  of  certain  birds  to 
search  for  new  habitats,  and  these  predators  repro- 
duce in  Sreat  numbers* 

5g.  The  receiver  perceives  the  mimic  as  a  model  because 
the  receiver; 

*  F,  recognizes  the  v^rning  stimuli  of  the  model. 

G.  learns  that  both  or|anism$  are  palatable, 

H.  attracts  both  the  mimic  and  the  model 
J.  has  an  acute  tense  of  sight. 
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SL  How  does  mimicry  contnbute  to  and  suppg^  the 
theory  of  evolution? 

A*  Effective  mimetic  re«embl«nccs  are  produced  and 
modified  (qt  the  procesief  of  nalunl  selection. 

B.  Mimetic  species  show  a  change  over  centuries  from 
^  treater  to  «  lesser  rcKmbbnce  to  th^  model 

C.  ^^metic  species  ortfinalt/  possesses  all  the 
resCTBblances  to  the  model  speaes  that  U  ever  will 

D<  Hie  rekcfflblance  of  the  mimic  to  the  model  affects 
featurtaTlUl  are  unrelated  to  the  behavior  of  the 
mimic  ,  * 


4 


52.  A  mimtc  does  nOt  need  to  closely  resemble  an  unpal* 
atabte  model  ITone  species  inhabits  a  different  area  than 
the  other  because  the 

F.  receiver  learns  to  associate  a  feneral  pattern  with  a 
M  taste. 

G.  mimic  no  loafer  competes  with  the  model  for  food, 

H.  minuc  U  not  palatable  prey  for  the  receiver. 

J.  same  recejver  does  not  pther  food  from  two  dtf* 
ferent  arca|<. 


.  END  OF  TEST  4. 
STOP!  DO  NOT  RETURN  TO  ANY  OTHER  TEST. 


Answer  Kty  jo  Sampit  Ttst  Bookitt 


EnfNth  UMf* 

TMt2 

McthMMtlCt  UMf« 

1  c 

11  C 

21  B 

it  D 

41  A 

51  A 

§1 

A 

71  C 

1  A 

ll>  A 

21  C 

31.  D 

2  H 

12  If 

72  I 

32  G 

42  J 

52  H 

62. 

11 

72  H 

2.  H 

12.  H 

22.  J 

32.  K 

3  II  ' 

O  B 

23  A 

33  B 

43  A 

53,  A 

63 

B 

73.  0 

3,  B 

13.  D 

23  C 

33.  E 

4,  H 

14  F 

24  G 

34  n 

44  H 

54  H 

64 

G 

74,  J 

4,  F 

14^  F 

24.  G 

34.  G 

i  9 

15  C 

25  A 

35  A 

45  B 

55  B 

65 

C 

75,  D 

5  B 

15,  E 

25  D 

35.  B 

6  J 

l(K  ) 

36  If 

H  0 

46.  0 

56  ^ 

66 

J 

'<  G 

t6.  K 

76  G 

36,  J 

7  8 

n.  c 

27  C 

37  vr 

47  1) 

57.  A 

67. 

B 

7.  B 

17  D 

27.  E 

37.  E 

1  J 

l»  G 

2t  G 

it  G 

4t  J 

«  r 

6lt. 

F 

1,  F 

It.  U 

2t  J 

31.  K 

9  O 

19.  C 

79  V 

3^  D 

49  D 

59  A 

69 

B 

9,  A 

19  D 

29.  B 

39.  C 

10  H 

20  i 

^9  J 

40  J 

50.  J 

€0  H 

70.  G 

10.  11 

20.  K 

30.  F 

40  H 

T««I>'1 

fls#tf^ 

TM(4«N«iunitc 

ItneesR* 

1  O 

II  D 

2KB 

31  B 

41  B 

^1  is 

t  A      11.  B  ' 

D 

31.  C 

41.  C 

51.  A. 

2  F 

12  0 

22  J 

32  G 

42  II 

52  tj 

2  F      12.  G 

2'2  H 

32  C 

42.  J 

52  F 

'  <; 

1}  A 

23  D 

33  B 

43  D 

y  C      13.  D 

23  D 

33  B 

43.  D 

4  J 

M  Jl 

2/  G 

34,  II 

44  h 

4.  F      14,  F 

24.  F 

34  J 

44.  H 

5  R 

15  II 

25  D 

35  D 

45  B 

5  B      15  D 

25  B 

-  35  A 

45  A 

6  F 

16.  G 

26l  G 

36,  F 

46.  J 

6  F      16.  11 

26.  J 

36  F 

46.  J 

7  R 

17,  A 

27  A 

37  D 

47  D 

7  B      I7>  A 

27,  B 

37.  C 

47.  B 

S  G 

lit  i 

21  F 

3>  J 

4S  H 

t  H      It,  II 

21,  H 

3$  H 

4t  H 

9.  B 

19.  C 

29.  A 

39.  e 

49.  B 

9.  C      19.  C 

29.  0 

39,  D 

49,  D 

10  F 

20  J 

30  h 

40  11 

50  F 

10  G      20.  J 

30  J 

40,  F 

50  F 

35 
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Actual  Test 

Directiidns 


Th1ibookt«t  containa  fourtMta— £p9^/s/}  l/aaff*.  M*th' 
a/nar/ca  (/aaga.  Soc/a/  Studi%t  8*»ding.  and  A/aTura/ 
Sctancas  n*%dmg.  Tha  four  ttats  measura  skills  and 
ab)ltti«»  that  ara  highly  ralatad  to  succats  In  collaga 

During  tha  first  half  of  tha  tasting  sasslon.  you  will 
complata  tha  English  Usaga  Tast  and  tha  Matha- 
matFcs-Usaga  Taat.  \n  tha  safcond  half,  you  will  com- 
plata tha  Social  Studias  Raadlhg  Tast  and  tha  Natural 
Sctancat  Raading  Tast. 

Tha  quastions  in  aach  tast  ara  numbarad.  and  tha  four 
or  fiva^suggastad  ahswars  for  aach  quastlon  ara 
lattarad.  On  !h«  answar  shaat,  tha  rows  of  ovals  ara 
numbarad  to  match  tha  quasllona,  and  tha  ovals  >n 
aach  row  ara  lattarad  to  corraspond  to  tha  suggastad 
ans¥)wrs 

For  aach  quastlon.  first  dacida  which  answar  Is  bast< 
Naxt.  locata  on  tha  answar  shaat  tha.  rpw  of  ovals 
numbarad  tha  sama  as  tha  quastlon.  TKah.  locata  tha 
oval  In  that  row  latlarad  tha  sama  as  your  answer 
Finally,  blackan  tha  oval  complately.  Usa  a  soft  ^••d 
pancH  and  maka  your  marks  haavy  and  black.  DO 
NOT  USB  A  BALL-POINT  PEN. 


You  may  work  on  «ach*  tast  ONLY  whan  your  tast 
administrator  talla  you  to  do  ao^lf  you  finish  a  tast 
baf ora  Uma  Is  callad,  you  should  usa  tha  tima  ramain- 
ing  to  raconsldar  quastJons  you  ara  uncartaln  about 
In  that  taat<  You  may  NOT  look  back  to  a  tast  on  which 
tima  has  alraady  baan  callad,  and  you  may  NOT  go 
ahaad  to  jinothar  taat.  To  do  ao  w»tl  disqualify  you 
•  from  th«  anamination. 

Your  acora  on-aiu:haMUwilU>tJ>a5td_oiUyLonJht_ 


Your  acora  on-w;n-wuwiJv-w«-*'-»««-»'"i»-»'^^«- 

numt>af  of  qUastibni  you  aniwar  corractly.  You  will 
NOT  ba  panalrzad  for  guassing,  HENCB  IT  IS  TO 
YOUR  ADVANTAGE  TO  ANSWER  ^VERY  QUES- 
TION. \ 

If  you  changa  your  mind  about  an  answar,  arasa  your 
first  mark  thcSroOghly  bafora  marking  your  nawjrv^ 
•war.  For  aicH"qJa9tI6n,  maka  certaTri  that  ybu  mark 
In  tha  row  of  ovals  with  tha  sama  riumbar  as  tha 
quastlon,        .  ^ 

Do  not  fold  or  taar  tha  pages  of  your  test  booklet 
Keep  the  booklet  m  as  good  a  condition  ss  possible 


00  NOT  OPEN  THIS  BOOKLET  UNTIL  TOLD  TO  DO  SO. 
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TE8T1 
ENGLISH  USAGE 

40  Mmutes—75  Questions 


\ 


om€CTIOHl:  In  th«.  pasMQM  that  follow.  c«rt«pn 
words  and  phraaaa  4r#  und«rtm«d  and  rmmb«rad.  Irv 
th«  rtght-^nd  columrlyou  wiii  find  altarnativM  for 
MCh  und«rtin«d  part,  rbu  ara  to  chooaa  tha  ooa  that 
baat  oxprasaas  tha  ldaa\  makat  tha  ttatamant  appro* 
priata  for  standard  writtan  Engtiah.  or  it  word«d  most 
consiatantiy  with  tha  styi*  and  tona  of  tha  paataga  at 
a  whola,  Chooaa  ih«  altarhativa  you  contidar  baat  and 


blacKan  th«  cornssponding  spaca  on  your  answar 
shaat.  If  you  think  tha  original  varsion  is  bast.  chooM 
'*N0  CHANGE'  Raad  aacO  pataaga  through  onca 
bafora  you  bagin  to  antWar  tha  quastions  that 
accompany  it.  tou  cannotldatarmin*  moat  answars 
without  raading  savarai  santancas  bayond  tha  phrata 
in  quastion,  Ba  sura  that  ydu  hava  raad  far  anough 
ahaad  aach  tima  you  cbooaa  an  altarnativa. 


■ch  tima  you  cboo 


V 

i  ^ 

Mo%\  |>copk  auocttte  the  n«mc  Count  DracuU 

with  a  Wiendary  vampire.  They  alio  think 

'  thai  Traniylvania.  the  iiie  of  the 

CounO  Moodthifity  Jccd$.  ii  juil  u  much 
I 

a  fiction  t«  the  Count  h>m»clf.  HowcVer.thii  view 
would  be  mina ken:  Dracula  really  djd  |>ve 

'\ 

in  Tniniylwi^^ 

ii  near  the  Ruiiian  border.  In  fact,  his'caclk 

lUll  standi,  perched  high  on  a  rock,  in  the 

village  of  Bran.  " 

Dncula  may  never  have  been  a  vampire, 
'iut  he  was  a  ruihkia  tyrant.  He  bad 
thousandi  of  hii  lubjecti  slaughtered  and 
their  corpse*  dUplayed  at  the  border'  to 
fcare  off  an  invaiioft  planned  by  the  Turks 
(the  Turks  practiced  fire  worship  before 


ihy>t 
ft^nt 


converting  to  Islatnj  in  the  fiftMnth  century. 

If  Dracula  were  to  return  to,  his 
oM  haupts.  he  would  find  the  customs 


1.  A.  NO  CHANGE 

B,  name  Count  Dracula 

C,  name,  of  Count  DracUla. 
O.  name  Count  Dracula, 

2.  F.  NO  CHANGE 

G.  CounU'  bIo6d(hirsiy  deeds, 

H,  '  Count's  bloodthirsty 'deeds  * 
J.  Count's  bloodthirsty  deeds,  ' 

3.  A.  NO  CHANGE  ,  1 

B.  'a  fiction,  like 

C.  of  a  fiction  like        [  \ 

0.  Action,  just  as 

4.  K..  NO  CHANGE  1 

G.  would  have  been  '  ^ 

H.  IS  I 

J.   has  been  1  i 

's.  A,  NO  CHANGE 

1,  I n  Tra nsyh a nta,  near  the  Russian  border,  a  part  of  ^ 
Rumania*  i  ' 

C.  near  the  Russian  border,  in  Transylvania,  in  a  part 
of  Rumania.  1 

O:  a  part  that  fs  near'lhAAussian  border  of  Rumania 
in  Transylvania,'      '  j  ^ 


i.  F.  NO  CHANGE  / 

G.  (before  they  were  tonver^ed  to  Islam,  the  Tu/ki 
were  f»re  worshippen) 

H.  (before  the  Turks  conVerted  to  Islam, 
worshipped  fire) 

J.  OMIT 


■    OQ  ON  TO  THE  NEXT  MQC, 
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liitlr  chftaitd.  J«irwyt  we  iMdt^ 
ttwqmmJty  ky  oi<m^  metdftmMy  ky 
bicycle,  m4  by  car.  TyfrioiDy.  ^pfe 
idll  dwi«r  m  vUli|i»  airf  «bof  ia 

-  wiglibofi  aad  wttehiMf  tilt  p«timby  are 
wMi  ttey  ai^dy  4»ti^  Tkt  coMum 
prtaapae  of  loUieijk^iMidiiiit  or  ftof^at 
farfcitnaM,  craaiia  a  ^pttaving  onunow 
aimoaflicra  tiMt  Count  Draoila  wouU 
luidoubledly  have  found  lo  hi*  likifig. 


7.  A.  NO  CHANGE 

B.  only  rtrdy  by  car. 

C.  jjoitrwryt  by  car  only  rarrly. 

D.  joumcyt  art  made  ooJy  rarely  by  car. 


9.  F.  NO  CHANGE 
G.  have  been 


H. 


9,  A.  NO  CHANGE 

B.  dcpresaing  (and  omuioui) 

C.  depretiiiif,  and  omiaou* 

D.  defrttaing  and  omuiout 


t 


Sojourner  Truth  and  Harriet  TubmanL 

.  *  M 

two  ninctacfith-«erMafy  Wack  Amcrkaiis. 

'have  ovefcatnc  the  yfcyical  and  ptychototkal 

n  , 
bewdigr  of  alavery  and  became  vocal  chamfiom 

of  fraedom.  Thctc  wbinen  contriliuitd 

•jfnfkaeUy  to  the  ancielavery  movcaMiit« 

the  Gvil  Wftfic^oft,  and  tlie  womcnt  righu 
It 

Mrecgit.  , 

After  haviarf  laiaad  their  frtedom-' 
Sojewaer  Tnitthby  mmm  of  hfiilation 
and  Harriet  TaitMn  bj^  eaoafiiif->bo(h 


women  worked  fotvUic  abolitlotMat  movfwt. 
Xhetr  dety|y>  reUfioiK  cosviclMMit  ltd  ibeM  to 


It.  F.  NQ  CHANGE 

G.  Tubmaa - 
«      H.  Tubman. 
J.  Tubmaa^ 

II.  A.  NO  CHANGE 

&have  overcome 
overcome   >  > 
-De  overcame 


12.  F".  NOCHANGE 
"  G.  womtn'i  nfhtt 
^Jl.  women'i  r^i't 
J.  nmnem  rvrti* 


13.  A.  NO  pHANGE 

B.  (Bepia  new  yerafraph)  After  when  they  gained 


c. 


iraeSeM***  Fani|^(»h)  After  the  Ume  their 
D.  |Oo^NOTC^m~pafatraph)  When aft»Uitir 


Id.  F.  NO  CHAI^OE 

G.  deep  rtlipmu  convictiooi 
:M/^deep  rtlttottt  eonvictiote, 
i.  deeply  r«^pow  convictioM. 


ad  ON  TO  THC  MEXT  MQI. 
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M  muu  &mu€mm  ud  mni<ivity  to 
tKnuK  of  kvmM  Kkcratioft  Altlwuih 

•t 

CftIM  the  'MoMt  of  Um  lUilnMitfr 


to  fm>4c  ikiem  to  nakc  thi  fcnJoM 


io(h  womM  cootriWioi  tf»  the  Gvtt  War 
elToft.  S<90«nitr  TrMh  iMtvrad  to  the 
loMwn  Mrf  collector  (Mtt  for  th^a.  ^ 
Htrricc  Tiih««ii'»  rok,  oo  the  other  htiid. 
WM  %  wmt  active  om.  At  vsnoM 
tiMe,  Ttthmaa  wveri    a  cook,  a  tfy. 
a  MMie.  a  Movt.  aatf  a  iBemUa  fighier. 
UMt  aoi  fiaaUy.  thcM  ^ 


'gUvtoritks  helweea  the  prerfkaaeiMa  of  the 
Macfc  A vaa,  aW  of  iwwieii  k  the  tfacteeath 

cMtiiry.  Ae  bM  taMfaa,  they^  ji 

K^i^  vie(o«  thai       them  itmmI 
iMi|h)jo  the  pfeMwof  hoUi  iro«4|e.  « 


Siaoe  they  iM4e  lyeechci  m  Mffott  ef 
rig);ts  for  woima.  Their  Mepiriac  «or4a  ^ 
•De«  eiiod  hy  i 


IS.  A.  NO  CHANCE 

of  and  teaiitivity.  to         ^  « 
C  to  and  icaeitivity  for  ' 
4>.  and  sMiivity  for 

ICF.  NO  CHANGE  ^      ,         '  . 

G.  maay  po<^ul  addreeeet  Jwve  been  made  by 
SoMuraer  Tnith   .  ^  *         ,  . 

H.  sSounier  Tnith  Made  maay  p»wer^  mx^m 
h  maay  poweifaladdreaeee  were  made  by  Sojourner' 

Tnith  ' 

17.  A.  NO  CHANGE 

I.  Kailroad, 
C  Railroad;  at 
D.  IUUroad,;at 


It.  F.  NO  CHANGE 

G.  Tubmaa'i  vario«N  lechmques 

H.  tubman,  tMing  vaiioue  tecfaniquet, 
^J.  Tubn»n  wed  various,  techniquct 


1*.  A. 


NO  CHANGE 
therefore, 


C.  conieaueMty. 

D.  nevertnekii, . 


n.  r.  NO  c^iANb^       ^         ^  ,^ 

G.  (Hciia-acw  paraiKfh)  Hwee  womca  finally  ^ 

H.  (Mtpm  aew  .^ar«fraph)  Laet  aad  finaUy,  U 


J.  (  f|itt  new  paragraph)  Finally,  theee  women 

21.  A.  NOXHANGE 

B.  slaves  aad  W  women  k 

C.  sbvve  aad  of  women, 

D. '^  ilavee  (aad  of  women) 


X2.  f.  NCf  CHANGE' 

'    G.  upon  * 

H.  kto 

J.  withia 

-13.  A.  NO  CHANGE 

B.  However, 

'C.  Althoi#.  ' 

D.  OMIT  aadjbopa  sentenos  with  Thty 


V' 

00  ON  TO  THE  NEXT  FAQI. 
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like  titt  Hdtik  Sim  (iMt  M  Htrriet  * 

Tutaiw  W  Wr  Mcapc  to' frtidom,  (he  lim  . 

worfcf  of  Utttr      woflwii  Krvtt  -  24.  F.  NO  CHANGE 

— ij-j"    »  G.  leivc  amiltr  (o 

IP  guide  afl  wbb  ftfbt  for  httmaii    ■  H.  MmjiMtM. 

,  J.  »ervt  M 


An  ><qil.  awdrpcrfifet  pUcc  for  a 
short  vacation,  the  Mack  Hilli  area  of 
*   South  Dakota  proiniics  attractive  experiences 
"  to  the  outdoortman,  to  the  hiuory  enthiMiau,^ 
and  to  the  person  »ho  enjoyi  cultural  acltvtties. 
The  out<loof»type  pewon  who  visits' the 

M  ^ 

Hack  Hint  dticoven  glistetttnf  bkes  to 
skim  by  boat  or  water  skis;  iiv  addition,  he  ■ 

Hftds  pine*sccn(ed  mountain  trails  where 
you  may  o^rve  such  rare  forms  of 

wildlife,  as  buffalo  and  antelope.  After 

savoriflf  a  frtih  trout* dinner,  he  may 

stee^peacefully'ikiKfor  a  surlit  skjr. 

Thft  history  enihosiasi  relives  the  past  in 
f 

Dead  wood,  where  legendary  frontier,  personalities 
Uve  again  during  the  "Days  of  76"  celebration. 


25.  A.  NO  CHANGE 

^   B.  A  perfectly,  ideal 

C.  An  ideal  perfect 

O.  An  ideal 


U.  F.  NO  CHANGE 

G.  outdoors  people 

H.  outdoorsman 

i.  outdoor'type  people 

27.  A.  NO  CHANGE 

B.  skis,  in  addition: 

C.  skis  furthermore, 
O.  skis,  furthermore, 

2S.  F.  NO  CHANGE 

G.  you  might  observe 

H.  he  may  observe 

J.  a  person  can  glimpse 

2*.  A.  NO  CHANCE 

B.  wiMlifehke: 

C  wildlife,  tike 

O.  wildlife  ai 


QO  ON  tp  THE  NEXt^tPAQC. 
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Amoftf  tlie  moti  fiimou»  of  thoc  »tc 

n'-  ~ 

Cfttomily  Jane      Wild  Ml  Hictok,  Jack  McOR 

N 

mufdcKd  liiin  M  a  rcwt  of  a  card  >am». 

M 

in  DtadwoodJ^am  afM  vuit  tear  Puttv, 
wlim  iMliaa  tribei  once  hcM  c<Mnktl. 
FTiMUy.  where  the  loiirifi  appractatoi 

cukiuil  activities,  tbcae.are  tpecial: 

huntifft  eikt,  the  Mack  Hilli  Mayfaouw  ~ 

producUoftt  and  ihe.faMion  flay.  Ttf 

vaal  outdoor  amphitheater  uaad  for  thcoe 

perfonmM|e<  ii  it«cl(  an  exiraoidtnary  »i|ht. 


Havifn  been  puz/tod  over  old  ha'ndwritlcn 

-  - 

manttfcnpls,  we  wonder  at  the  omatcfjcai, 
the  ekmfated  letters,  and  Jhe  illegibliity, 
httt  foTfct  that  each  wrher  was  fdiowmg^the 
fashionaWe  style  of  his  time.  Those  styks. 
identified  hy  names,  like  Chancery  Cursive^ 
\  Gothic,  and  Uncial j^revcanenu  more  than 
^  ind^viduaiU.  It  is  no  coinadence  that  the 
l^signatures  on  the,  DecJarslion  of  Independ^ooe 
flnke  us  as  so  ttmilar:  for  the  Founding 
Fathers,  fashion  .not  only  had  shaped  dress^ 
and  architecture;  but  also  haodwntinf. 


/M.  r.  NO  CHANGE 

C.  Cuspus^ones  of  tbesie 

H*  two  oKMt  famouStOf  these  * 

'Sl  very  most  famous^of  fbem  • 

NO  CHANGE 

whom  Jack  McCall  during  a  card*  game  slew 
who  was  murdered  by  Jack  McCall  during  a  caid 
gane 

who,  during  a  card  ganie.  Jack  McCall  murdered. 


31.  A. 
■. 

c. 

D. 

i 

12.  r. 

G. 
H. 

i. 

.  d: 


NO  CHANGE 

(I>>  NOT  begin  new  paragraph)  Finajly,  when 
'(•e^n  new  paragraph)  Finally,  where 
(B^n>new  paragraph)  Finally,  if 


NG  CHANGE 
to.hun^clk 

.lhe.iHinting.pClheeys3i,, 
OMIT,'  " 


34.       NO  CHANGE 

Having  been  puzzled  over  old.  and 
i.  Puzzlmg'.over  old,^ 
Puzzled  over  old.  and 


31  A.  NO  CHANGE 
0.  names,  such  as 
C.  names  tuch'as 
such  names,  as 


3*.  r. 


NO  CHANGE 
(Place  after  Ftthers,) 
(Flace  after'W) 
(Place  after  shtpe^) 


QO  ON  TO  THE  NEXT  If  AGE. 
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Onfy  ytMiwdky  our  frmndptreiiu    *  ^ 
cftraTMUy  cofM  tJic^)p«i«i  Vainer' <^  ' 
Spemxf  Knfiu'Tod&y  we  nuy  htve 
learned  MMWM:rip(^or  Ciirttye,  y«t  we 
no  Mm  Mhw  m  c«<wp<J«  <^y»*.  J»»  *» 
a«e  of  inierwtwml  rock      roU.  inmcx 
drm,  lad  tke  cmmmm  ^wiowhwlor  oT 

teieviiio«t«  which  wqm  rtranfe,  that  » 

"     '        H  T 

um'wMl  hMdwri^ing  Myte  dob  not 

ncmerte;  however,  our  ape  i»  dominated  by 

■'   '  j»  " 

fMny'oommttiucftlion  devkes  that  create 
teaier  need  fcr  the  handwritten  word. 

f crhaft  thi>  tecKnoloty  maket  ui 
indifferent  with  ihe  dktates  of  fathion. 
Conycneiy^  pcrhapt  our  individuaload 
icripla  allow  ua  to  be  attraclive.  fanciful, 
^practical-  evcvi  iile|ihle-at  whatever  sl^nt 
you  choose.  ^ 


37.  A.  NO  CHANCE 

B.  cadi 

vC.  any  form  of 

~  any  iypt  of 


n.  F.  NO  CHANGE 

C.  (which  loems  tiranfe) 

H.  it  leeflu  atranfe.  that 

h  it  Mema  ilrante  (hat 

M.  A.  NO  CHANGE 

B.  moreover,'-  - 

C.  therefore, 
'    D.  thus, 

41.  F.  NO  CHANGE  v 
lca»  needs 

H«  leet  neod 

J.  fewer  need 

41.  M,  NO  CHANGE 

B.  to 

C.  for 

D.  from 


42.  F. 
G. 


NO  CHANGE 
we  cKoow. 
H.  Ichoote. 
i.   is  choien. 


QO  ON  TO  THE  NEXT  PAOE. 
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T 


WUd<nwM  umt  are  a  UMque  r«rt^ 
of  ow  Miteal  bad-prcacfvc  syiCcni. 
OiAmM  froa  ^  nuiooal  parks  and 
wnitaaUofiiH,  tlK  WUdcreoi  Act  of  l>64 
maMiihad  Uim  aatioaal  wiM<fna>  afcaa. 

Arcai  are  tdcdadjto^iadiMion  ' 

m  the  wildcnMw  »yti«nj  bacaiMc 
well  and  mry  oik  of  than  have  not 


\ 


yet  kMi  duofled  by  nan.  Tluy  are  piaoei 
wtwrt  Dm  earth  and  tU  community  of  itfe 


_      are  umraromeM  ty  man;  At  where  man 

httMetf  ia  a  viiitor  who  doc«  not  remain.  In  * 

arou,  man  mutt  tiivd  by  foot  or  on 
'honeback.  lecausc  motoriMd  vehidct  ^r\ 

not  aliowad.  Nor  may  buitdings  be  conttructcd. 
timber  cut,  or  roadt  may  not  be  built. 

WiMemett  areas  terve  several  purposes. 
'   It  providea  a  piaoe  for  wildlife  to  evolve 
freely!  for  plant  life  to  grow  naturally,  and 
for'people  to  enjoy  the  "tonic  of  wildnos." 


4).  A.  NO  CHANCE  ^  - 

B.  iJw«>verMiicntp8Ss«SthaWilderoe«Actof 

C.  in  lW4UwWUdenMMAct«a«p•la«lbyCoa«rl«' 
aM  eslabliihcd  thcee  nattoaal  wiMmM  ami. 

D.  natiomlwiMenMiS  arm  wettaiiabhshetl  with  the 
pMMfB  of  the  WiUcniaM  Ad  of  1964. ' 

44.  F.  NO  CHANGE 

C.  for 

H.  with  a  view  to  . 

J.  by 

4$.  A.  NO  CHANGE 

*    yc!  atSoftliain  '      ^       '     "  ^  / 

D.  ^  every  one  of  them 

44.  F.  NO  CHANGE 

G.  it*s  - 

H.  their 
J.  our 

47,  A.  ?<0  CHANGE 

B.  man,  where, 

C.  4  man.  to  where 

D.  man,  where  '  *  ,  - 

45.  F.  NO  CHANGE 

G.  visitor  who 

H.  visiiorWhat— 
J.  -^visitpr;  who 

49.  A.  NO  CHANGE 

B.  horseback  bi^ause 

C.  borKback.  in  that 
D;  horseback:  because 

54.  F.  NO  CHANGE 

G.  or  roads 

It  and  no  roads  may  be 

J.  and  roads  may  not  be 

SI.  A.  NO  CHANGE 

B.  ,  Itoffen 

C.  It  serves  as 

D.  They  provide 
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Mom  ptoflk  wouU  not  chooie  a 

feoftfd  M  a  iMHite  pct„  Yet  an  American 

'  woaMn,  wbotc  huiteiMi  wa«  Mationtd  in 

India,  for  two  yta rt  did  manift  to  obtain 
n  ' 

I 

/ 

*  bnby  infani  kopnrd  soon  rfier  iu  birth 
and  to  rear  it  a«  a  companion  for  her  fanuiy. 

At  fifft  her  plan 

M 

which  yf^t  to  reuilt  in  brintini  one  of 

the  mott  Mvnfc  of  the  bt|  cats  into  her  * 

household  met  with  opposition  from  Indian 

<tfficials,  friends,  and  neighbors 

worried  about  her  safety^  But  she  overcame  their 

protests  and  settled  the  leopard  in  her 

home  when  it  was  only  twenty-one  days  old. 

As  Cat  (which  wu  its  name)  pew,  itt 
energy  and  sue  were  the  cause  of  constant  » 
household  disorder.  And  in  spite  of  mountin| 
wreck^fe.  the  family  fftw  to  love  their  strange  pet. 

iefore  the  family  returned  to  the 
States,  their  Cat  was  placed  in  the 


Delhi  Zoo.  After  a  heart  breaking  period 
n 

of  weaning  it  from  constant  human  companionship 
10  the  solitary  life  of  an  aninial  behind  bars. 


S2.  r.  NO  CHANGE 

G.  India  for  two  years, 

H.  India  (for.two  years) 
J.  lndk,Jor  two  years. 

SX  A.  NO  CHANGE 

B.  baby,  infant 

C.  baln^  and  infant 
D*.  OMIT 

54.  F. '  NO  CHANGE 

C.  Rrsi.,  . 

^    H.  first  <iff 

J.  In  the  first  place. 

59.  A.  NO  CHANGE 

M,  broui^t  ^ 

C.  resulting  in  the  bnnging  of 

D.  ^  to  bring 


5«.  r.  NO  CHANGE 
G.  Thus, 
.  H.  But 
J,  Although 


57.  A.  NO  CHANGE 

B.  the 
C  her 
D.  OMIT 

'5i.  F.  ^NO  CHANGE 

G.  "  Zoo.  It  was  after 

H.  Zoo.  But  after 

J.  Zoo—but  .only  after 

5*.  A.  NO  CHANGE 

B^  life  in  solitude 

C.  life  all  alone 

D.  lone  life 
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ytm^  p«r«gr«ph«  may  or  mpy  not  b«  In  th%' 
moat  logical  ordw.  Tha  laat  Ham  wiii  aak  you  to 
chooia  tha  moat  looteal  ordar. 


Fnrnimin  dad  not  die.  but'  li  iepttmoq, 

a  wtr,  and  the  Ffeudian  belief  in  fiemak 

mferioriiy  cffiecuvely  Ihwaitad  much 

activitm,  Daufhtert  were  oonteni  to  < 

^jcontolidate'  the  futa  privately  theit 

^mothcfi'lMMl  won  pubUdy.  In  the  mid- 

tixties,  however,  feminiun  rcemerted  ' 

again.  Althoufh  the  feimniic  movtment 

might  Mrike  thoar  uader  twenty 'Hve  m$ 

novel  and  revolutionary,  there  b 

ample  evidence,  that  women  have  worked 
u 

f^r  over  three  hundriid  years  to  ohuin 
equal  rithta. 

Alihou|h  widely  uied^to  identify  the 
women's  movement,  the  term,  ftmMsm  u  of 

rather  current  coinage,  Mot  until  the*  1190s  did  it 
assume  the  meaning  wc  now  accept.  Sexual 
equality.  Within  today's  political 
context,  it  has  been  comfortably  assimilatad 
into  our  language. 

(3) 

That  contemporary,hi«oruns  have* 
had  to  use  the  term  delnonitrates  that 
history  has  traditionally  avoided  focusing 
on  women.  Because  our  great  historians 


0.  F:  NO  CHANGE. 

'G.  privately,  (Plaoa  after  Dmtghttn) 

H4  m  imvate  (Place  after  w^.v) 

J.  privately  (Plaoe  after  corootUktt) 


<i.  A.  NO  CHANGE 
S.  once  agaiD.^  ^ 

C.  yet  another  lime. 

D.  OMIT  and  end  sentence  with  rtfrntrged* 


42.  F.  NO  CHANGE 

G.  evidence,  ihat« 

H.  evidenoethat 
J.  evidence,  that. 


U.  A.  NO  CHANGE 

S.  term,  known  u/emkiUm, 

C.  term  ftminbm 

D.  XtttA  feminism-^ 

M.  F.  MO  CHANGE 

G.  accept:  sexual 

H.  have  excepted;  that  being  sexual 
J.  have  accepted.  That  of  iSxual 


(5.  A.  NO  CHANGE 
S.  in 

C.  within 

D.  through 


10 
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have  Wen  tuk^i  ihcrc  has  been  an 


MiKoaiooui.  icxttt.  tnt>rpf«ultoB. 
«i 

CMMqucnilyi  women  have  remainad 
MviiiUc  m  tcxibopkt  aiid  record*,  the 

aiMMnptwo  beuf  that  ihcy  have  made  oe^giMe 
conlribudoM.  Femmiem,  moreovfr,  was  <)uile 
vieible  m  colonial  America  ivlien  women 

'}'piak»oiitd  faV  nfhu^like^tJider 
Later,  durinf  the  Revolution,  Abiful  AdasM 

\im^lofcd  her  hiuWnd  John  to  remember  the  men 

aaid  be  feoeroue  eke  they'd  rebel.  Adama, 
however,  affeett  no  female  I'ndepSidency. 
•■      "  (4) 

The'cnioal  year  was  1141,  with  the  fiwt 
women*t  convention  meetinf  in  New  York« 

They  tucceeded  in  drawing  up  eleven 

n 

resohitiont;  the  moM  oonlrovenial  was  the 

 ~  

demand  for  luffrafe.  ^heir  activitia  suspended 
durinf  the  C>yi]  War  women  wtr'e  compelled  not 
only  to  endure  diaenfranchisement  vntil 
1920,  but  also  to  suffer  a  forty-year       ,y  ^ 
hibernation  thereafter. 


M.  F.  NO  CHANGE 

G.  malea.  there's  t 

H.  males.  Hiere's 
J.  maiea,  Hmn 

$1,  A.  NO  CHANGE 

I.  uaraMcioualy  sexist  interpretation.  , 

C.  inlorpratation  whtdi  .is  sexist,  though  uncon- 
scioMly  so. 

D.  unooMMo^,  sexist  interprcution. 

It.  r.  NO  CHANGE 

G.  reoordsthe  * 

H.  records.  .Hie 
J,  OMIT 

<9.  A.  NO  CHANGE , 

i.  therefore;  \, 

C,  for  example.  . 

O.  however,  \ 


'n.  F,  NO  CHANGE 

G.  the  riahu 

H,  thekdtet 
J.  OMIT 

71.  A.  NO  CHANGE 

B.  effects 

C.  effected 
Da  wiU  affect 


72.  r.  NO  CHANGE 

G.  Women 

H.  Thedekntes 

J.<  Nople  / 

73.  A.  NO  CHANGE 
Jl;  lesohttioM.  the  , 

C.  res<riutions  and  the 

D.  rAolutions  but 

74.  F.  NO  CHANGE 

G.  War.  However 

H.  War, 

J.  War,  but  ^ 

75.  Cbooee  the  seaucnce  of  paragraph  numbers  that  «nJl 
maka  the  essa/s  structure  most  logical. 

A.  NO  CHANGE 
».  2.1.3.4. 

C.  2.  3,  4,1 

D.  4,  2»  X  1 
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TEST^ 
MATHEMATICS  USAGE 

50  Mlnutes^40  Questions  « 

omiCTlONS:  SoM  Mch  problem.  choOM  th«  oor- 
rtct  answer,  and  ttf«n  blackan  th«  corrMponding 
iipac*  on  your  tntwvr  thMt. 
Do  not  Hngar  0¥«r  problamt  that  taka  too  much  timt. 
Solva  M  many  aa  you  can;  than  rat um  lo  tha  othara  (n 
tha  tima  you  hava  Mt« 

Nota:  Nlu'tritiva  ftQuraa  art  not  nacaatirity' drawn  lo 
aia  aaaumad  to  lia  in  a  plana  unfaaa 


t.  TheworkTf  larieMjKRi  diamond,  the  CuUinaa.  wn'shi  DO  Y0U9I  PIQUflINQ  HERE. 

af|»ro)iinMMely  3 JOO  canity  If  5  caiau  equal  I  fnun. 
.    aad  Jt.'jpajm  ccfual  1  ooncc,  whtt  ii  the  approxiiiiiu 

uttht  M  thk  diamond  in  ounoet?  f 

A.  -Ii 
%  2 

C.  20  ' 

D.  JO 

E.  I,M2 

2.  If  9«ci(oftli«folk»wi«f  werere|ukrpoiy9onitnd  w;ere 
iiwcfiM  in  tht  lamc  circle^  which  polygon  would  have 
Uie  grcateM  araa? 

F.  Tfianfle 

G.  Square 

H.  rmUion 
J.  Htufoii 
K.  Oclafaa 

3.  inihcnfiire,/iand/|areparftUellinctcutbythetrtn*- 
venai  ly  If  the  mcMuret  of  the  arikks  are  a«  shoWn, 

ilien  y- 1  ' 

/h 


A.  ur 

.S.  120* 

C.  I30»  ' 

D.  Ii0»  .  ' 
t.  340* 

4.  la  a  ccftaia  faaie,'  Sue  aiait  try  to  fueit  the  numbcf 
that  letty  hue  vvntten  on  a  lUp  of  ^apcr.  If  Sue  fueMa 

comctly.  the  reoeivee  10  potntt;  if  >he  fueeics  inoor- 
reciiy,  $h<Ho«e«  2  potati.  After  7  turnir'Sue's  toul 
Kore  i«  22.  Hfw  many  incorrect  lUMtei  did  ihe  malte? 

c,  }  •    ,  ' 

M.   4      .  ' 
i.  II 
K.  14 
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S.  Wkn  pcnnl  n  •muimkM  to  a32fS  7 

A.  9jm7n% 

>B.  0.0)295% 
C.  OJ295% 
O.  X795% 
1L  U9S% 


00  YOUH  nOUHiNQ  HIRi. 


i.  4v3  - 12x^9 
H.  4x»  ♦  I2jr  ♦  f 


a.  The  formttta  F  =  4  C  ♦  32       be  used  to  convert 
Cekiui  (C)  to  Fabrenhek  (F)  lemycniture.  To  tlwnca^* 
est  tentli,  wlMt  b  tiK  Celsius  equivalent  of  60* 
.  Fehreaheit? 


F.  15,*^ 

G.  300* 

H.  .  2f.7* 
J.  29.r 
K.  1400* 


f .  The  Ate  of  k  long-diMMCc  telephone  aiii>dween  2 
atm  it  SK50  for  the  fifit  3  minutes  plus  135  lor  mOi 
•Mitionel  mtnutc.  Ifa  long-disunce  call  cost  S3.25. 
then  how  nwny  minutes  lonf  was  the  celt? 


For  all  jr,  (x*  Ox*-*-3*-6)  ♦  (5**  >  2jc»  ♦  6)  ♦ 

F.  5?(jr-3/ 
C.  ;i<5jr  ♦  21) 
H.  3i<3jrV5) 
J.  4l2»V*  5'-*5) 
'  K.  5ji»  -  ii^  *  12 
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ii.  What  It  tk€  kagdi  of  }9F  in  the  figure  shown  below? 


DO  YOUR  FIQUfllNQ  HIRC 


A.  $ 
».  7 

C.  •  ,  . 

D.  '  9 

K.  10  ;     .  Jf 

12.  A  iMJi  boufht  a  new  or  for  HkSM.  He  amnfid  to 
Mv.^  oT  the  total  price  at  the  Umc  of  the  Mie, of  the 
Ukaoe  in  30  '(iay«,  uni  the  reMuiinf  talance  at  the 
ca4  of  M  <feyt.  How  much  wm  ^ue  at  the  end,  of  <0 
day*? 
r.  SLOOO 
C.  SIJOO 
M,  $2W 
S3.000 
K.  ROOO 
>  I       -  ' 

11.  Which  of  the  fo)lowii«  would  be  a  correct  a^lkation 
«     of  the  dittrihvlive  yroferty  of  muhiplicetion  over 
addition? 


af3*4)-f2>3X2*4) 

D.  2*(3.4).(20)V(2-4J 
t.  AH  oftheahwe 


14.  SnwioM  i  of  a  wffc«r*>  mkry  i>  daductad  far  iywe 
taxaa,  and  4'  of  bMOMt  taxa*  aic  uaad  for  aniiUfy 
eilMilnna.  If  13.000  of  a  workeft  pay  were  UMd  for 
'   imMafy  expcadilnm,  than  which  a^iiatKm  cooU  he 

«    ^wlved  to  dotannuM  the  worfcef**  aalaiy? 

c.  4*x|)-3;ooo 

H.  ^Jr-IJMO 

J.   ^*\x'ijX»  I 

K.  ^.j«.3j000         •  / 

19.  Tbewnof -iofa  oarlainnuaiher,jr.andioftheian» 
niMnber  m  II.  Which  o(  the  foUowUif  aquatioiu  oouM 
,he  uwd  to  solve  for  or  ? 

A. -Ix^-^-ll 

jr^|«-^«|l 

C.j..^.|l  ( 

-  -  D.  ■{^{xM  II        ^  c 

•  E.  |jf*|«ll  ^ 
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14  A  circk-rt  cenlewd  Mplhte  enp»  <rf  «  Cartesi^ft 
coocdtMie  •yMcm.  If  the  coofdiiutct  of  one  «ndpo»iit 

of  *  dimeter  of  the  af«le«rt  (-j'^)  ,  ihen  whii 
are  ibc  coofdmttn  of  ihc  dbnfcicr"*  other  «ndpo»ftt7\ 

F.  (4.-4)  \     •  \ 

c.  (4.4>  *  \ 

i.  (4.4) 

17,  A  fwiangW  tt  12  meter i  bng  an4  5  melt f»  wide.  If  the 
lef«th  »nd  the  width  of  the  rect*B|k  »re  mm*»ed  ky- 
the  mmc  amount,  ky  how  way  meter*  »hould  e«ch 
dimcftjioft,  be  I'ncreaied  to  douWe  «re«  of'the 
rc€t«n(>c? 

A.    I  —  

'  ■.  3 

C.  4 

D.  15 
C  20 


II.  |jcljr»*»  real  number  and  y/x'»2$]*1 


«2}| 


If.  Which'^Kj*  correctly  Utuitrtlei  the  relation 


DO  YOUR  FfOURiNQ  HRRE.  / 
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M.  Aa«q4uriit«iM  DiedwtlMf.  11  inches  wid<.  and  10 
indKt  high.  How  imny  pBonc  of  water  are  neWed  to 
<    nil  H  to  3  iiK9c$  Mow  the  to^  tf  I  |[Ulon  occu|»ie*  23 1 


PC  Youn  noumNQ  Hint. 


50  \ 

K  to  "T" 

J.  100  ^ 
K.  I9J 


21.  H      •  d«(jr  -  <)V      »  tx  ♦  45^th«n  jr  »  : 

,    A.  -5  or  3 

■.  $or.3 

D.   J— 


12.  Whkli  of  the  followinf 
F.  SjOxIO-' 
C.  2X)xI0-' 
H.  2.1  X  10** 

J.  yx)xio-» 


;  iariett  number? 


23.  If  13,844  wft«  MCftt  for*  car  which  was  diMounterf  to 
14  fttttnt  of  tb<  orifiMi  pfice.\what  wai  the  onKinal 
price? 

A.  S2.iOO.00 

C.  S4.4tI24 

D.  S4.t0000  ^ 
C  I7.I0»76 

24.  V^hai  powtivc  value  of  x  utufiet  the  Inuatton       1 1 '  ? , 
C.  2 

H.    3  *• 
•     J.  4 

K.     9  , 


25.  A  dealer  buyi  laioiine  from  hi*  wholeialer  for  Mc  per 
fallon.  He  mwi  pay  the  followint  uxei'on  ihU  cost; 
17  2%  faderai  hlfhwiy  tax 
22  %%  Male  Ki|hway  lax  ^ 
5%  Mate  Miet  ux  \ 
Ai  what  pncc  (iu  ectiti  per  fallen)  miWjhe  lett  the 
laiolinc  in  prder  to  make  2,U  per  gallon  Vofit? 
A.  Wil     *  \ 
■.  74,6  I 

C,  72.5  •     ,  A 

D.  72.1  I 
t»  566 
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.  Wli»t  M  the  rfMUiMcc  b«(we«n  points  «  <n<j  A*  in  the 
C4^ir«Un  coordiMie  »y»i«in  shown  below''  1 


•  Hi.i) 


r.  n/t 

c.  \/s 

H.  2y/l 

•J.  3 

K.  S 


Xt,  li  M«ty  rides  her  biode  e«st  <i  the  nie  of  16  kilo 
'i     meters  per  hourartd  returns  o\er  the  sjme  routeati  the 
rate  of  24  kitoo^tert  per  hour,  how  miny  kilometers 
e*si  c»n  she  irav^el  if  she  bkycks  for  <  total  of  S  hours'* 

A.  • 

B.  30 

C.  40  . 
\    D.  48 

E:  100 


U.  Ihe  reope  for  It  cookiet  cults  for  4  cup  ^K'^ 
many  cvp«  of  stifar  will, be  needed  to  make  4 
'  cookiet"* 

C.  2i 

H.  3  \  ' 


It.  U  3 1  <9  if  and  only  if  whidi  o(  ihc  foIJowmg  is  ttyc? 

A.  Jt>-*     '  1 

B.  Jr<U 

C  -4<x<12  ^  * 

O.  x<-6or;r>  12 
r,  j(>-6orx>  U 


1 

3#;  lfit(^)*2c»  r  afKJ/J|{jr)I*7x  J,  ihen/(2l*'' 

F.   i  i 

C,  5  1 
M.  V  . 

li.  34 
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31.  If  a  «^  of  an  equilt  'xnl  trUn|k  i«  t  n»ttcn  in  knfth. 
'  wIm(  m  ihe  kniih,  a  mctm.  of  »t»  altitude? 

A.  In/T'        '  / 

»•  •»  ^' 

D.  4>/3^ 

t  It  ,  / 


DO  YOUR  FIQURtNG  HERE. 


32.  The  circle  in5<obe<J  m  Ihe  «j»«re  Wow  ha»  t  rid»u$  of 
2  Jn<he».  What  Jt  ibe  ilea,  in  square  inches,  of  Ihe 
thaded  area?  ^ 


o 


/ 


/ 


G.  t-4ir 

H.  4(4-») 
J.    2(1 -f) 


33*  VVhwh  of  Ihe  folk)win#  w  troe  if  lel  ^  -  { 1,2.1.4.5.4, 
t.MJoIi      4^:  C«  {5.6.1).  and  D  »  {O.UJ)  ? ' 

C.  a)C^)jnd(CC4 
'     D.  (iCi>)Mdtf>C^ 
^  E.  (i>C4>Md(#C^ 


34.  Ho*  many  diffefeM  7-di|il  lek^bone  numfcere  (for 
example.  niMktt)  ean  kc  wrillen  if  lhe'Ji|>l  0  cannot 
appear  amoni  the  fim  3  d>f>i»? 

C.  ^'x  1x7x7  x*x'5x4t 
^H.  rx2«x2^x2*x7*x2'»x2'» 
J.  9  X  9  a  9  |i  10  X  10  X  10  X  10 
K.  4x  Ix?Ti  IO>i^  X  1x7' 


35,  l-of  a  pvcA  fractkm.  J.  lh«  numeralor   haWad  and  the 
denominator  ie  doubUd,  The  retuhini  fractioB  could  - 
Imvc  been  obtained  by  imihiplyini  Ihe  onunal  frac- 


lion  by  which  qwnttiy?'(«  »*  Oi  *  * 


C.  1 

D.  /2 
K.  4 
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3t..  UJiA»Cjidl§CMod£B  ilOLlf the  kftfih ot^IB^ 4. 


DO  YOUn  FIOUHINQ  HCRC 


A.  ,2130 

B.  JM7 

^     C.  10132 

o-  1-1.41 

"■  H.-^l 

i.  H.-il 

J9.  WImi  v»hie  of  m  U' required  in  of^er  lhal  Ihe  grtph  of 


yamx*  b  ffktt  thxou|h  poiiui  (l.f)  «n4  ("I 

I  A.  y 

.2 
4 


in 


C.  i 

H4-2  

.    J.  3 
K.  5 


\ 
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SOCIAL  STUCNEt  IICADINa\ 

J5  WnUt€$'-52  Questions  \ 

^^il  quMtioiw.  Anwk««U0f  «  pMMO*.  choo^  th« 
i  aoMMf  to  Mch  qtiiwiion  •nd  biKCcn  tb«  oofr^ 
jAding  ftpMM  on  your  mum  shoot  You  may  rofof 
>tht  I 


Tlw  MMani  tumai  of  SoulHe«M  Awa,  j*ho.  h«ve 
Moully  rontcd  ^Ming  lii|hrf.yieW|B|  v»nrti«  of  fiwof 
iw«  croM  thttt  could  W  loMY&r  larir  profiU.  Mvc  Mfled 
Wmtrn  •co«omirt».  The  p«M*m»^tta  Mt  mcm  lo  waot  / 
b«tt«r  ctof»  «iMl-moft  inctmt,  «  iiowrtipo  tome  hive  / 
imuily  Mtnfcjued  lo  the  "culliinil  boekw^4neM  of; 
 1  ioctciy<       •         '     1  ^ 


jke  kmI,  1 


tM  ■wtanu*  tctiom  nuke  kh^,  howtver.  ftveft  «Se 
■        tM  of  peaMM  We;  they  hve  din  lo  the  tyUoUncc 
)ev«|--ihcmMiifliMm  »moum  of  foodi«ededto>omve.  If* 
croo  fiili»»e'o«cuo.  Ihcy  •«  in  Immof Uw  d«i*e'  O' ""r* 
ini-v,  fherefofe  Ihey  iridiuoW  m^hod^  which 

woducc  only  mo^i  ywlde  ui  jood  yfciw  W«  are  likely  lo 
yitid  »omethin(  even  under  poor  cooditioft*.  Ahhoufh  new 
vtricties  o(  rk«  wodiM*  much  moec  food  >n  the  Jong  ran. 
ihey  ire  •wfe.  luewpwWe  lo  dro««M.  flood,  or  d»««*e. 
tc^uM  the  p»MMt  can  lU  alTord  •ddMioiul  niki.  Ihey 
Mtck  to  ir*dNtoiM)  method)  of  cuhivajlon. 

.  ~  L 

IKk  iuhw»ie»ce  ethic  pervadet^petunthfe.  finl. 
MMirm  «'tl]  work  trenvndouely  hard  to  produce  very 
small  iKr«M»  in  Ihetr  crop'i  yieW.  Second,  i^eial  lUtue 
deMMdi  on  the  lecunty-oi  one'i  incotne  rather  then  the 
tmoum,  Ahhoufh  we#  Jaborer*  pniiMy .njk^-^mott 
ofmy  then  farmers,  the  tumtn'  poiiiioo  m  pwfertble;  in 
•oor  iknee,  fanoen  can  at  kut  eat  whet  they  have  |roJ«n. 
SuniMy.  PcaMMi  prefer  lo  own  a  ifeic  Und  rather  than 
rem  •  toffTplol.  eyco  Ihoofh  the  hti^  will  yield  a  larger 
iiiconw  in  nuNt  ycart.  | 
; 

*    ~      ~     ,      "  » 

The  Weticrn  power*  that  coiooued  SoiNheiM  Ana 
were  irapcaUy  ignorM  of  the  lubvi^ence  ethic.  Although 
tha  tradttiOMi  kingdonM  of  the  region^exiracted  large  por- 
tKMia  of  the  fanner*'  »Uf  pliuo  in  good'year*  for  lawe.  Ihey 
^tlectfd  no  taxes  in  bad  years  and,  if  pCMible.  djunboted 
/food  to  the  hungry.  Taxes  were  abo  kyiwl  on  wllagei.  noi 
'individuals.  Tkow  whoee  crops  had  done  bMier  could  and 
wouM  pay  more.  The  cotomal  |Kjwer»  reversed  these 
poHcks.  Although  averagr  uus  were  lower;  Ihey  were  the 
same  iti  had  years  ai  In  good.  >nd  evfcryonc  had  to  pay  Ihe 
same  amooni.  These  pobcies  help4l ^produce 
dedina  in  the  aeaianu'  economic  tfell-being,  widesprr^ 
famines,  and  u«if.»aiely.  several  peaiant  rtbellioni,  ^ 


K  The  method*  of  u»aUon  uaed  hy  the  tradjlional  king- 
•  dome  of  Southeast  Asia  inaared  higher  Uws  from 
those  peasams  who  were  economtcalty  well  off.  whtch 
form  of  uxaaon  in  the  UnKMl  Stale*  is  based  on  this 
sam?  principle?  \ 
A.  Saks  uxes  on  retail  foodj 
1.  Taxes  on  liquor  and  ciganAie* 
C.  Enlertainnieiir 'taaies  on  Inighlclub*  *nd  dis- 
cotheque* 

P.  The  progressive  federal  income  ux 

].  The  peasanu  res«ted  plantirta  cLh  aop*.  whKh  they 
could  have  sold  fo^  Iar»e  profits,  bainly  becauK  Ihey 
F.  lacked  the  knowkdfe  needed  to  row  ihe  cbh 

C.  woSl  have  had  to  hire  wag^  laborers  in  order  lo 
grow  cuh  crop*.   '  i  ^  ^ 

H.  woi'Jd  have  had  to  pof  - high  ^  rents  on  the  addK 
Ikmal  land  needed  lo  grow  cish  aops. 

i,  ^tt  that  Uwu  safer  lo  gr ow 'aop*  that  could  be 
 — -ealcn  than  cropa^hal  had  lo  be^M. 


3,  Why  would  Southeast  Asian  peasanlrwort  iremen- 
dcMly  bard  only*to  produce  very  small  increaserin 
their  crop's  yields  " 

A.  'For  people  living  near  the  subsistence  kvel.  a  bttle 
more  food  is  very  valuabk, 

B.  Social  suiua  in  peasant  society  depends  on  the 
atrtctuni  of  one's  incOimc. 

C.  The  lradttional*kingdotn*  of  the  area  pUce  a  con- 
sunt,  high  ux  burden  on  ihcm. 

0,  The  peasants  fail  to  reajite  that  th»  work  •  very 
^nproftiable,  I 

4-  The  author**  main  mienlion  in  this  passage  u  probably 

10. 

F.  show  that  the  apparently 'irraltonal  behavior  of  the 
peasants  is  rational,  given  the  demands  of  their 
economic  situation.  \ 

G\  describe  the  cuhural  backwardness  of  peasant 

H.  show  how  the  peasant^  could  be  helped  by  apply- 
ing the  knowkdge  of  Western  economics. 

J.  describe  |he  technique*  that  succeeded  in  persuad- 
ing peaaants  lo  adopt  new.  more  efiicieni  methods 
of  caliivaiion. 


QO  ON  TO  THE  next  FAQE. 
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S.  Which  tuiemcnt  bcs(  nttMi  ihc  attitude  ot,  the 
pcAMnti  toward  taxation? 

A.  What  matter*  it  not  how  much  h  ukcn  for  taxes, 
but  how  much' it  kft. 

B.  A  moOeratc  tax  that  i«  a^««>«  the  satrx  «  prefer* 
a  bk  to  a  lax  that  is  aomctimes  hi|^  »omet>Mrs\ 

0.  Taxati6n  it  fair  if  atrrryone  payt  the  umc  amount 
'[>•  taxes  ^houM  be  kvKd  on  property,  not  on 
income.  •  ' 

Western  ccoocmUt*  haw  been  baffkd  by  the  behavior 
of  Southeast  Asian  peaurns  primarily  because  the 
pcasaats:  * 
K.  dimonstrated  cuhural  jMckwardncss.  . 

C.  sibcmed  to""act  "eont^y  to  their  economic  self- 
intcreK.  ^ 

-H.  Icmoittt  rated  a  lack  <^  concern  for  tociai  si^'w. 
J.  itowly  resisted  coming  into  contact  with  ii>e 
economists.  • 

7.  The  economic  behavior  of  a  United  Sutes  plumbtnt>^ 
supply  businm  vrouM  be  coroptrable  to  that  of  South- 
cast  Asian  peasanu  tf  it: 

I  borrowed  heavily  in,order  to  expand  rapidly, 
even  Ihou^h  this  increaKd  the 'risk  of  bank, 
.fuptcy. 

II  took  actions  thai  hun  lU  profit  marym.  but 
helped  It  retain  its  present  customers. 

«  IIL  concentrated  on  leUmf  producti  for  which 
there  '>as  a  steady  demand,  but  whieh  yielded 
reU lively  low  profits. 

A.  II  only  • 

B.  Illon!/ 

C.  I  and  11  only 

D.  11  and  111  only 


$.  Some  economists  in  thts  country  aovoeate  «  neititve 
income  ux  (instead  of  payint  taxes,  people  exroinf  less 
than  a  ceruin  fiaure  virould  receive  mon^  from  the 
fovemment).  Which  ofjhc  foilowing  policies  of  tradi- 
tional Southeast  Asian  kingdoms  would  be  similar  to 
the  ncijativt  income  ux? 

I  In  food  crop  years,  larfe  portions  of  farmers' 
K  surplus^  are  extracted  for  taxes.       '  % 

II.  Taxation  is  levied  on  vtllafes  instead  bf 
individuals.  ^ 

III.  In  bad  crop  years;  no  uxes  are  collectad.  and 
food  is  distributed  to  the  needy, 

K  I  only  '    '  \ 

G.  II  only  _  \  - 

Ill  only  ^  \ 

J.   I  and  11  only  -f  \ 


9.  Peasant  farmers  would  be  more  iikely  to  grow  the  hew 
varieties  of  rjce.  which  have  hl|hcr  average  yields  if 
thdr  lovcmment: 

A.  provided  theiA  vnth .  fcrtituers  and  mechanized 
farm  equipment  to  do  so. 

B.  built  facilitici  where  they  coufd  safely  store  sur-  ^ 
plus  rice  from  good  y^rs  until  it  was  needed  in  b*d 

C.  iiutnicted  them  on  the  proper  tcchnique^for 
cuftivaling  th^ncw  varieties. 

D.  insttt(i(ed  mass  education  programto  corabat  the 
eultural  baekvntdness  of  peaiant  so^ety. 


GO  ON  TO  THE  NEXT  PAQC. 
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From  asitquiiy  ihrouf  h  mcdkvat  umes,  dream*  ^ere 
cofu'idcred  suocroatural  and  prophetic  fMMftsuuof*. 
Ailhowch  modera  Mycbotofuti  hav«  been  Mudjing  ihe 
nature  and  me* ninr  of  dreamy  they  iiUl  h«ve  no  cle«r-cui 
dcnnnioo.of  dreanMnf.»Ho*tver.  much  new  inTorrMtton 
about  the  dreaming  proceM  ii  aviihblc  NtcauK  of  research 
in  »fc«>  Ubofatojiet-  We  bow  know,  for  c^ampk.  Ihil  a 
ft^lht*!  Oecp  »  made  up  of  Kvtral  cyele*  of  appro  xjmaicljr 
ninety  mlm'tt  in  lengih.  &Mh  cvclc  U  divHlwJ  toio  nve 
dificrfm  Icvch  or  i^aprt  of  »Jeep.  tl>c  roo«  vivid  dtarmnt 
Qciuit  m  the  tatt  uage  of  ihe  sleep  eyde.  which  »  calkd 
MKf/  (rapid  eye  movemeni)  »leep-  Pcopk  awakened  dur- 
ing thu  pefiod  o(  sleep  nearly  alway>  have  clear  memofie* 
of.  dreamt^ AkhouaW  •  d  rea  m>ng«o«cun  ^  duri  ag  i  he  other 
Mar«  ot  iktp.  it  tslets  deuiled  a'td  Icm  frequent.  We  abo 
know  now  that  dreaming  w  importani  to  mental  health.  If 
people  arc  deprimJ  of  REM  »kcp  for  Kveral  nights.  Ihey 
will  be^n  to  hallucinate  during  waking  hour*:. Finally.  »leep 
laboratory  rewarch  has  ako  ditpfoved  several  old  myths 
about  dreamt:  Dream*  do  not  uwaliy  uke  place  in  an 
imiaai^  DreanM  that  incorpoiaie  color  ire  not  limited  to  a 
few  people.  No  one  b  dreamlesa.  ^ 

Modern  dream  mTerpretition  owes  much  to  Sifmund 
FfTwl.  who  ibeocized  that  dream*  serve  two  nu)or  pun- 
pottir  Firsts  they  prcierve  sleep  by  weocporaiiAg  exietrtal 
»«muU  inio  the  dttam^ content.  Sloond.  dream*  arc  the 
expfe«ion  of  the  »ub<ofl*aou*  mind  and  rcprcKnt  wish 
(Mtfillmeni  Freud  cmpha»i/cd  that  every  dream  hai  a 
manifest  content  that  •  <xprc»sed  through  symbol*  Iq 
^uncover  the  latent  and  more  imporuni  meamng  of  Ihr 
dream,  one  must  intcfpret  these  symbdb.  whxh  are  larfely 
sexual  and  universal.  Modern  dream  interpretation  b«ild» 
on,  but  greatly  modifiet.  Freudian  theory.  It  doei  f  by 
emph**i/mg  the  marijfest  confcnt  cf  the  dream,  by  support* 
tng  a  wKkr  raftge  of  meamng  than  wi*h  fulfillment,  and  by 
de^phatiring  the  uiwcrsainy  of  symbol*  Modern  tbeo- 
n*ts  agree  withj^rcud  that  dreami  are  the  activity  of  the 
unconscious  mind:  but  they  stres*  that  the  uncomaou* 
often  say*  what  it  mean*,  pots  forth  much  useful  infointa- 
tion,  and  uses  person!  symbols  that  are  me^niniful  only  as 
iodtvidual*  can  interpret. them  in  thc^  context  of  their  own 
itfe  experliencet. 


It.  What  has  modem  research  reveaW  about  sleep? 
A.  Sleep^M  cyclic  in  nature. 
K.  Dreamt  Uke  place  in  an  instairf. 

C.  Dreams  may  be  prophetic. 

D,  fcveryone  need*  at  kast  seven  hours  of  sleep 
nightly. 


12.  The  author's  main  inieniioiv  in  the  last  paragraph  if 
probably  to. 

F.  compare  ami  contrast  Preudun  dream  theory  witli 
more  models  oream  theory. 

G.  dcKribe  the  >tapcs  of  sleep  in  relation  to  their 
dream  coaicdi, 

H.  explain  iHe  uk  of  symbolism  in  dream  interpreta- 
tion. 

J.  define  ihe  nature  2nd  purpOK  of  dreams. 


II  A  man  has  a  recurrent  dream  that  hts  home  is  on  fire 
He  feci*  strongjy  thai  the  meaning  of  the  dream  i^ 
r^laiad  to  two  traumatic  events  in  bi  childhood.  His 
traodparenis'-home  burned,  and  his  church  burned 
His  acal^  insists  that  fire  sigmfiei  life,  nsovcment.and 
vitality.  They  cannot  agree  about  the  interpretation  of 
the  dream.  Wha:  is  the  major  difference  in  their 
posttians?  * 
A.  Die  man  is  showing  the  influence  of  a  religious 

background  and  is  insisting  on  a  prophetic  inter* 

pretaiion. 

U.  The  analyst  is  using  a  more  modem  approach  to 
dream  bierpretation  than  is  the  nun 

C.  Ihe  man  ts  using  fire  as  a  universal  symbol.  The 
analyst  sees  fire  as  a  personal  symbol. 

D.  The  analyst  sees'fire  as  a  universal  sy^nbol.  The 
man  is  using  fire  as  a  personal  symbol. 


l$.^Thc  best  summary  of  the  present  state  of  rcKjich  on 

\jfefl^  is  lhat< 
•   F.  recent  research  fias  proven  earlier  theorisu  accu. 
rale  on  most  points.  A  good  syntheus  of  work  «n 
dream*  U  now  needed.  . 
C.  all  hough''  relatively  recent  methods  of  research 
^    have  added  much  knowledge  «boui  Ihe  dreaming 
^'proccfi;  there  i*  much  to  be  karned  about  the 
physlologicat  as  well  at  the  imerpreitve  aspects  of 
dreaming. 

^H.  wha  IS  not  known  about  dream*  at  the  present 
lime  is  probably  not  worth  the  research  that  would 
be  necessary  (o  obtain  further  information* 

J:  modern  research  so  completely  refutes  earlier 
.  theories  that  a  breakthrough  in  dream  research 
M<mi  imminent. 


14.  A  psychotiBSi  working  m  a  sleep  laboratorlr  designs  a 
«udy  in  which  she  awakenrsubjedsjust  as  they  go  into 
the  REM  suge  of  sleep.  Which  area  is  she  most  likely 
ttikfyi'ng? 

F   .^Icep  d«r)vaiioft  1^1* 
0.  Dream  deprivation  * 
H.  Eye  movement  padcrns 
J.   Dream  content 


15.  Manifest  dream  content  ts  to  latent  dream  content  as 
liicrnl  interpretation  ts  to* 
A.  direct  interpretation. 
U.  symbolic  interpreUiion. 
r.  psychic  inierprelalion. 
D.  exact  interpretation. 
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If  ilttp  ronrchen  «erc  to  discover  that  dream 
dcpritnuon  l«ad>  lo  dtaeaMd  memory,  y^hich  <onc{u* 
4i'oa~  about  the  purpotc  of' dreamt  would  be  mo>t 
loikar 

K  Ornms  rccapiiuUte  events  and  tnforsutton  col- 
lected by  the  waktni  mind.  Thi%  recapitgtaiton. 
may  be  a  pan  of  the  memory  sioraie  proce». 

G.  Dreamt  unite  the  tiidividiMil  with  a  co»mic 
conKiouinew^  This  Union  huy  be  one  of  the  base*  9 
for  memory  Mora|c 

H,  f>feamt  provide  an  outlet  (or  tupprewed  wishes 
whick  if  inhibited,  create  ennoiional  blocks  that 
d«crca»e  metnory- 

J.  Dream")  supply  the  mind  witff  new  ways  of  mter^ 
preuof  remembered  iW  ^rmatton. 


J7.  fhe  history  of  the  study  of  dreams  Sufiests  all  of  the 
followtnf  predictions  EXCEPT  that: 

A.  p»ycholO|Kts  «ilt  develop  maeasinfly  accurate 
approaches  10  dream  mterpreuiton< 

B.  studies  about  the  different  functions  of  the  two 
hemispheres  of  the  brain  witi  complement  dream 
study. 

C.  better  undersumJmf  of  the  body's  biochemical 
processes  wiU  bnnf  about  a  clearer  understandmf 
of  (he  drcammf  proccsi- 

U.  an  intensified  emphasis  on  soentific  research  will 
relate  dream  stu^  to  the  area  of  superstition. 

II.  Dream  dep/ivation  could  c^oncctvabty  be  used  as  a. 
Vw  means  to  improve  menial  health. 

G.  treatment  for  depfesuon. 

H.  means  to  pre\ent  insomnia. 
J.  bramwvshmf  technique. 


D 
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When  ihe  Qvii  W4r  erupted,  nuny  sUvcs  dexncd 
their  owners,  sought  rcfufc  behind  federal  imes.  and 
appealed  to  ihe  federaJ  officers  for  heip.  In  the  absence  ol 
an  offiCMl  federal  policy*  each  c om ma nding  officer  fo'mcd 
imlividua]  poficy  aayrding  to  hu  nee'Js  and  potiiion  For 
exaiopk.  Oencral  Hotter,  who  rcalured  the  importance  of 
slave  labof  lo  the  Confederate  *-ar  effon.- declared  run- 
awaj^  slaves  'contraband  of  war** and  forbade  their  return 
,  tltim*tely*  the  officers  ur*cd  the  government  to  formulate 
an  official  policy  on  -thU  ^sue. 

 ^ucb  a  policy. was Jux^establuhed  uiitil^ugu$t.l&6lr 

when  the  Confttcation  Act  was  passed,  panly  in  response  to 
abo]ition»ts'  growing  dtssatts  fact  ion  v^ith  the  federal 
goi-ernmears  failure  to  deal  decisively  whh  this  tmponani 
>Mu<  Ihi*  Act  stated  thai  any  property,  usdudmg  slaves. 
Ls«d  with  the  knowledge  or  conKnt  of  the  owner  to  aid 
iMurrectiOrusjs  again*!  the  United  Slates  "**$  lawfully  sub' 
jeci  to  capture  and  c4)nftscation.  The  Act  specified  that 
confiscated  ilaves  were  to  be  freed,  but  did  not  specify  what 
was  to  be  done  w^ttt  them,  or  for  them,  therealier.  As  the 
Union  army  pushed  southward  and  more  and  more  sUves 
sought  refufc  behind  federal  lines,  the.probIem  of  ^h^t  to 
do  w4hthc  freed  slaves  increased.  In  some  cases.  Ihey  were 
put  Fnio  special  campt;  in  >ome  cases,  they  were  allowed  to 
farm  conftscated  lands.  In  all  cases,  however,  they  faced 
Kvere  prob'^ems  of  teadjiutment  to  a  completely  new  way 
of  lift  Special  commissions  and  bureaus  were  formed  iq, 
find  ways  and  ^^eans  to  help  them.  ' 

Like  the  runaway  slaves,  many  of  the  slavef  freed 
t/nder  the  Confiscation  Act  wanted  to  join  the  fighu  but  it 
was  not  until  the  Ipring  of  1*62  that  Lincoln  finally  allowed 
blacks  to  entiji  in  the  army.  Until  i^n«  Lincoln  had  flared 
the  aIleftalK>n  of  the  border  states;  he  changed  ha  mifuJ  at 
theurpngofthe  officers  in  the  field  During  the  »um'mef.  a 
few  Wack  re^mefti's  were  formtcd  but  were  subsequently 
disbanded  When Cencral  Augustus  Chcilainassumedcon- 
trol  of  black  recruiting  in  Tennessee,  however,  the  RfO*  ' 
^am  became  succcssluL  In  the  fojlowing  year,  serious 
recruiiin?  •i/ofts  began  In  the  Mississippi  Vatley  Of  the 
total  number'of  black  so'diets  recruited  for  the  war,  more 
than  half  were  recruited  In  Confederate  itates  that  had 
fallen  to  the  Union  txoop5.  Black  renttients  became  an 
im'poitant  link  in  the  chain  of  Cull  war  events. 


,  At  more  and  more  runaway  slaves  headed  toward 
Northern  cilKS.  Northern  attitudes  toward  abolition 
became  increasingly  negative  pnmanly  because  the 
A.  neighborhoods  that  blacks  moved  "Jf^  beiztt  to 
deteriorate. 

blacks  could  not  be  avsimtUied  as  easily  as 
immigrants. 

Ci  Northerners  had  wanted  to  free  the  slaves  but  only 

)f  they  agreed  to  emigrate. 
I)«  blacks  competed  with  Son  hern  workers  for  jobs^ 


U.  The  tnion  recognized  the  right  of  blacks  to  be  free  but 
did  not  automatically  grant  them  equal  status  with 
whites  Thu  fact  is  supported  by>U  pf  the  following 
circumstances  EXCEPT 

I-    black  soldiers  being  organ»ed  into  icparate.  all- 
black  regiments. 

G.  black  soldiers  receiving  medab  of  honor  for  theif 
valorous  conduct  during  the  war  ^ 

H,  black  soldiers  serving  as  cook),  stewards,  ^nd 
officert'  servants, 

J.  very  fevy  blacks  being  o^icert- 


2L  Which  ordering  of  events  ts  chronologically  correct, 
staning  with  ll)c  earliest  event? 

I  Emancipaiioti  Proclamation 
IL  Official  federal  approval  of  recruitment  of 
blacks 

lit  Passafc  of  Confiscation  Act 

IV  Secession  of  Southern  states  from  the  Union 
A.  II,  L  IV.  in 
■.  ill.  IV,  11, 1 

C.  iV,  11.  ill,  I  •  

D,  IV.  iiL  li,  i  ' 

22,  Uunng  the  war.  Southern  slaveholders  were  probably 
LEAST  likely  to  use  their  slaves  to 

F.  maintain  the  plantations  in  the  abKnce  of  ihetr 
masters. 

G.  prepare  food  for  trcopt. 

H.  carry  messages  behina  Union  fines. 
J.   help  produce  ammunition 


23.  By  Il65  there  were  many  blacks  in  the  North  These 
free  blacks  were  likely  to  have  been  ail  of  the  folio w^g 
BXCEPr: 

A.  slaves  who  had  escaped  through  Ihe  Underground 

Railway. 

■.  ilaves  who  had  bought  their  own  freedom, 

C.  slaves  who  had  been  freed. 

D,  foreign  immigrants. 

24.  The  Confiscation  Act  did  NOT  allow  confiscation  or 
capture  of  a* 

F.  sUve  whose  master  was  loyal  to  the  U.S< 

G.  house  in  which  Confederates  had  met  regularly  for 
strategy  sessions. 

H.  farm  on  which  food  for  the  Confederate  army  had 
been  grown. 

J,  slave  who  had  killed  his  owner's  horses  rather  than 
let  the  Union  utmy  have  ihem. 

25.  rhe  Southern  Jtates  typically  assumtd  a  position 
toward  states  rights  that  was  mo%t  C<gJTR\PlCf  ED 
when  iheyt  ^ 

4-  maintained  each  sute's  right  to  determine  iti  own 
polfcy  on  slavery. 

B.  rejected  federal  authority  over  economic  policy. 

C.  upheld  the  right  to  secede  from  Ihe  Union. 

D.  encouraged  federal  action  to  recapture  fugitive 
s!laves.r 
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M.  One  proUoB  of  rttdjuiiMU  tbM  futdtve  »{«vc«  dtd 
NOT  tevc  10  fM(  wu  ilwr 
F.  hck  of  worUly  pomuioM.  ^ 
C.  fMMl  t*  tatrii  bow  to  vote. 
H.  mti  10  find  i  jo¥, 
J.  need  to  find  a  ^oe  to  bvf 

}7.  A  niMMV  ilive  who  loufbt  rcfupr  behind  Union  itne* 
before  ll«  womM  be  LEAST  Uidy  to  be  lent  to: 


Jkn  chImI  in  Um  aniiy. 
B.  (arm  confiented.teoitory.  . , 
\  C  live  M/S  iftmX  fcfufee  c«n^. 


I  from  » 

I 

ConTiaation  Act  dw^iamt  fuaaiwy  »Javcf  coa- 


The  C6nriacati< 
'  tf^band  4: 


F.  their  ownef*  had  uied  them  ia  the  Confederate  war 
effort.  .       .  . 

G.  the<f  owaer»  had  declared  tbem  Iu|Jtim» 

H.  ihey  iMd  voluntarily  left  their  owner*. 
J.  ihcy  hved  in  nonilave  lUtee. 


OuMUom  aM3  art  nox  bM«d  on  a  rMdir>g 
paaMOt,  You  aft  lo  •otwtr  ttiM*  q««t«oot  on 
mt  bMia  of  your  pravkHM  achooiwoffc  In  tm 
•ociai  studwt/ 


1».  Tlw  elactofat  col!epe  h««  been  moet  frequently  and 
lerMMtily  cntHuad  becauw  tt; 

A.  enables  a  |»rcaideat  to  be  elected  with  fewer 
pofalar  vote*  than  hie  ofyctnent, 

B.  »  demoAHrably  inadequate.  a»  proven  by  the  dif 
Mted  electioM  of  IIM.  I«24,  and  1176. 

C.  It  outdated  and  overly  liniple. 

D.  aliowt  the  election  of  a  (icw  weak  prceideAts. 

3*.  Which  daiae  of  the  Fourteenth  -Amendment  hai  been 

the  baaii  for  meet  Supiemc  Court  dectvont  deahn| 

with  the  ctvii  rifhu  of  niinontMe? 

F.  TAll  pereone  bom  or  naturatijed  in  the  Unifed 
State*  .  r.  are  atiiw*  of  the  United  Slate*. 

C*  ,  whet>  the  right  to  voieJideiurdfoanyof  LSe 
mate  inhaUunti  of.  tsch  Suu  /.X  tne  of 
rernscntAtioft  therein  shall  be  reduced  "  ' 

H.       nor  shall  anvSute  deprive  any  person  of  life, 
fiberty,,;>r  propefiy.  without  'iue  pro«e»*  of  law. 
nir  d«»y . . .  equal  protection  of  the  law*. 
'    J.  ■*liit  nettber  the  UAtted  Stale*  mV  any  State 

shall  pay  any  debt  .  .  ,  incuraed  in  aid  of  insur- 
rection .  X .  against  the  United  State*. .  . ." 


31.  Ail  of  the  foltowint  legislative  power*  check  pre«iden« 
ual  powerEXCEFT; ' 

A.  impeacfanient  and  removal  from  office. 

B.  changtng  the  sixe  of  the  Su^rennejCoun. 

C  refuat  to  oonTirm  pmidential  appointments. 
D.  overrMling  a  veto. 

32.  An  cntredvenetir  wwh(4  |o  ofl^n  a  shoe  store  for 
women.  To  deterrmnc  aluch  co^nmunUy  would  pro* 
vide  the  frfateet  numf^  of  potcitial  customers,  she 

'  diouU  ^iher  infortM(iM  about: 

I.  fender  ratios. 

II.  tout  population. 

III.  aoonomtc  sutu4e*. 

IV.  oompeUtsr^  ' 
F.  I  aad  IV  o^ly 

L  lU  icid  111  only 
H.  ti:  III.  and  IV  only 
J.   I.  II.  II!.  and  IV 

33.  One  characteristic  of  mftincts  is  that  they  arc: 

A.  imp^nted  shortly  after  birtb. 

B.  the  result  of  environmental  innuences  after  birth. 

C.  behavior  pattern*  that  >«ty  within  a  species. 
D*  untcamed.  inherited  behavior  patterns. 

34.  An  open  prtmacy  u  one  in  which  voters  an: 

F.  .  openly  declare  altegiance  to  one  party^ 

G.  paitiapaie  in  the  PHmacy  of  more  than  one  party. 

H.  CBit  their  vote*  without  spcdfying  a  party 
prvfercnot. 

J.  cbanffe  their  parties  by  pledgmg  to  support  a  new 
party  on  election  dey. 

35.  One  underiyifti  pnnaple  of  modem  cultural  studies 
strcsac*  (hat  every  culture  must  be: 

A.  jud|*d  in  tti  own  context. 

B.  ,  visrted  before  it  can  be  properly  judged.  . 

C.  judged  in  terms  of  economic  and  induttrul 
progress.'  .  . 

D.  judged  in  terms  of  one's  own  moral  standards. 

yk.  The  main  function  of 'ifefl^al  Reafrve  System  is  to. 

.F.  clear  checks  for  commercial  banks 

G.  naiouin  the  gold  supply  upon  which  the  currency 
it  based. 

H.  control  the  supply  of  money. 

J.   act  as  a  fiscal  agent  for  the  federal  go vemment. 

37.  A  market.oriented  economic  system  is  frequently 
descnbed  as  ofierating  subordinate  to  ""consumer 
sovereignty^  This  concept  mean*  that: 

A.  ^  advert  i*en  hi.-e  btSc  Cf-r^?  t.'n^Jct  on  wv;rcign 

consumers: 

B.  producers,  rather  than  consumers,  determine  the 
kind*  of  goods  and  Mrvices  produced. 

C  consunwrs  make  a  careful  inventory  of  their  needs^ 

for  the  benefit  tf  producers. 
D.  consumer  judgments  determine  the  amounts  and 

kinds  of  goods  and  Krvices  produced. 
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3K  The  pre«Mlent  hai  grett  independent  authonty  m  for* 
Cttn  affairs.  Without  the  consent' of  Congress,  he  can 
do  all  of  the  foik>«ln|  EXCEPT 
IV  jtnd  troops  abroad. 

G.  declare  war 

H.  prodaim  U  S  neutrality 

^j.  enter  into  a«forflui  aireement  with  a  foreign 
nat}oo. 

39,  The  m«lievalKrf»poiitiort  in  locwty  differed  from  the 

'  Amerifan-4iav«;s  po»»iio«  H»  that'lhe-»erf* 

A.  was  atitomalicaUy  etna  net  patcd  Upon  ihc  death  of 
htf  master. 

■w  was  exempt  from  personal,  houiebotd  duties. 
C  was  forbidden  the  Christian  sacraments. 
D.  could  ro<  be  sold  a«ay  fromiithe  land. 

4*.  The  New  Iraperuhun  of  >i(70-i914  was  characteriicd 

by  ihe 

I  search  for  new  industrul  markets. 
U.  need  for  new  yourccs  of  raw  material 
IH.  search  for  new  markets  for  financial  mvesi* 
^  melt? 

IV.  9c:irch  fof  strategicatly  located  areas  to  safe* 
guard  trade  rofutev 
F.  UAdlToniy 
I    C.  II  and  IV  only 
H.  I.  M.  and  Jli  only 
J.   I.  II.  III.  and  IV 

41.  Jacksonian  Democrats  wire  generally  opposed  to' 

A.  slavery"  * 

the  SpoiU  System 

C.  free  trade 

D.  a.cenirtbred  natMna}  bank 

42.  Between  World  War  I  and  World  War  li,  conditions  in 
Germany  and  the  So«et  Umon  gave  ntfi  to  govern- 
mcnts  that  can  best  be  described  as 

F.  communi(t> 

G.  socialist. 

H.  democratic 
J.  totalitarian. 

43.  Most  N'ew  England  Punians  believed  that  men  of 

A.  would  never' go  to  heasen 

B.  should  give  away  their  wealth  to  the  less  for- 
tunate. 

^  C.  shouU  pay  a  high  u\  to  the  slate^ 

^  D.  should  aaept  wealth  as  4  sign  of  divine  favor.. 


Since  1940,  competition  in  congressional  elections  has 
been  declining.  At  laast  three  major  factors  contnbute  to 
this  decline.  First,  mcumbency  itself  guarantees  many 
advantages.  The  media  routinely  report  on  rep  resent  a  uves* 
actions,  so  incumbents  are  better  known  than  their  chal- 
lengers. Incumbents  can  mail  several  letiersa  year  to  their 
constituents  without  paying  posuge.  Ihcy  are  entitled  to  a 
number  of  free  tnps  to  thetr  dm  net  every  year,  so  there  is 
little  danger  of  their  being  tsolaiad  in  Washington. 

_  Se^^Mid.  the  sectinng  ojj^mmittcc^wlj.H^"?^'"-*''^ 
Chairmanships  is^sometimes  influenced  by  seniority.  Hav- 
ing more  seniority  than  any  chatienger  might  also  occa- 
sionally help  an  incumbent  to  promote  legisUtion  fivor- 
able  to  the  district,  thus  providing  voters  with  great  incen- 
tive to  reelect  incumbents^ 

Third,  representatives  are  increasingly- performing 
valuable,  noncontroversial  servica  tor  their  constituents. 
Sinc«  the  number  both  of  federal  programs  and  of  the 
people  affected  by  them  has  mushroomed,  mistakes 
ineviublyXKCur,  Some  people  may  fail  to  receive  the  assis- 
tance due  them,  such  as  Sooal  Secunty  payments  or  health 
benefits.  Others  a  re  adversely  affected  by  arbitrary  bureau- 
cratic dedsions.  Faced  with  the  complex  reguUiions 
surrounding  federal  programs,  they  often  turn  lo  their 
representatives  for  help.  And  because  federat  agencies 
depend  upon  congressional  approval  for  their  budgets  and 
new  progranu,  representatives  usually  can  help,  when 
representatives  complain  tb  an  agency  on  behalf  of  con* 
stituents,  they  nearly  always  receive  quick  cooperation.  For 
Ittc  incumbent  who  has  performed  such  services  for  thou- 
sands of  eonstiluents.  reelection  becomes  easier 

TbcK  trends  disturb  many  observers  who  believe  that 
reprcscnutives  spend  tpft^much  time  on  constituent  Kr- 
VKct  and  too  httle  Itync' deliberating  legislation.  Con* 
Kquently*  they  facl  that'the  House  may  occasionally  enact 
poorly  designed  programs  that  create  more  problems  for 
the 'people  than  they  solve.  The  representatives'  case  loads 
burgeon,  and  their  attention  Is  further  diverted  from  le^s- 
lation.  Finally,  these  crttics  deplore  the  decdnr  in  congres* 
sio^al  turnover  itself.  They  argue  that  a  reprecenuti\e"s 
views  change  little  after  election  to  office.  Thus  the  only 
way  to  get  the  Houk  to  adopt  innovative  policies  is  to  elect 
new  representatives,  something  that  is  becoming  harder  to 
do.  ^ 


,  Federal  igenaes  are  very  responsive  to  reprc- 
xntativcs'^mplatnts  because 
^   ibLageftcies  depend  upon  congressional  approval 
f/ortheir  budgets  and  programs, 
'a  large  r>umber.of  agency  otflculs  are  former 
iepslatofs. 

H.  agency  offlculs  are  ultimately  responsible  to  the 

(>reskleni.  ^ 
egislaiors  have  the  right  to  appoint  and  to  fire 
agency  officials. 
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48,  the  potiticat  advtnitiet  I  hat  are  tn^oyd  ¥y  tncum* 
bent  i^tkiors  tndude  ihc  ofpoftuAtiy  lo. 

I.  receive  a  lar|e  amount  of  anntiton  from  iKe 

II.  beeloxly  idenii/icd  wi(h  the  federal  bureau- 
cracy. 

Ill  matt  t»iera(ure  lo  conttKuenu  po»U|t*fre«. 
*  A.  I  only 
'B.  Uonly 

C^lTmrf-HI-orrfj  

O.  II  and  III  OAly,  c 


4^  Tht  pamfe  can  best  be  duradcnied  ai  Uinf: 

F.  J  pairioiic  (nbute  to  Cbfitre«s''>  rok  in  3tdtn|  the 
average  atiitn,  ' 

G.  an  openly  crrtical  attack  on  the  behavior  of  several 
powerful  ienisbiorf.       ^    \  " 

H.  an  objeuivc  report  on  the^atik  of  con|reMK>nal 
cofpmiitee*  and  tubcomnuttect.\ 

J.  a  review  'of  factor*  that  may  irifluence  coaf  re»- 
sk>nai  competition  at  ^mH  at  ii^ir  teti^tive 
ferforfflance< 


,  Ihe  author  ttatcv  lhat  feetectioriJ^Secome*  eawer"15r' 
the  incumbent  who  ^rformt  nnkny  constituent  ter* 
vices  WM(  b  the  underlying  auutnption  here'' 
A.  Mo«i  representatives  care  about  tittle  except 

yeiiiVtf  reekcted  \ 
i.  People  r«ceivin(  tuch  services  reWard  incumbent  t 

With  iheir  votes.  \ 
C.  Incumbents  are  usually  belter  lirW>wn  than  that 


opponent  t.  ,  , 

Few  people  are  uttsfied  with  ih^  performance  of 
Hovemmenl  afcncies. 


f^hy  would  "misUkes  ineviuMy  occur"  in  the 
dimm^ratlon  of  some  federal  programs? 

Av'trage  ctiiKns  are  demanding  more  and  belter 
government  services. 

A  certain  arnount  of  human  error  enters  the 
\  impknwflUiion  of  s»y  program. 
If  Certain  federal  agenaes.  Cke  the  Socul  Secunty 
/   Administration^  tre  mere  inept  than  others. 
if.---JLcdera>  olftcials  deliberately  surround  programs 
wrth"x»mplex  regulations  in  order  {o  discourage 
public  scrutiny  


49.  According  (o  the  passage.  reprcKntattves  increasingly 
perform  "noncontroversiaP  services  for  their  con- 
stituents. Activities  that  could  be  considecpd'con' 
tro\ersial  would  probably  include.'  ^ 

I.  speaking  at  hi£'  school  graduations  and  other 
honorary  functions. 

II.  sponsoring  le]0sIationrV>n  issues  I  ike  tax  reform 
and  gun  control. 

III.  sacunng  federal  Unancing  of  district  water 

  treatment  plants. 

AT^l'only   

».  11  only 
C.  IIS  only 

O.  I  and  11  only  ^ 

M.  Accoidini  10  the  passage,  cntics  of  Congress  believe 
that  the  views  of  most  representatives  on  major  issues 
arei 

F.  heavily  influenced  by  the  masic  rry^ia.  « 

G.  dictated  by  the  party's  platform  .  * 
H;  in  agreement  with  uie  views  of  th^president. 

J.  unlikely  to  change'much  over  the  course  of  thor 
careers. 

51 .  According  to  the  passage,  cntics  of  Congre$«  object  to 
the  legislative  performance  of  representatives  mainly 
because: 

A.  repreKntativcs  generally  enact  programs  that  are 
far  too  big  and  expensive.  — 
•    many  rcpresMtat^ves  spend  so  mu^  time  on  com*  , 

mittee  hcaniTfs  that  they  often  neglect  to  vote  on 
'  important  legisfaRrdn  '  -        -  ^ 

C.  representatives  readily  give  in  to  powerful  special 

interest  groups. 
~0.  representatives  p:iy  mue  attention  to  constituent 
services  than  to  delib' rating  new  laws, 

5Z.  Which  of  the  folbwing  Onstitutional  provisions  was 
(were)  designed  to  help  i^p  Congress  responsive  to 
Changes  in  public  opinion* 

t.  Congiess  can  oven     »  presideniial  veto  with 

a  two'thirds  vole  or  both'houaes. 
tl.  Congressional  elections  a;e  hekt  everr  two 
years. 

III.  Bills  perfaining  to  the  ool lection  and  expend i« 
lure  of  federal  revenue  originate  in  the  House 
of  Representatives, 

F.  I  only 

G,  11  only 


III  only 
I  and  1 1  only 
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si  Minutts—52  Questions 


MM  CTIONfe  Eaeh  pMMf*  in  thii  iMt  it  toUowMl  by 

itvf  >l  QUO tioni.      f^dtog  «  »iiat.  thotm  th»  t 
bMt  wwwvf  10  Mch  quMt^  arMf  M«cK«n  th*  corr*- 
•poMino  tpic*  on  your  <ntw»r  alwoc  You  may  rvfvr 
to  tt)*  piiMji  «•  oft«n  «•  nocMMry. 


When  fkc»d  :(otcihcr  in  the  umt  •^tium,  msk 
SMUinc  nibtiof  fMh.  Jlrf<«  spktytms.  cxbibft  aafcttivc 
behavior.  AkhoMfli  thefr  »tr*«Hvt  bchtvior  rarchr  mufte 
ir\  ^olonfitf  Hiy»K«l  conuct  between  tith  of  <hc  urn*- 
»rcoc«.  it  UMiaUy  involve*  a  mwi.  A  bicrioyMi  performed  4 
ex^imcnu  to  kam  more  about  the  acgrcsMvc  bcbavior  of 
tbe  ri|i»Uii|  foh.  ^ 

Two  aquarium,  each  oonulmni  I  <  r»ak  StameM 
li|hliac  flih.  were  ^{m4  adiaeeni  lo  each  other.  Af  soon  ai 
the  Tfih  recofmaad.each  other.  thcV  flared  thetr  Tmi  and 
darkened  co»6r  An  occaMonai  attempt  at  physical 
contact  *af  i»ot«d.  After  2  mtnulc*.  one  nuik  iwam  to  the 
back  of  t  he  unk  ^nd  contracted  iti  Has:  al«o.  ill  »km  color 
hthtened.  ConMOwentiy.  the  otiKr  mak  uopped  any 
further  asf rcMve  behavior. 


When  a  bri|hily  colored.  Iar|e  femak  flih  wai  lubttf 
luted  for  the  mak  liih  m  one  aiiuarium.  the  male  m  the 
other  aquariiim  exhibited  an  »|(reMite  reipome.  When 
the  Urge  femak  ftih  «a>  replaced  by  a  li|hlly  colored, 
^mall  femak  fith.  the  male  did  not  exhibit  any  attresiivc 
bchawor.  Neither  femak  fnh  exhibited  auresiite  bchav wr 
to«nrd  the  mak  Hih.  Furihermof e.  when  the  2  fenuk  f>>h 
«ere  placed  >n  the  same  lank,  they  did  not  exhibit  ajiirei- 
$ive  behavior  toi^ard  each  other. 


Kxpttimtnt  S 

\o  determine  whkh  viiual  cues  eliat  anreuive 
bcKttior  m  nuik  Siametc  Hghtinp  fi»h.  painted  wooden 
models  vvcre  placed  in  an  a<}uarium  containmi  \ 
Sanw  fi*hlin I  liih,  Ihoie models  tMl  f  ^Vfcscutled 
an  aiire^^e-mak  ^afm^'Tifniiiti  Hih  cbbied  very 

^  aM*tMoe  responds.  Smalkr  models  eliated  reduced 
retfontcs.  The  more  darkly  colored  the  model,  the  more 

,  mren*e  ihe  aff'^ve  rnponic.  Model*  that  were  dark!/ 
colored  but  had  contracfed  Hni  elicited  very  Itttle  aigrcs- 
ttve  action,  modeli-^ihat  v»ere  lightly  colored  but  h4d 
t^tendcd  Tint  alM)  produced  Ijttk  af^reuUe  action.* 


txpftimmt  4 

Thia  expenmciit  wa«  desianed  lo  determine  whether 
male  SiamcM  fi^ltng  Tiah  cvhibit  lerriloruhiy.  A  mak 
Siamese  ri|htin|Tiab  waa  placad  in  an  aquarium  for  I  hour 
to  adjuat  lo  iu  new  environment.  Then., another  mak 
SiameK  fitting  Hah  was  placed  in  tbe  tame  aquarium 
ThM  K«Qnd  male  waa  attacked  immadHitely^and  responded 
by  contracting  its  fuw  and  ii^tentni  m  color.  This 
experiment  wai  repeatad  5  timea  with  diflerenl  Hsh  and  new 
water.  With  the  aamc  rcatths.  The  btologiat  concluded  that 
malcSiamckjfighting  Rat  exhibit  tetntoriality^ 


t.Jf  Ktemljnalejod  female  Siameie  noting  fish  were 
placed  together  in  Ihe  same  aquarium,  one  would  most 
likely  obaerve: 

A.  Ihe  darkest  and  largest  malrdominaling  the  other 
fiih. 

t.  breeding  behavior. 

C.  the  krgest  Hih  attacking  Ihe  imalkst  ftih. 

D.  no  aggressive  behavi(^r  among  Ihe  M\, 


I.  ty  turning  a  ligF't  color  ami  conlraciing  iti  fmt  when  il 
encounters  another  nule  fithting  fiih.  a  male  SiamcM 
noting  ftsh  liable  lo. 

F.  canwuflage  itself. 

G.  signal  lubffliisiveness  and  avoid  physical  harm 

H.  look  like  an  iflimaiure  fish, 
i.  indicate  tti  rcadineu  to  fight 


3.  Which  experiment  supports  the  hypothesis  that  a 
brightly  colored  female  fighting  fish  exhibits  tctntor- 
iaJity? 
^    A.  Expenment  3 
1,  Expenment  J 
C.  Expenment  4 
O.  .Sone  of  the  above 
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4.  Acfrmive  behavior  ts  NOT  beinf  exhibited  when  a. 

F.  MKkieb«ck  fiih  defends  ii^  Wntoty. 

G.  fotcvpine  releases  Mt  mtdU. 

H.  ea{  arches  ti«  hack  and  ftt$*e« 
J.  ehariKkon  turns  a  dark  color 

5.  ToinveM>«ate  further  the  terntoruliwo^male  Siamese 
rifMtnf  Hih,  the  expe^menierihouki  vary  wmeh  of  the 
followiiif  k/donf  m  bxpcnment  4?  | 

A.  Temfcraiure  of  the  water 

t.  SiK  and  shafc  of  the  aquanum 

C  Time  of  day  of  c  ^nmenuiion 

0.  Sabnity  of  the  ^  , 

i.  Suppote  a  brte  female  Siamese  fifhitng  Rsh  has  a 
•crmaneniry  dark  scale  pi|mtniai>on  If  this  muuni 
lemile  were  ptacad  in  an  aquarium  with  a  male 
Stam^  fifhitnt  fish,  the  male  fuh  probably  would: 

f  «  Ignore  ihe  female  fish. 
C.  continuously  attack  the  female  ftth 
H.  attack  the  female  Gih  until  the  female  attacked  the 
mal<.  ♦ 

1.  aiuck  the  femiile  ri»h,unii!  the  female  flared  its 

7.  Tish  species  M  exhibits  the  ume  type  of  auresuvc 
behavior  as  Siameae  fithtinf  fish.  One  could  expect  to 
obtcfve  afgresyv^  encounters  between'^ 
A.  -  mitei.of  spectcf  A. 
■.  females  of  >pecKS  H 

C.  a  male  Siamese  noting  fish  and  a  male  of  speoes 
O.  males  of  spfciet  H  and  other  types  of  Hsh 


C.  The  expenmentat  d&u  would  support  the  hypothestt 
that  agftcMve  behavior  ' 
F.  IS  not  part  ofthe  courtship  behavior  of  organisms 
C.  involves  recognizable  visual  displays 
H.  IS  behavior'that  is  innate  and  not  lea'rned. 
J.   is  often  exhibited  between  members  of  2  dtfrercnt 
ipectcs^ 


f.  Supposi  i  aquanums.  eacf^  containing  I  rtufe  Siamese 
fighting  fish.  were  placed  next  (o  each  other  so  that  the 
fish  in  each  unk  could  see  the  fish  in  evtry  other  lank. 
Which  fish  would  exhibit  the  most  aggressive  behavior 
toward  each  othc^ 

A.  The  2  Sigh  tot  •colored  males 

B.  The  2  darkest-colored  males 

C.  rhe  darkest*  and  hghtest'colored  mates 

D.  rhe  i  fish  would  not  show  any  aggressive  behavior 
toward  each  other. 


II.  To  clajify  the  results  of  Expenment  3.  (he  bioto^st 
should  IMC  models  that: 

h\  show  varying  degrees  of  fin  contraction  and 

exiemion. 
C.  have  varying  ginhs. 
'  H.  are  made  from  different  materials, 
J.   represent  othtr  species  of  fish 
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r«Mr«iiifr  M  a  relative  moUure  of  hotncst  or  cold* 
nc«i.  TtmprrHiirr  dunta  muH/rom  the  addition  of  heat 
to  Of  the  ftmoval  of  bMt  fr#ol  a  lub^ance.  In  the  urjy 
nlncmiith  century,  the  fr*v/ilin|  theory  of  heat  ^nn- 
taiiiari  tJ»fheat*«a»  aflttirf.  caUed  <-a/offr.  compo«e«oi 
MrtKie*  that  couM  flow  into  and  out  of  an  ok^ject.  The 
aionc  Mrudet  we  muiually  repellent  hui  were  iiiractad 
wMh  diner«M  afrei^M  to  alt  matter.  Jt  wa>  aho  aMumed 
that  the  fluid  wa*  comcrved  in  atl  interaction*.  In  the 
cnlwic  thwry.  the  Umfwraturc  oT  an  was  directly 
related  ip  the  amount  of  calon«  turrouadinf  an  atop  or  a 
molecule  o(  the  ohject. 


fytl 


U  the  modern  the*ry  oT  heat,  tempetature  m  c^ipUinal 
the  weyi  of  moleoilar'kinetic  enerf>  ,The  Hnetic 
theory  mmjibcs  molec»li»  to  be  m  eowunt  random 
moliM.  ••iMing  with  each  oth«r  and  the  walk  of  tbeg  con- 
tainef.  In  mm,  the  diiunoe  hetwten  moleculet  t^lieved 
to  he  very  larfim  relation  to  the  tiK  of  the  moPKulca.  In 
ideal  lam.  there  ut  no  tntennolecular  forcea  n  affect  the 
flMHKMi  of  a  molecule  hetween  coHwion*.  Newton'i  Uw«  a  re 
M«d  ta  cak«iate  the  force  exerted  hy  the  warn  of  the  con- 
tainer on  the  aa>  when  the  molecules  chan|e  momentum 
dunaa  the  coUutons.  This  force  is  e^iprcsMd  ai  pressure 
(foixc  per  area):  pressure  is  related  to  the  volunw  of  the 
cof 'aef  and  the  averaft  kinetic  cncrsy  of  the  molecules. 

The^»netjc  theoiv  expUin)  the  retationshipt  that  are  . 
•^vfd  in  nature  amdng  the  presaure.  volume,  and 
lamperature  of  a  jas.  Temperature  (expteised  in 
Ketvin)  is  direaly.pcopoftional  to  the  avera»e  molecuUr 
kinetic  enefty.  the  pcoduct  of  prw4ure  and  volume  is 
■directly  proportional  to  temperature.  The  kinetic  theory 
aWo  cxpuuns  a  diverse  assortment  of  tjhcrmal  phenomena. 
Evaporation  IS  recofni#ed  as  aq>olinii»roc«**  htcause  only 
I  he  f»Mt  moviftt  molecules  can  break;i  way  f/o"*  **!« 
ai  umpefatufe»'ttelow  the  hoilini^mt,  kavini  hehindthe 
moiecukt  with  less  kinetic  ener|y  and  thus  lowering  the 
temperature.  Most  substances  expand  when  heated  because 
the  increased  kinetic  energy  of  the  molecules  produces  an 
increase  in  the  avcw|e  separation  disuncc  between  mole- 
cules. 


11.  Why  IS  cvsporation  a  cooling  process? 

A.  Molecules  of  a  vapor  have  less  kinetic  energy  than 

those  of  a  liquk). 
t.  Wat«r  >apor  conducts  heat.  , 

C.  Evaporation  makes  the  surrounding  aK  dam^, 

D.  Ihe  ?aoIecules  with  the  greatest  kinetic  energy 
.escape  tbs  bqti'<d< 

12.  A  gas  u  confined  m  a  container  that  has  rigid  walU. 
When  its  molecules  are  made  to  move  faster,  how  is  the 
gas  affected?  ^ 

F.  It  condenses  to  a  tiquid. 

C.  Us  volume  increases. 

H.  Its  temperature  increasev 

J.  Its  temperature  decrfcises. 


13.  According  to  the  caloric  theory,  the  amount  of  caloric 
present  in^subsunceper  molecule  would  be  arroeasure 

of: 

A.  the  temperature  of  the  substance. 
•.  the  mass  of  the  subsunce. 
C  the  pressure  of  the  substance. 
^D.  none  of  the  above. 

14.  When  air  in  a  cylinder  is  compresswJ  by  a  slowly 
moving  piston,  what  occun  ui  this  system? 

F.  The  ^s  cooH.  because  the  average  kinetic  energy 

of  the  molecules  decreases. 
C.  fhe  number  of  molecules  increases,  because  lh« 


H. 


gas  beau  up. 

The  temperature  of.iU  gasJncreascs;  hacauwjhe,  _ 
a»ri«3pi«^lw  lose  energy,  as  the)  «>«Mle>jth  each 

J.  The  pressure  incrcaaet.  beause  the  ait  moJccuks 
coHide  more  frequently  with  the  wall*  of  the 
cylinder.  / 

15.  An  e(fective  way  to  increase  ihe^  number  of  collisions 
between  the  molecules  of  a  gas  and  the  walls  of  its 
enclosing  conuiner  is  to: 

A.  increase  the  mass  of  the  moleculei. 
1.  increaM  the  velodty  of  the  molecules. 

»    C.  increase  the  siae  of  the  molecules.. 

D.  decrease  the  kinetic  energy  of  ihf  molecules. 

t 

I*.  The  for«e  exerted  on,  ihe^walls  .of  a  eonuiner  by  a 
conflncd  gas  is  dira^y related  to' 

F.  the  changes  in  the  molecules'' momentum  due  to 
their  collisions  >ith  the  wallst 

C.  a  slight  km  in  average  spewi  AufTered  by  the  mole- 
cules at  the  walisi         ,  / 
H.  eUslic  collisions  between  iht  molecules  of  the  gas. 
J.  the  attraction  between  thc/walU  and  the  gas. 

17.  Scientists  m  the  early  nineteenth  century  most 
probnbty  assumed  that  caloric  repelled  itself  because 
they  obKrved  thatL.  ' 
_     A-^heaf  flows  iTom  hot  objects  to  coki  one*. 

B.  caloric  is  conserved. 

C.  hot  objects  contain  more  caloric  than  coW  objerts. 

D.  gases  are  highly  compressible. 

I gl  Which  pbKrvaiion  suggest  that  heat  is  a  form  <>f  •* 
''  energy,  not  a  substance  or  fluid? 
F:  Stirring  cm  warm  a 'tiquid. 

G.  Metal  rods  conduct  heat 

H.  Most  substances  expand  when  heated. 

J.  Heat  flows  from  a  hot  body  to  a  cold  orvc 

19.  If  aloric  particle*  existed  and  had  weight,  the  caloric 
theory  would  suggest  that  as: 

A.  a  JiMnTiiy  of  water  is  heated,  its  weight  decreak*. 

B.  a  quartity  of  lu4^  cooled,  its  weight  Tcmains  the 
same. 

C.  an  object  U  heated,  its  waght  increase*.  ^ 

D.  a  tubtuncc  is  heated,  it  contrrcts. 


QO  ON  TO  THE  NEXT  MQE.^ 


ERIC 


669^ 


665 


Oimtiont  20'34  «r«  not  b«s*d  on  a  rMding 
pM»agt  You  «rc  to  answer  th«Mi  questions  on 
th«  bM»s  of  yoOr  previous  schooiwori(  in  th« 
natural  sciancts. 


2#.  In  the  Circuit  show  n  below.  *ha!  u  (Kceuary  ft>r 
ojrrcnMO  Lfhi  the  Ump? 


taiiciy 


-m. — I 


15.  A  >ludcni  »it(Kt  to  test  the  hypoihcKi;  thiit  ()^  rate  <>f 
r^iration  lahuRUnv  dqxndi  on  tKe  amooot  of  avail* 
abk,oxv|en.  <J(si|ni  a  face nuik  that  allows  himiO' 
rcbreatnc  the  same  air  supply  coAiinually-;  he  aiaumei 
*  ihal  the  amount  ot'Oxyten  contained  ji>  the  aur  will 
prOfrciiively  Jecieasc.  The  chitf  error  m  tali 
1     procedure  u  that. 

A.  ii  K}f<DnAructed  face  matl  lIlo^Y  loo^uch  air  to 

leak  out,  '  c  '     .  . 

V.  the  effect  of  increa*ed  arron  jdioxide  -con- 
centration M  not  aqfountcd  for 

C.  the  effect. of  the  procnce  of  nitro|en  in  the  air 
supply  It  hot  coniidercd' 

D.  - the  amount  of  oxyfcn  ti  nol'adiui(?d  to  account 

forfVirying  retpiration  r^tet  m  numani. 


lamp® 


>witch 

f,  The  » Witch  mutt  fce  cloK<d 
C.  A  frffvanomcler  mutt  be  atuchcd  to  the  circuit 
H.-Currtnl  muit  travel  up  and  down 
J.  Another  cell  muit  be  jidded  to  the  lyfe^^. 


^  214  A  system  of  |a>c«  is  in  chemical  e^tl^ium  This 
"      equilibrium  iruy  be  disturbed  by  an  increase, in, 

~  ,  A.  pres«urc   ~ 

%t  temperature 

C,  the  amount  of  rcactant  ^ 

f>.  all  of  the  above.  / 

22.  Mercury  is  used  jun  m^ny  thermomeiert<io  n.easure 
icmficraturc  because  mercury  iv 

F.  the  only  m<tal  that  his  a  liquid  phdse '  - 

G.  nhe  international  tctcntifiC  sundard  for  measvnng 

tcmpccalom 

,H.  the  «nly  commonly  ay aitabksubstancethai  under 
'  foes  fnc:.iurable  chanica  «iih  tei^pcrature 

i.  a  hqvid  that  increases  uniformly  in  volume  as  us 
jempcrature  rises 

U.  Minerals  can  be  idenlified  by  their  hardness  on  &  scale 
from  I  (softesti  to  10  ^hardest)  Hardncvk  testt  uerC 
made  on  several  minerils  by  «<ratchin|  them  with  a 
finfcf.'taa  inardneit  2.$)  and  xNrommon  nail  (hardness 
S  J)  Vt'hieh  mineral  could  be  scratched  by  the  common 
luJ  but  not  by  the  ftniernair 
A.  Gypsum  {birdness  t\ 
A,  Cah.iie  (hardneu  31 

C,  Qvan^  (Kifdncis  7»  6 
O.  Sapphire  (hardness  9) 

'  24.  On  what  basis  are  ar^mafs  cSasuHed  into  phyU^ 

K,  fvource-of  cnerjc^  for  locomotion 
/      C.   f  ype  of  habitat 

H.  Si/e  of  torso  and  limb) 

J.  Structur*  of  bodj^paits  —  ' 


34'  A  student  conducts  /an  expcnnricnl  involvinf  a 
rMioactivc  material  ^iind  a  radiation  counter  that 
delects  and  counts  partklcs  of  raduiion.  The  student 
fi|ure»  that  exaetlx<4)5  counts  wiU  be'obtained  in  I 
minute.  This  prediction  is  NOT  appropriate  because: 
F.  >  It  IS  impossible  to  calculate  the  rate  of  decay  of 

radiotctisc  f^uterial- 
_G.  no  radioa^ive  materul  could  produce  so  many 

particles  rn^l  minute. 
H»  no  radioactive  material  could  product  so  few 

jpartictes'in  I  minute. 
'X  Mich'a/prcd'^'^o"^"  only  be  approximate. 


27*  Fossils  afc  tarely  found  in  ifneous  rock  formations 
because  igneous  rockt  are' 
A.  extrcliKly  hard< 
scarii;. 

C.  invo/>ed  in  frtquent  austal  shifts. 
f>.  forn)«d  at  very  hi|^  temperatures^ 


2t.  If  only  iome  of  the  offsprtnf  ol  a  pair  of  fruit  flies  ar;. 
vest! ttaf* winged  and  ebon)<olo(ed«'>*hatare  thcfenO' 
!>pc*  of  the  oarents  that  «ere  Crossed?  (v  «  recessive 
vesti^^al'Winged.  e  -  recessive  ebony-colored:  V  and  E  = 
dominant  >iM-type.ehara(;)(cf9l 
K.  VVEE  X  wee  , 
c;  VVEE  X  VvEe 
H.-wVcj|L.v\ee  - 
J.   Vl  Ee  X  VvEc 


2t.  An  e 

P>  ' 

imnv 
water, 
splint 
A. 

i.  %V 

C.  «r 


 r  addjTMCe  to  hydrochlonc  aad,  and  a 

produced  She  collects  the  gas  in  a  test  tube 
ed  in  water  and  thecrxemoses  the  tube  from  the 
'  ir  she  places  a  flowing  splint  in  the  tube,  the 

vilL 

n  vigorously. 

'  very  brightly  i 
off  ah  orange  smoke  ~  ■* 

%  a  |>opping  noisc 


buri 
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Whai  do  nwrtiber*  of  ihe  haloten  family  (floonne, 
chlonnc  bromine,  lodtne.  «nd  Atunnc)  have  in 
oommon?  J  ^ 

I  Al/6mic  wcifht 

II  MeltiBf  poifli  ,  . 
III.  Seven ekctrons m  ihe flutermosi  eJeciron  shell 

F.  llo^y 

C.  m7o«Jy 

H.  ILind  HI  only 
J.  ^^'ll.aixJlH 

/      .  - 

/ 

xSuppoK  Uui  in  an  expenment.  s  buliei  u  ftred  from  a 
/A?}  Ofl.the  lurface  of  the  earth,  ami  «n  jder.iical  bullet 
IS  firtd  from  i  gun  on  the  iurfiicc  of  ihe  moon 
rdenttcal  e-jd*  •re  uxd  in  l>oth  «tua(voihvar.d  the)  ?re^ 
/ired  it  JdtBttcal  an»le»  The  buHet  that  travel*  further 
ii  Ihe  Doe  fired  on  the 

A.  moon»  l>«c»uK  the  aeccteration  due  Ic  fr^viiy  on 
ih«  moon  'v\  looker  than  Uurtxpenenctd  on  the 
eanh,  ,  ,       .  , 

R.  «rth,  b^uie  th<  bullet  travels  fariif  through  the 
earth'f  atmoiph^rc  than  through*  lh«  moons 
itmotpherc  .  ,. 

Cr  earth.  bf<oiui«  the  bullet  weighs  more  on  the  earth 
than  on  tlAc  moon  «• 

D.  earth.  >ccaiuK  the  earth  has  a  greater  rnagnet 
field  than  liie  moon- 


Obsen-ational  studies  of  »Uf  dusitt%.  groups,of 
hundr«ds  or  thouunds  of  sur»  bound  togithef  »y  their 
mutual  gnvit*ti^Aal  attraction,  have  en/ibied  astronomer* 
to  theOJiic  how  $ur»  evolve.  Since  'he  sur»  in  any  cluiier 
all  formed  simuluneously  from^the  ume  cloud  of  inter* 
stellar  gas  and  dust,  all  the  stirs  In  a  dusiethave  the  unw 
age  and  chemicai  composition.  However,  differenl^usteri 
have  diffefent#fc».  Thus,  by  comparirvt  the  surs  in  young 
clwter*  to  those  in  oM  etusteri.  asiroy).n<rs  ern  HxctjUte 
.  en  the  pro«s>es  mvolved  innht  hfe  of  a  sur. 

Initially,  astronomers  detrnmw-jJtJiich  duster*  are 
young  and  v»hieh  arc  old  b/  considering  two  simple  facts: 
(I)  the  amount  of.fuel  a  sur  has  ayadablt  must, be  related 
son^how  to  its  mass  (large  Mar*  sUrt  with^more  fuel  than 
small  stars),  and  <2)  a  sur-s  luminosity  (tt^al  rale  of  radia- 
tion) IS  a  direct  measurement  of  its  rateof  fuel  use.  pbser- 
vations  abow'that  the  largest  »rehundrtds  ofulneias 
•  jnassivc  as,  and  millions  of  t»m<s  more  luminous  th^n.  the 
sm^Hfesl  surs.  But  even  though  the  large  sUr*  sUf  with 
more  fuel,  thertjrn  out  more  quickly  ^c«ui«  ihpf  Use. 
their  fuel  much  more 
fore,  star  chisters  that 


t  rapidly  lH«n  the  small  sur*.  ffiere* 
it  conuiii  a  high  proportion  ^f  yight. 


.  Todemt>nitrate<Hr>oMsbyan«offlu»d*rthina»ub^, 
one  should  xt  up  a  conUuier  wi|h  a  thistle  tube  * 
memfcrane  so  that  -  »•  /  Pf' 

F.  a  sugar  solution  is  on  both'ndt*  of  <h«  merab^nek|i 
C.    sugar  solution  uon  one  side  and^iiulled  wsfier  iiP 

'on  Vi€  other  sidit  of  Ihe  membrane,  • 
.*tr  iSttUed  water  »  on  both  «des  of  the  membrane. 
J.  1  sugar  jolw'jsr  ii  on  one'  ude  of  th^  membane 
"    and  lU  other      of  Ihe  hiemhfjne  .Venpty. 


.  A  pjpette  is  used  m  the  Uboratory  to  measure, 
A.  ih*  dameter  of.smatt^wiret. 
R.  ih<.wei|ht  ftf  a  jwIkJ  sample  . 
C.  small  disuncj)^  / 


massive  surs  muM  be  young,  aw*  those  that  contain  a  high 
proportion  of  famt.  small  sUrs  muit  b«  old.  ; 

UsiQg  observatKmai  meth^s  to  determine  the  rehUive 
iges  of  clusters,  aitronomer*  havr<ound*tbat  sUr*  spend 
most  of  their-iifetime*  as  m*(n  stqutrtce  start  and  that  their, 
tem{Kratu:v  and  luminosiues  are  directly  related  to  their 
masse*.  When  ifie  avaiWkte  filel  ts  exhtusied.  the  sUr 
rapKlly  expands  and  its  Surface  cools  until  it  becomes  a  tea- 
gtom  or  rrJ  supergitntSAlKr  a  short  time  as  a  giant  or 
super^ni  sur,  ikc  star  dies  by  eiihef  fatf  ng  Quietly  from^ 
view  as  a        JuMrf  or  exploding  with  tremendous  for«©«  * 
ata  jwrr/novv.  The  suptrnova  scatters  themiierul  of  the 
Slat  back  mto  spacer   -ere  j/wlll  eventually  be  rec>elcd  ^ 
into  a  rtew  generation  of  stiffs.  \ 


\ 


D»  a  volum^-^tlluid 


34.  If  red.  Wood- ceJJs  art  pUced  in- concentrated  salt 
scltttion.  they  *>1^ 

F.  &iwtate.  . 

G.  dissolve 

M.  fuse..^,  ' 
J,  shnnV'  t 


35,  In  whkh  stage  are  maswve  }Wi  hot  and  bngl^  and 
-wnall  SUrs  cool  and  faint?  *■ 
A.  Mainrstquence  4 
^      B.  Red  giant  ^ 
,    C-  Red  supeigunt 

D.  Supernova  ' ' ' 

Which  sequence  correctly  orders  th^  stages  that  a 
tvpical  star  mt^t  undergo  dunng  its  lifetime? 
*   *    I  Mairr?equence  , 

II  RcdgUpt  / 

III  RA  supen^unt 
IV.  Whtf^;dwarf_r'"_    __   _  _  , 

F.  \u.  Ill  ; 

G.  1.  II.  IV 

H.  liJII.  tv 

J.  II.  iv^l  * 
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37.  On  (he  bans  oPthc  inrormatton  in  ihe  ]»sMfe.  Hhich 

,  (roup  of  stars  could  be  cUtsified  as  a  star  ctusier? 
.    A.  All  surs  visible  lo  the  nak^  eye 

B.  Two  stars  in  orbii  around  each  other 

C.  Stars  thai  pass  each  other  during  their  M«ndennfs 
throufh  space 

D.  A  (roup  of  many  small  and  large  stars 

3t.  Which  siaiemeni  best  describes  why  star  clusters  are 

tiscOl  to  deteimine  how  stars  evoUe^ 
,    ¥,  Stars  nutate  eneriy  m  the  form  of  heat  and  ii|h< 
G.  Star  dusters  are  groups  of  surs  that  are  sn\ita* 
tionaUy  bound  tofciher. 
The  surs  m  a  clutter  are  ait  ihe  same  a(e< 
J.  All  stars  must  eventually  bum</U(. 

3*.  If  new  stars  of  different  ma*»c$^ere  formed  wjth  equal 
probahUiiy.  and  new  stars  were  continuously  forming 
and  evotvm|.  which  statement  would  be  consistent 

the  passage?  > 
A.  .Massive  stars  should  be  aecn  with  )ess  probability 

than  small  surs.  because  massive  stars  do  not  i>\e 

as  long  as  small  stars. 
3*  Massive  stars  should  be  seen  wiih  more  probabi{i(> 

than  small  surs.  because  massive  surs  are  larger 

than  smaU  stars, 

C.  Young  surs  should  be  seen  with  jnore  probability 
lhan  iUt*,  because  younf  stars  have  more 
energy  (ban  old  sun  , 

D.  Young  surs  should  be  seen  with  morcc probability 
(han  old  stars*  because  young  stars  have  a  different 
chemical  composition  than  old  stars. 


4#.  5iar  clusters  often  coaiatn  many  more  mam  sequence 
sUrs  lhan  red  supcrgunis  because^  as  compared  to 
main  sequence  stars,  red  supergtanis  are: 
*»  F.  brfur. 

G.  cooler. 

H.  fainter  '  « 
J.  more  short>lt\ed« 

41.  Astronomers  can  compare  a  star  m  a  single  cluster  lo 
other  stars  in  ihe  same  cluster  on  the  assumption  that 
ail  siarsinacSu^er 

A.  die  by  exploding  as  supemo\-as. 
■<  have  Japproximately  ihe  same  chemical  Compo* 
siiion, 

C.  exist  for  only  a  few  Ihouvjnd  )e3rs 

D.  have  identical  luminosities 


42.  Whirh  group  of  field  stars  (stars  noi  associated  uilh  a 
duster)  v^ould  ftave  ihe  smallest  ninge  of  ages? 

F.  Stars  with  varying  luminosities 

G.  All  stars  wilhitva  certain  distance  from  the  sun 

H.  Very  ma>sive  surs 

J.   Stars  millions  of  years  old 

43.  Accordmg  (o  the  passafe.  which  single  va ruble  deter- 
mines thelengih  ti  ihc  main  sequence  lifetime  of  a  sur'' 
A.  Luminosity 

■<  Chrmical  composition 

C.  Mass 

D.  «\umbef  of  surs  in  the  cluster 
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Radtoacti^e  decay  oeccn  «hen  nuclei  sponuneoutly 
Chanac  th«u  uruciuies.  To  determine  the  duractemila  of 
the  oy>/M.  b*ia.  And  xamma  rayt  emiticdby  these  chanfuig 
nuckt,  sctentisis  conductoi  3  ^nes  of  «xpcnmcnt». 

First,  the  capadty  <A  the  vanous  emmions  to  darken 
photographic  plates  wa$  observed<  ShceiJ  of  difrercnl  , 
maicruit  were  placed  between  the' decaying  elenneni  artd  the 
plate.  Alpha  ra>s  exhibited  the  tcaM  pci\etr;>tinf  ability: 
Ihey  Tailed  to  penetrate  both  paper  and  aluminum  sheets, 
icu  rayt.  with  intermcduie  penetrating  power,  passed 
through  soeral  thkkne»es  of  paper  and  aluminum  sheets. 
Bui  gamma  rays  penetrated ^per.  aluminum,  and  severa! 
other  materuls  before  they  «'.re  finally  stopped  by  lead 
sheets, 

Second.  th<  chemical  properties  of  atoms  that  had 
undcrjfone  radioactive  decay  were  examined.  Alpha  emis- 
sions caused  atoms  to  change  to  atoms  o(  new  elements 
(called  daughter  atoms)  that  had  2  fcwc^  positive  charges  in 
ihc  nucleus.  For  example*  uranium  231. emitted"  I  alpha 
partic^  to  become  lhonum234.an  element  whose  chemical- 
properties  are  different  from  those  of  uranium.  Beta  emiv 
sions  resulted  in  daughter  atoms  of  elements  with  other  I 
more  or  I  less  positive  char|e  in  the  nucleus  than  the 
original  atoo-s^  Gamma  emissions  left  ihe  chemical  prop- 
eriies  of  atoms  unchanged.  These  eAperimentsalso  demon- 
stfftted  thai  many  naturally  occurring  radioactive  atoms 
undergo  a  series  of  radioactive  decays,  until  a  stable 
nucleus  (one  that  does  not  undergo  radioactive  decay)  is 
finaUy  produced. 

The  last  senes  of  expenments  measured  the  masses  of 
alpha  and  bcu  parucles  only  Emitted  particles  (whole 
velocities  had  been  determined)  were  pasted  into  a  strong 
magnetic  field.  Hie  interaction  of  the  movin|  charfc  and 
the  Magnetic  field  deflected  the, particles  into  circular 
orbits.  I  he  radu  of  these  orbits  yere  proportional  to  the 
ina«tes  of  the^ particles.  Alpha  particles,  which  have  the 
same  mast  as  helium  nuclei*  were  found  lo  have  about  7.00O 
times  as  much  mass  as  beu  particles:  beu  particles  have  the 
same  mass  as  electrons.  When  daughter  nuclei  underwent 
similar  processes,  those  that  had  decayed  bv  alpha  rmis- 
sion  had  lost  7.000  timei  is  much  mass  as  those  that  had 
decayed  by  beta  emission.  Those  that  had  decayed  by 
gamma  emission  had  lost  no  perceptible  mass. 


I,  According  to  the  ttsults  of  the  expenments*  which 
particles  would  most  lilelybe  stopped  by  a  l-foot  Ujer 
of  waier^ 

I  Alpha  particles 

II  Beta  parlicfcs 
111.  Gamma  partides 

F.  II  only 

G.  iiionly 

H.  I  and  11  only 
J.  H  and  ill  only 


45.  Which  of  the  following  charges  can  a  beta  particle 

ha\e? 

I  One  unit  of 'positive  charge 

II.  One  unit  of  negative  charge 

III.  Two  units  of  positive  charge 
IV  Two  uniti  of  negative  charge 

A.  ill  only 
IV  only 

C,  I  or  II  only 

D.  I  or  IV  oifty 


44.  Atoms  with  stable  nuclei  arc  found  more  frequently  in 
natu^  than  atoms  of  the  same  element  with  unstable 
nuclei.  Hiis  ^ihenomenon  occurs  because  atoms  wilht 
T.  unstable  nuclei  undergo  radioactive  decay. 

G.  unstable  nuclei  immediately  disintegrate  into  noth-^ 
ing. 

H.  unstable  nuclei  readily  absorb  alpha  particles  into 
their  nuclei. 

J.  suble  nuclei  are  usually  mixed  with  radioactive 
atoms  in  naturally  occurnng  samples. 

47.  What  do  these  experiments  suggest  about  the  mass  of 
the  gamma  particle?  ^ 
A.  It  equals  the  mass  Ot^an  electron 
■.  Ijt  is  so  snuli  that  it  »  undetectable: 
C  "It  equals  the  mass  of  a  helium  nucleus. 
O.  It  is  greater'ihan  the  mass  of  a  neutron 


.  On  the  bas:s  of  the  first  experiment  only,  one  can 
correctly  conclude  that 'radioactive  decay 

F.  originates  in  the  rucia  pf  atomi. 

G.  changes  the  chemical  stfutture  of  atoms. 

H.  occurs  in  a  series. 

J.  produces  a  variety  of  emissions. 


4*.  Fhe  experimental  results  would  suppon  *hich  state- 
ment about  the  mteraction  between  moving  particles 
and  matter? 

A.  Uncharged  {Mrticles  are  stopped  more  easily  than 

cTiarged  particles, 
i.  Particles  with  md.""mass  and  tnore  charge  are 

Slopped  more  easily  than  those  with  less  man  or 

less  charge. 

C.  Particles  with  less'mass  are  stopped  more  easily 
than  those  with  inore*mats 

D.  Particles  wittia  negative  charge  are  stopped  more 
easily  than  those  with  a  positive  charge. 


To  handle  safely  a  weak,  solid  radioactive  object  that 
emits  only  alpha  particles,,  what  is  the  minimum 
precaution  that  one  should  take? 
F:  Weanng  plastic  gloves  and  holding  the  ot^ect  away 
from  ex|X>sed  skin 

G.  Transporting  the  object  m  a  concrete  container 

H.  Wearing  lead'lined  gloves  and  clothing 

J.  Using  n:tchanical  hands  to  holo  the  object 
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51.  Iht  third  itnts  of  €xp«nm«nis  dqKnds  d«rectly  upon 

which  pnndpk? 
'    A.  Mafnetk  ficMt  cucn  force*  on  rnovinf  charfcv 

i.  For  evtiy  action  there  U  an  equal  ?nd  opposite 
reaction, 

C.  rhe  eanh'»  fraviutional  force  i)  ^tronfcr  on  more 
massive  particfe)  than  on  1^  maw>e  panicles.  \ 
*  O.  Ihc  charite  of  a  panicle  depends  on  its  mass. 


52.  By  erm^n  of  >khich  type  of  particle  docs  the 
followinf  radioactive  decay  of  carbon  occJt? 


F.  Ncfative  alpha  panlcic 

G.  Positive  alpha  panicle 

H.  Ncfative  beta  pantde 
J.  Gamma  particle 


END  OF  TEST  4 
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Actual  Test 
Directions 


This  bookitt  contain*  four  l»?U~£o9'»»/i  Uzz^^ 
MttthfTtttics  Ust^g:  Sookl  Studfs  R%%(itng.  and 
N%iur»{  ici0nc0$  R—ding:  Jour  teits  mtaiurt 
tkiiu  and  abilitiM  that  ara  highly  rtlatad  to  succau  tn 
ootiag^, 

.  During  lha  first  haH  o(  tha  tatting  sawlon.  you  vwH 
compl«ta  tha  Eng(«»h  UMg«  Taat  ar>d  tha  Matba- 
matict  Utaga  Ta$L  In  tha  aacond  h»tf.  you  will  com- 
plata  tha  Social  Studiaa  Raadmg  Tast  and  tha  Natural 
Scfancaa  ^aading  Taat 

• 

Tha  quattiooa  In  aach  tatt  ara  n  umb#r»d,  and  th«  four 
Of  fiv«  suggaatad  answars  for  aach  quealion  ara 
lattarad,  bn  tha  arwwar  thaat,  thalows  of  ovaU  art 
numb«rad  to  match  tha  quaatiora  and  tha  ovalt  in 
aach  row  ara  latiarad  to  corraspond  to  tha  suggaatsd 
an$««r*. 

For  aach  quaaJJon.  first  dacida  w;nch  anawar  is  bast. 
Naxt  locata  on  tha  answer  shaat  the  row  of  ovals 
numbarad  ttw  sam«  aa  tha  quaation.  Than,  locata  tha 
oval  in  that^row  latterad  tha  aama  as  your  answar. 
RnalV*  biscVan  tha  oval  compiataly.  Usa  a  soft  laad 
paocri  and  maka  yoor  marks  'haavy  and  black.  00 
NOT  USE  A  8ALL-P0IN T  PEN, 


You  may  work  on  aach  tast  ONLY  whan  your  tast 
adnfcinistratof  tails  .you  to  do  so.  If  you  finish  a  last 
bafora  titna.  is  catlad.  you.  should  usa  tha  tima 
ramaining  to  raconaldar  quaationa  you  ara  uncartam 
about  in  that  last.  You  may  NOT  look  back  to  a  taat  on 
which  tIma  has  alraa<Jy  baan  callad.  and  you  may 
NOT  go  ahaad  to  anothar  tast.  To  do  to  wilt  disqualify 
you  from  tha  axaminstlon. 

Your  scort  on  aach  tast  will  be  basad  only  on  tha 
iiumbar  of.quastions  you  answar  corractly  You  will 
NOT  ba  panalizad  for  goasslng.  HENCE  IT  1$  TO 
YOUR  ADVANTAGE  TO  ANSWER  EVERY  QUES- 
TION. ,^ 

If  you  changa  your  mind  about  an  antwer.  arasa  your 
first  mark  thoroughly  bafora"  marking  your  naw 
answar.  For  aach  quastion.  maka  cartaio  that  you 
mark  in  tha  row.of  ovals  with  tha  sama  numbar  as  lha 
quastion. 

Do  not  fold  or  taar  tha  pag«s  of  your  tast  booklat. 
Kaap  tha  booklat  in  aa  good  •  condition  as  pussibla. 


DO  NOT  OPEN  THIS  ■OOKLET  UNTIL  TOLD  TO  DO  SO. 
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TEtTI 
ENGLISH  USAGE 

^  Minutes^7S-Quttfkms 


 In  itw  pimoM  thrt  foltow.  o^rtaln 

«M>rdt  and  pOrwM  m  und^riitfC  and  numbvfPd.  In  - 
Vm  right*twnd  cohjmn  yciu  wiH  find  •n«rn«tivM  tor 
MCh  und»r1«ntd  pwt  You  cm  to  chooM  th»  on*  that 
bMl  awpwaaaa  Vtm  idaa.  m«k«a  tha  atalamant  appro- 
priata  tor  alandaid  wrHtari  Enfbah.  or  it  worded  njoit 
ooniialintf»  wHh  ttw  atyia  and  ton*  of  9)0  paaaaga  «• 
a  whol*.  CDooaa  ttw  altfrnativa  you  conaidar  bMt  and 


blachan  tt>a  corraaponding  tpaca  on  your  anawar 
•haat  If  you  thinK  tha  onginal  vartion  t»  tmt.  chooM 
"NO  CHANCe"  Raad  aach  paaaaga  through  onca 
tMfora  you  bagin  to  anawar  tha  quaattona  which 
accompany  it  You  cannot  datarmtna  moat  answers 
wtthout  raading  aavarat  aaniancM  bayond  th«  phraaa 
in  quaation,  Ba  aura  that  you  hava  raad  far  anough 
ahaad  aach  timo  you  chooaa  an  altamativa. 


When  I  ^kctmni  «  few  moatht  tjo. 
a  umH  cactw  mnmHH  to  Mrvive  in 
tae  iluie  ci  ny  paiio,  1  f$t»4  •  ^oWein 
that  I  wi«  iMfrcyarad  to  lolvc.  Thii 
cactw  was  •  yrkkiy  fmt,  a  variMy  Um; 
thrive*  ia  the  hanh  dimaik  cotditwta 

(rf  49mm,  lim*e  my  patio>.howevcr« 
H  hti  hw»  mmvU  ud  jrow*  weakly. 
|tt  M«»  or  kraadM,  wm 
-  weak.  thiN.  aarf  yiOow.  Moreover, 
laciaM  m  ihe-cndwwe  wai      tact  that 


I  hy  •  deer  >rl>< 
'  a  line  of  ^  fiber  Maliag  ittedfM. 
tni  the, whale  plaal  kanerf  forward. 
ObvioiMly,  l^nMKh  ihadc  aad  water  had 
weakenerft^^itf  wwiU  hreat  rti  damaieJ 

To  ttve  the  pncfcly  pear.  I 
decMM  that  moving  it  wa»  CBMflUal:  but 
knowini  nothinf  about  (rantplantinf  cacti, 
i  calkd  a  ndghbor  to  Mp.  Hc^ 


I.  A.  NO  CHANGE 

■.  When  1  dttcoverad  a  miuII  caous  atrutfl'nf  a  few 
months  «|o. 

C.  A  few  tnonths  «|0«  when  1  diMovered  a  small  cac- 
tus struttlmf 

O.  When  a  tew  months  afo«  I  discovered  a  small  cac- 
tus stmcUini     '  . 


2.  F.  NO  CHANGE  " 

G,  dimallc  conditions  and  temperatures 

H.  dimalical  conditJoos , 

J.  dtnaie-inrfucwl  oondmons 

X  A.  NO  CHANGE 

B.  was  stuated  and  sickl^r; 

C.  IS  stunted  and  grew  sick: « 
O.  grows  stunted  and  weakly: 


4.  F.  NO  CHANGE 

G.  the  evidence,  wduding  the  fact  that 

H.  the  evidence  revealed  the  fad  that 
J.  OMIT 

5.  A.  NO  CHANGE 

B.  it's  edges: 

C,  iliTedr- 
O.  their  edge; 


i.  F.  NO  CHANGE 

G.  might  have  hrokc 

H.  broken 

J.  must  have  broke  " 


GO  ON  TO  THE  NEXT  PAGE. 


Mr 


677 


673* 


1 


broke  Ihc  pnck>y  pear  inio  two  ptccci. 
uprooted  .1,  tiiJd  each  m  shallow  toil 

bcyorul  ibc       ar>d  covered  the  r<>ot«. 

  J 

adding  tcr>  litllc  ^»atcr. 

Ihc  recovery  process  fascinated  me 

Ihc  p4d«  drained  dry  to  nounsh  expjndm|t 

roots  When  the  roots  functioned,  the 

pad*  r;filled.^Finj1ly.  »cc>ng  them  erect 

4nd  *rcen.  I  knew  both  IraiMplants  had  »uf\i\ed 


7.  A,  NO  CHANGE 

B.  iatd  the  prickly  pear  in*  shallow  ^oil  beyond  the 
wall,  broke  it  into  two  pl«*<.  uprooted  it.  and  cov- 
ered the  fooii. 

C  uprooted  Ihepnckly  pear,  broke  it  into  two  piccet. 
laid  eachm  shallow  »oiI  beyond  the  wall  and  coV« 
ered  the  roots. 

D.  bwke  it  mto  two  pieces,  uprooted  the  pnckly  pear, 
coveted  the  roots,  and  laid*  each  in  shallow  soil 
bi-yond  the  wait. 

t,       NO  CHANGE  , 

C  ^l>o  NOr  bciim  new  paragraph)  As  succeedm( 

'  weeVv  foUowcd^e .another  V 
H.  (begin  new  paragraph)  In  the  succcedtnf!  weckS; 

that  ro(!o>%rdt 
J.  (Bc|tin  new  parajcrgph)  In  >ucccedm(  week». 


9,  A.  NO  CHANGE 

B.  Finall/  seems  them  sundm(<  erect, 

C.  f  anally,  with  them  sundini:.  erect 

D.  finally,  standinf  ^rect 


PMMf*  tl 

♦  Am<nca  the  world's  nchef  afficultural 

O/uniiy.  was  once  tarfely  covered  with 

forests.  Necdmf  both  limber  but  also 
II 

^farmland.  »elilers  felled  trees  and  removed 

stumps,  many  of  which  were  ten  feet  or 

more  in  diameter.  They  had  to  remove 

these  stamps  m  order  to  clear  the  bnd 

lor  buildirtf  roads  or  railroads. 

iV»r  establtshinjc  farming  or  homes 
II 

Imagine  standing  before  a  stump 
U  is  btg  enough  lo  hold  a  kinfsi/e  bed. 


1«L  K  NOCflANGt 

G.  America,  the  world's  nchest 

H.  AnKncaMhe  world's  richest , 

J.  America,  ihe  world's  most  richest 

II.  A.  NO  CHANGE 

B.  as  well  as  > 

'     C.  and 

D.  along  wiih 


12.  K.  NO-CHANGE 

0.  Kiablishing  farms  or 

H.  the  establishment  of  farms  or  to  but  id 

J.  establishing  farms,  or 

13.  A.  NO  CHANGE 

B.  bong 

C.  that  has  a  capacity 

D.  OMIT 


00  ON  TO  THE  NEXT  PAQE. 
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4Mtnm  m.  Wtat  4o  yoa  do  An:? 
Yoa  tafM  bjr  ikovaliHt  t  to*  or  more  of 

14.  F. 
G. 
H. 
J. 

NO  CHANGE 
shovel 
shovel  and 
shoyel-T' 

4ut  away  frwii  the  vi«Me  rooti.  Then  you 

/ 

cut  tlwai  off  Mow  plow  level  and  doee  %6 

L 

the  tCMMip.  Sioce  the  larfe  lafrooi  ton 
,   ^  ^      ^iinu|ht  down  from  the  center,  ooe  must 

y            fet  dowa  under  the  Mump  to  cut  it^ 

0 

Showriinf.  chopftot'  ^nying 

fS^  A. 
B. 
C. 
D. 

NO  CHA.NGE 
we 

you  or  1  ^ 
you 

away  iJk  ytecet  that  m  the  proccM. 
w 

^  Finally,  when  the  uproot  i»  almost, 
Kvcrad,  a  food  team  of  horto 

!«.  F. 

t  C. 
H. 

^  J. 

NO  CHA.NGE 
pieces,  are 
pteces^that  is 
pieces  bcinc 

waa  ahle  to- break  the  stump  loose  and  . 

17.  A. 
B. 

C. 
J>. 

.NO  CHANGE 
ts 

were 
OMIT 

*    roll  It  out  of  iu  hole.  Now  the  slump' 

M 

11  F. 

G. 
H. 
J. 

NO  CHANGE 
it's  hole, 
ill'  hole, 
there. 

cao  he  humed.  The  hole  left  l»y  Che  stump 

If.  A. 
B. 

C. 
D.^ 

NO  CHANGE 

(Do  NOT  btpn  iKw  paracraph)  Tlie  hole  of  the 
stump 

(Beyn  iKw  parairaph)  The  stump's  hole 
(ieftn  IKW  paragraph)  The  hole,  from  the  stump. 

can  he  shovdad  fulL  Only  then  is  that 
» 

area,  a  Uitle  larger  than  a  kin$^it 

».  F. 

G. 
H. 
J. 

NO  CHANGE 
and  filied  in  fuU. 
full  to  the  brim, 
in  and  fiUed  full 

M.  ready  to'  htficmtif  pUhiad.  and 
harvcslad.  71  is  what  many  of  the  early  ^ 

21.  A. 
B. 

C. 
D. 

NO  CHANGE 
had 
bad- 
bed: 

settlers,  stump-ranchers,  not  sod  busters. 
m 

had  to  do  to  make  Amenca  a  productive 
a«rkuhural  country.  * 

22.  F. 
G. 
H. 
J. 

NO  CHANGE 

settlers^,,  tump-ranctias.  not  sodbusters 
settlers  (stumfy-ranchers  not  sodbusters) 
settlers  (stump-ranchers,  not  sodbusteis) 

4  00  ON  TO  THE  NEXT  FAQE, 
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The  Jiv«nife  V4(attoner  seeks  relaxation  by 

,  eicapint  from  daily  fou^ne.  however;  senwtive 
•  "  '  u 

tra>ekr>  vtani  more  than  a  chanite.  Hence,  they 

mu»t  beiufi  :heir  jAirneys  with;  sUnuna. 

3ler1ne>s,  and  sufficieni  time  <o  absorb 

the  information  Ihey'^ther 

Any  traveler  r.'^-Jeam  about  loail 

ira«nporution  and  factliliev''but  the 

iravekr  </ho  seeks  knowledge  mm  aho 

kam  natioiul  kw»  aod  such  local  customs 

Itke  whtch  proper  vde  <rf  the  road  to 

drive  on  or  the  proper  amount  to  tip  tfic 
""I!**' f l^j**^-*-**  it  IS  only  human  lo  obKrve 

other  peopk,  such  obKr\9)]0n  should  be 
tactfuL  Pcopk  yuan  I  above  alL  to 
satisfy  their  cunoift/  about  their 
own  speocs.  Therefore,  lo  bepn  a 
journey  with  preconceived  idcai  of  what 
IS  fo«d  or  bad^  beautiful  or  ugly* 
wor^hwhite  and  not  tiselest  d^meaM  not 


only  the  travekr.  bm  also  the  unfamiliar 
culture. 


The  abihty  to  absorb  impreuions  comet 
m 

with  expervencc  and  prevents  the  travekr 
from  being  neither  ovcr«w'td  by  or  bored 
witn  new  sccttcs  and  customs  Sensih>e 
travekrs  never  lire  of  ihetr  journeys. 


23,  A.  NO  CHANGE 

routine  howe>er. 

C.  roultne. 

D,  /oulme/but 

24.  F.  NO  CHASGfc 

G.  with  such  traits  as  the  follov^ini: 

H.  with  iU<h  traits  as 
J.  w|^ 


25.  A,  N'O  aiANGE 
like 

C.  as  the 

D,  as  to'which 

2«.  P.  NO  CHANGE 

G.  maid,  because 

H.  maid  alihoufh 
J.  maid*  Alihoufh 

27.  A.  NO. CHANGE 
People  want. 
C.  People  wantini 
People,  wanting 


M.  F.  NO  CHANGE 

G.  what  is  worthwhile  or  usciesa 
Ht  worthwhile  or  useless 
J.  worthwhile  and  uKful 

29.  A.  NOCHANGE 
traveler  and 

C.  traveler  but  tn  addition 

D.  travder,  and  also 

3lL  F.  NOCHANGE 

G,  impressions,  which  come 

H.  imiiressions  come 
J.  impresMons  coming 

'  il.  A,  NOCHANGE 

M,  either  overa»fld  bv  or 

C.  neither  overawed  by  and 

D.  either  overawed  by  and 


QO  ON  TO  THE  NEXT  PAQE. 
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They  are  «l«vtys  refre»h«d  and  fuifiilcd 
by  It  and  of  courK.  are  aJway»  ea|«f  to 
iravtl  afain.  for  they  seek  a  kinthip? 
with  all  p«ofiW. 


31  F.* NO  CHANGE 

G.  ihem; 

H.  Ihem  and. 
J<  II. 


The  recent  emphatit  on  the  equaltiy 
and  dignity  of  ail  peraoni  drawing  attention 

to  job  titles.  In  many  I'nduiiriet.  the 
names  of  jobs  have  been  changed,  although 
the  functions  performed  by  the  /obholders 
have  not^  How  long,  for  example,  has  it 
been  since  there  has  been  an  adveiliKment 
for  janitors?  Today  he  has  been  referrrd 
10  as  custodial  or  Mniiary,  engineers, 

Jhe'burcaucnlic  reasoning  behind 
these  changes  suggests  morejhan  mere 
window  dressing,  its  not  juii  that 
"longer  is  always  better."  Some  of  the 
changes  are  meant  lo,  upgrade  the  job  and 
give  the  pcnoi^  performing  for  it  an 

appropriate  senie  of  dignity.  To  the 
extent,  that  new  ittles  can  do  \his,  fine; 
to  ihT extent  that  they  cannot,  they  should 
be  rejected. 


33.  A.  NO  CHANGE 

B.  can  draw 

C.  have  drawn 

D.  has  drawn 

34.  F.  NO  CHANGE 

G.  changed,  and 

H.  changed;  therefore 
J.  'changed,  however 


35.  A.  NO  CHANGE 
,B.  they  have  been 
C.  he  IS 
Dt  they  are 


H.  F.  NO  CHANGE 

g.  dressing  it's 

^  dressing.  Us 

J.  dressing;  it's 


37.  A.  NO  CHANGc 

B.  for  them 

C.  within  them " 

D.  it 

3t.  F.  NO  C^ANGE 

G.  extent  that 

H.  extent  by  which 
4<  extent  where 


aO  ON  TO  THE  NEXT  PAGE. 
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A-connccicd  rtbtcd  shKt  mvolvrs 
iihanDnf  th«  job  litle^U)  remdyc  mxxh 
overtoflct.  Until  r«««rnly\for  ei»mpJe, 
many  job  tilki  conttin  •  rWertnof  to  the 
xKoilht  fcnoa  vTho  moilVequertlly 
perfofmwJ  that. job.  Since  ihe  \, 
for  dbcnmi^tton  tn  hinnf  lutve  finally^ 
'been  pauad.  A  a  ruimf  that  not  only; 
lefai  bui  also  verbal  barrKn  to  jobi 
be  eliminated. 


39.  A.  NO  CHANGE 

•*     B.  connected^ 

,  C.  coniH 

p.  OM/ 


41.  F.  NOICHANGE 

C.  contained 

H.  coniaininf 

J.  have 


41.  A.  NO  CHANGE 

B.  on 

C.  about 
O.  againM 


\ 


EtubKthad  under  the  terms  of 
Alfred  Nobers  will,  the  Nobel  Priie.  of 
all  hteraxy  awards  is  Ihc  most  preili|i«u». 

■     ■   ■"•     •  .\ 

HavTns  made  a  fortune  from  ex^oaivts.  ^ 
No^l  refcttad  lus  violent  consaquenoes  and 
« 

seekmt  to  promot*  conMructive  and 
— S —  s 

creative  not  dcttfuetive.  efforts. 

Auunnf  ks  wmner  fame  and  financul 
success,  the  kierary  award  ts  hifhiy 
coveted.  The  laureate,  or  winner,  receive* 


42.  r.  NO  CHANGE 

C.  awards,  is 

H.  awards  are 

J,  awards,  are 

4X  A.  NO  CHANGE 

B.  thn'r 
€.  rhat 
O.  oik's 

F.  NO^CHANGE 

C.  havmi  sought 
H.  in  saoiing 

J.  sought 

45.  A.  NO  CHANGE 

B.  crcaiive.and 

C,  creative.but 
O.  creative. 

U,  F.,  NO  CHANGE 

G.  It's 
H. 

J.  their  ] 
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^fised^.  a^certtficate.  and  approxitiutely 
SIOQJPOO:  and.  cu«io«unly.  abo  dcUvtnni 


acdainMd.  laurtaiet  are 


ofien  <nlidz«d  bccauae  they  Have  not 

alway«  been  popular  dioices.  For  example. 

Anvsnca'^  flm  Uureait.  Sinclair  lx>fnu 

who  <T— ted  an  outnue  with  hU  noveli 
"~  m 

cnlKsl  ot  middle-cUM  values. 
■Pearl  Kick'i  Kkcfjon.  whoie  Ounc«e 

peataAl  novefs  had  not  e»ubluhed  her  among 
cnita  as  •Jliefary,'  atoo  evoked  > 

N 

Mofin  o(  ^oteal.  Joha  Slnnbcck  was 

not  ooniiderad  a  rirM>raie  writer  by  llic 

hterali.  That  KU  choiac  was  peculiar 

IS  shown  by  the  fact  that  it  creatad 

 *-   

bttk  ptibbc  att«iHion«  suM<«i>>l  that 

iKwas  not  witfriy  read  in  1962,  Finalty. 

Amcricajii  vieiwed  the  novels  of  William 

Faulkner  as  eaotcric,  obscene,  and  unraadabk. 

SoHK  American  redptcnii  have  bacn 

pofttkr  and  draaMtic  cboMct,  The  choice 

of  OTiedl  was  applaudad.  like  Eliot'i. 

whoac  poetry  of  frafiQcntad  man  oipturad 

the  apini  q(  the  iwciitics.  in>  197i. 

^the  draiae  of  Chkafoan  Saul  Mlow 

created  not  onl/  a 'sti/« because  of  hii 

urfaaiufootlesi^heroeV-an^  a  •^rtt*;' 

M.  ■ 

.  all  ii«^N^bd  awards  w>:ii\  ;q  Aineri^ans.  ,^ 


47.  A.  N6  change 

».  S  100,000.  customacilyf'  he  also  ddivers 

C.  SIOO.O0O.  And<  customarily,  alto  delivers 

D.  SIOO.OOO.'Cu*lomaritx,  he  also  delivers 

«.  K.  NO  CHANGE    ^       _     ,  -   .      .  . 
C.  Hicftn  new  p*Agraph)  Ihouih  Declaimed  lau* 
reaus. 

Hi  (ie^'n  new  paragraph)  Though  acclaiming  Uu- 
reaiev     ~  ^  .    „  v 

J.  (Do  NOT  begin  new^ paragraph)  Tliough  ac« 
ciaimi.ig  laureates.        ^       ~  ~  ^ 

49.  A,  NO  CHANGE  ^  w 

W.  created  an  outrage  of  people 

C.  creating  an  outrage- 

D.  outraged  people 

5*.  F.  NO  CHANGE  ' 

G.  Pearl  Buck's  winning. 

H.  ITie  Peart  Buck  choice.  ^ 
J.  The  selection  of  Peirl  Buclf. 

51.  A.  NOCHANGE 

B.  projected 

C.  was  evocative  of 

D.  was  provocative  of 


52.. F.  NOCriANGE 

G.  10  have  created 

H.  by  creating  \ 

J.  due^  its  crn^iing 


5X  A.  5*0  CHANGE  .\ 

'B.  as  otwvne.  and  har^  to  read. 

C.  obscene,  as  well  as  being  unreadable. 

D.  obscene,  and  jbdfsd  inreadable. 


34.  F.  NO  CHANGE 

G.  as  was  Eltot'i  poetry, 

H.  as  was  that  of  Ehoi. 
j;  like  Eliot. 


5S.  A.  NO  Change 

M.  as.  welt  as 

C.  and  also 

D.  but  also 
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Jarnw  BaMwin.  a  maior  Amcncao  v.mcr  who 
can  be  called  1  iwcniKth'centuryiAitM. 
The  biblical  prophei  Amo»  lived  during  ^ 
an  age  and  iime  of  trcmcndoo^  cultural 
Adtapccment  and  economic  prospeniy 
that  ^ka»  accompanied  by  moral  and  rcli|iou> 
corruption.  Baldwin  fteU  lo  bclicyc 

thai  he  ha*  seen  a  >imilar  decbnf  in 

America.  Amos  *ajjeuremety  semiine.  and  a  ware 

^  of  Ale  shortconvots  of^ihe  kin|dom'thai  ^ 
hc-a(Uirt%cd.  5aM^in^i|w^jM». 
dcmonttraicd  keen  percepiwn  in  assessmi 
the  mtnificancc  of  sooal.  tnoral.  and 
political  trend i  m-Am«nca^\ln  fact,  in 
hit  uritingt  ever  the  years,  he  has 
accurately  defmed  America's  problems 

However,  hke  Amos.  Baldwin  has  protested 

.       „  -  ■■  -<J-  ^ 

the  anions  thai  he  felt  indicated  a  bck  of 
respect  and  adherence  for  the  bw*  of  Ood' 
the  luxunous  lifc-»t>le»  of  the  v-e^lihy 
that  were  supported  by  their  oppressive  economic 
exploiution  of  the  poor,  the  lack  of 
tesponMbility  of  the  pnvtfejied  for  the 
leti  pnvileied,  and  the  need  for  justice 
for  all  people.  Critics  severely  denounced 
bollh  Amos  and  imd\kin  for  then  strong 
stands  on  these  issues. 

The  predictions  of  both  nien  Mrcre 
consistently  gloomy;  so  far.  BakJvrtn's. 


54.  F.  NO  CHANGE  ,       .  ,^    '  * 

.  C.  A  nujor  Amencan  »nter,  James  UMwir.  • 
H.  James  Baldwin  is  a  major  Amencan  wnter.  who 
J.  James  Baldwin^  a  major  Amencan  vtriter. 


57.  A.  NO  CHANGE 
■.  in  a  time 

C.  in  time 

D.  OMIT 


St.  F.  NO  CHANGE 

G.  believes 

H.  in  his  opinion,  believes 
J*  feels  and  believes 

5*.  A.  NO  CHANGE  ^  ^ 

■.  (Do  NOT  begin  new  paragraph)  Amos  was 
extremely  sensitive  , 

C.  <  Begin  new  paragraph)  Amos  was  painfully  aware. 

D.  ( Begin  new  paragraph)  A  mos  wi\  extremely  sensi- 
live 

««.-F.  NO  CHANGE 

G.  Bal(^win<  also  has 

H.  'Baldwin  aUo.haS 
J.  Baldwin  has;  also' 


it.  A.  NO  CHANGE 

B.  Nevertheless.  Ike  AmoS. 

C.  Simibrly.  like  Amos 

D.  like  Amos. 

K  NO  CHANGS 

G.  for  and  adherence  to 

H.  as  well  as  adherence  to 

J.  and  a  kck  of  adherence  to 


«i.  A.  NO  CHANGE 

B.  poor.  The  bck  of 

C.  poor—the  bck  of 

D.  poor,  to  lack 


00  ON  TO  THE  NEXT  FAGE. 
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MCUMD^  Mm/  of  hU'cntwt  tavt  hkcM 
Imm  die  '^ptftfkm.  of  doom*';  «c<oriii«tly 

M 

Mwk  AacncMt,  youitf  aiirf  oU. 
<  flihiMie  lor  dHiiifB. 


M.  F.  NO  CHANGE 

G.  «noc 

H.  funh«rmofc 
J.  Wt 

15.  A.  NO  CHANGE 
t.  regard  him 
C.  look  up  to  him 
0.  have  ffMi  rcfifd  for  i 


./ 


VH 

Tl>e  rcmiot  ihal  fcicycfc*  ire  beco«in« 

a  po^br  moic  of  inMp*n»t«>A  irc  v 
o»vioMt>  they're  Ipod  for  Wetivironmew  ^ 

and  k>r  your  healih,  iiM  lo  luvc  fun  cydtni. 

yog  murt  choote  your  bifcc  carefully. 
"~  ""  <•  '  . 

If  K  »  imM  the  right  M<r.  you  wQi 

b«co<iie  ttrfd  (exhauilid)  and  imcomfofUUe. 

unprofKriy  fMlad  biqfdc  win  alio 

incTMC  liw  danger  of  your  lottag  control. 

Howcvtf.a  kke  that  l»  diher  loo 
7'" » 

heavy  or  cttnibcrMr.)c  wiU  reduce  your  pkaaure 
and  efrie>eiKy.,*o'  that  you  have  lyent  much 

TP 

energ/.lo  gain  bttle  grottud. 

In  addition  lo  ^wtettoni  of  M»e  and 

n  , 

wdght.  you  nuiM  coniider  that  of  geanng. 


««,  F.  NO  CHANGE 
G.  The  reasons  that 
H^  The  reaaon  why 
J,^  Why 

47.  A.  WO  CHANGE 
o^vkhm;  their 
C.  o^vioiK,  there 

0.  obviout;  iti  » 

a.  F.  NO  CHAN(4& 

G.  care  muit  he  UMd  m  chooung  your  bike. 

H.  the  hike  you  chaoM  muM  he  leiected  with  care, 

1.  the  hike  mwt  he  arefully  cboien  by  you. 

M.'A.  NO  CHANGE 
lired 

C.  lired  and  exhauKad 
0.  tired,  and  exhauMed. 


7«L  F.  NO  CHANGE 

G.  (iegin  new  garagraph)  Since 

H.  (Do  NOT  be»n  new  gara|raph)Since__. 
J,  (Do  NOT  hcpn  new  parapagh)  Funhcrmore, 

71.  A.  NO  CHANGE 
t.  you  agent 

C  ^ou  arc  tgcnding 
0.  youll  ifend 

72.  F.  NO  CHANGE 

G.  ((uationt  over 

H.  questioning  about 
J.  ({ueflioni  for 
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The  ijciors  thai  >hou)d  influence  your 

<kc»ion  wctudcK  ihe  local  terrain,  lh< 

n 

amount  of  cydmt  >ou  pUn  to  do.  and 
ihe  typev  of  wcatfier  youll  face.  Although 
>'ou  mifht  find  it  difHcutt  to  wergh 
all  thcK.  m  choosing  a  bicjrcfr,  most 
b'lic^hop  ov^ners  are  Iheimelvcs  enlhuM*»tic 
riders  and  are  nwre  than  M^illitif  to  |tve 
free  advice,  even  tf  >'oU  don  t  buy  a 
bike  on  his  accounts 


7isA.  NO  CHANGE 

B.  dedson.  includes 

C.  ded&ioo: 

D.  deoMon  tndude 


74l  K  no  change 
*  G.  all  thes;  factors. 
H.      these  factors 
J.  thr.ti 


75.  A.  NO  CHANGE 

B.  due  to  them. 

C.  from  them, 

D.  particularly  from  their  store. 


END  OF  TEST- 1 
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TEST  2 
MATHEMATICS  UtAQE 

^0  Minutes^40  Questions  ' 

DNHE CTIONt:  SoK«  MCh  problem.  €hooM  th«  cor- 
r«ct  anmr.  «nd  ttwn  btackM  th«  corrttponding 
•p«c«  on  your  amwtr  thMt. 
Do  not  linger  ovor  prob4«m«  th«t  t«k«  too  much  tim«. 
SoM  m  many  m  you  can:  thon  rvturn  to  th«  otTwrt  in 
ttM  timt  you  htvo  Itft 

Nott:  lUuttntivo  Hgurvt  w  not  nicMiinty  drawn  to 
seal*  «id  art'iMuinod  to  \\%  In  a  ptano  unloaa 
olharwiaa  sut«d< 


1.  A  rwspc  calk  for  li  cum  of  flow  to  be  utM  with  4-}  00  YOUR  FIQUHINQ  HERE, 
cvp*  oC  Bidir.  U  Ofdy-i  of  a  cup  of  flour  M  to  be  UMd, 

how  HMay  cup«  of  niilk  arc  iwedcd?  / 

/  . 

••3  .  . 

c.  H  . 

I.  H  ■  - 

2.  tlK  ftlatiomkp  bctwacn  th*  aiunbtr  of  timet  a  OKkrt  ** 
durpi  m  a  mwuic  {n)  and  the  tcffiperaturc  (0  u 

'  txpi  Mini  by  tlir  fonwaia  i  =    ♦  40.  tf  a  cncket  chirpt 
%  tuM*  Ml  a  nuaiMc.  what  U'the  temptraturc? 

r.  U» 

C. 

H.  34* 
J. 

K. 

J.  WlMck  of  Uk  foliowtag  lUlctacnU  u  NOT  true? 
.  Ac  3<a  -  t)  /5«  -  40 

C.  4(»*2)«K**-J) 
'"-i>. '5^.»  =  3<6-4r  " 

I,  3(-Ji»i  -  n)  »  m  -  2w 

4.  The  avcrafc  im|ht  of  3  Wxc«  u  II         If  one  box 
30  •Aother  weifhe  15  jranw.  what  m 

the  wcifbt.  in  aram*.  of  the  third  box? 
F,  f 
C.  12 

H.  IS  r 
i.  II 

K.  21 


QO  ON  TO  THE  NEXT  MQE. 
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5.  i.6t  -  }*SI  s  ?  '  00  YOUR  fiquiAnq  heue. 

A.  .11  ,  ,  ^ 

B.  -I 

C.  I 

D.  II 

C  None  of  (he  above 

4.  Helen  diKOv«H  thji  wKen,ihe  ouhipbe*  the  number 
stored  in  the  memory  of  her  cakultior  by  6  she  fet>  a 
%alue  ihat  is  twkt  at  Utfc  as  she  yets  when  sbcaddt  12 
to  the  number  >n  the  memory.  What  Ulhe  number  she 
has  stored  in  the  memory  of  the  cakulaior?  ^ 

F.  KOW 

G.  2.IVIS 

H.  30000 
i,  4  0000 
K.  6.0000 

7.  Mt,  Green  f*td  S7.00  for  a  can  of  paint  and  a  br uth.  If 
he  had  bought  6  cans  of  pami  and  2  bruihes,  Ms  bill 
would  have  been  S21 .00.  How  much  did  the  brush  cou^ 
A.  $  1,75 

ft.  S  JJO  « 

,  C^.i  420 


C  5I0JO 


"^  F,  0023t 

G.  02JI0 

H.  1M70 

i.  )4i«z 

K.  4  2010 


If  f  X  }  and  f  '  2.  then  rr 
A.  216  " 


C  ^24 
D.  It 


For  what  value  of  ii:  K  the  avera«e  of  3.  5.  and  k  equal 
to  67 

G.  -2 


H. 


T 


K.  10 
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II,  in  A  CAT  Wow.TIjlTP.  ICAM n»e»»utc»  «*,  and 
C3r»n4  Cff  »K  of  equ»I  knph.  Wh*l   the  measure  of 


C.  76' 

D.  104* 


— J.-^^^  ^ — - 

13.  Wtai  U  the  br|MC  prime  f*cior  of  /C* 
A.  "2 

C.  7 

D.  13 
C  42 

14.  Jack  buyi »  »hirt  fSr »  00. « lie  lor  S5  00.  and  a  pair  of 
ilacki.  If  the  4  percent  Mies  u««oo  the  total  putchaie 
sioottntt  to  $1 04.  how  n.ueh  did  hi*  jUcks  coii? 

V.  SI2.00 

G.  $13  00 

H.  $1400 
i.  $15.04 
X.  $M.OO 

15.  In  the  fifurt  Mow.  if  /,  [1    /,  \\  /*.  and  the  measure  of 
.  Z«  *  I05*.  then  the  measure  of     *  ?• 


DO  YOUR  FIQURINQ  HERE. 


A.  73* 

B.  105* 

C.  I35* 
!40» 

I.'  W 


i30  ON  TO  THE  NEXT  FACE. 
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U.  Mr.  Pcterton  eanu  •  k%K  uiitty  ylui  s  17%  co*n< 
.■liufoii  M  hU  M>««.  One  week  lie        S700  of 
■KrcKtsdiM  tMl  earned  «  I(Ha1  o(  S2)0.  How  much  is 
Mr>^feterMHii|  ^mc  M^ry  ^  week? 
r.  S  7»C»  ' 
G.  SIJI.W 

J.  OMJV 

IL  *l»57^  ---«^ 

17.  If /(x),»  3t 2,  l>wn^^V(«>-til  '  * 

A.  *  ^^^^ 

p.  -JOt-^) 

E.  M-2 

i  . 

18.  AttU  Bm  tw*wu  where  H  *  ^  x<  4  jtad 
« B  |o.  1. 2, 3. 4|.  What  U  the  iMerMction  (HDf  )of 
the  iwo  Mfb? 


00  YOUN  nOUMINQ  HEIie. 


|9«  Ijjhe  diapan  hclow.  O  ii  ihc  cenier  of  the  circle,  ana 
a  dtamelrr.  OD  hiMCH  ^«OC.  Co«ifare4  lo  Ihc 
jncasarc  of  £BAC  lh«  wcttwrc  of  CBODw. 


A.  o«e*ihirid  as  larfc. 

B.  halfa»iar|c. 
C  e^ual. 

D;  twice  as  larfc, 

C  three  tiflic«  as  large. 

It.  In  right  triangle  ACB,  if  tin    <  |  an^  the  length  of 
IT:  24.  how  longU;??? 


r  12 

G.  . I*  ' 

H.  II 
h  » 
K.  25 


QO  ON  TO  THE  NEXT  PAQE. 
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h«in  of  Ittt  BMtOftyck  tn^  m4  twveW  the  hit  230 

ktlpoMtcn  f*f  bo«r.  for'Uw  mtirt  tnf! 

A.  47,33  •  ' 

ft. 

C.  53  00 

D.  7liK> 

E.  M30 

a.  A  «tt*er«tioii  lyilein  hai  «  •%  \t%  bii<.  H 
4,  ♦  4.  ♦  4,  =  20^  then  24.  •  24,  ♦  24,*  ? 

r.  72, 

c. 

M.  »2. 
J.  120, 
IL  200, 

13,  h>  A  A»C^  the  knrh  of      «  5;r»  ♦  3;r»  ♦ 
kft^^  o(       «  7;i»  •  7j»i  -  I*,  and  the  knph  of 
7C  »  3jc»  -  xK  then  (of  •ome  real  numher.  x,  lh« 
pcrilBcier  of  A  ABC'1 

A.  J(l5jr»^  lU-J) 
j«<I5j»»^»Jr^l3) 

C.  3l5x»^  llJrM3) 
^    O.  3»<5ji»  ♦  3jr  -  I) 
^    f.  3Ji<5jr»  ♦ 

14,  A  iHunWf.  X. «  d«f e»«d  by  7;  wh«  the  mult  is  »ub- 
irtrt3froai^l2.  the  renuinder  U  X  Which  eqwuon 
COwU  be  uiW  to  find  ;r  7 

r.  7-<l2  J»>»3 
C.  l2-<Jt-7)*3  . 
H.  <I2-J»)0»3 
J.   12  *47  -  jc)  «  3 
^K.  (Jr<7)-I2s3 


DO  YOUn  FIQUMINO  HERE. 


take.home  pay  U  S2W  50.  v*h«t  iirittM*|«'y 
nearnt  dollar)?, 
r.  SIM 

C.  S2I5 
H.  S35I 
J.  S3t2 

K.  None  of  the  above  ^ 
27.  c4)mU  which  of  ihe  follw^mi?* 

A.  -7.    •  < 

C  ^-3 

D.  V7 
t  3V* 


QO  ON  TO  THE  NEXT  PAQE. 
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21.  WhtriCtheareaof  ^ABd 
A 


00  YOUM  FIQURtNG  HCIIE. 


2t.  What  1$  the  jenfth  in  ceniifflcicfs  of  ihe_h;^o(c%usc  of  - 

 a  ritht  inknglc  itihe  IfnithVof  uVicjts  are  9  cencr- 

metcf  1  snd  4  ecniimctcf  $? 
A,  ViJ 

5 

C.  V57 

D,  13  i ' 
C.  97 

Ji,  to  (he  fifurc  kelow.  circle  O  h«»  diameter  jS  mnd 
laiweni  ^  ai  £).  If  (he  meaiurc  of  iBAJ>  s  2S*,  what 
»  the  mcaMire  of  LBCD  7 


r,  25* 

C.  40* 

H.  63* 
J.  77i» 
K.  to* 

Jl,  rhe  act  of  all  number*,  x/tuch  that  jr^"  1<  J  »  equal 
to  the  set  of  all  num^berv,  ^»  such  thai: 

A.  -^/^<*<^/r 

I.  .2<*<2 

C.  *<-2of*>'2 

D.  x<2 

E.  *>'2 


IZ 
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32.  if  jr- ir*t  sOand  I3x  -  5r  «  0.  ihen  V/*-!*-? 
F. 

H.  ^12 
i.  il3 
«.  t25 

A«  1-10.1} 

C.  12^1 

D.  I5.-2I 

E.  no.ij 

M.  In  a  MrtkUIjr  MikctlMtIi  p me  Sue  Kortd  i  of  Ote 
Mill  I  »omi».  »n4  Tammy  Kored  anoiher  *  of  ihe 
team'i  point*.  If  Sue  woftd  4  more  pomw  in»n 
'Tammy  did.  how  many  polmi  did  ihe  leam  Kore? 

r.  14 

G.  24 

H.  30 
i.  34 
K,  41 

3S.  Ik  ihc  circle  Wow. with  diameter  AD.  tht  Unph  of 
JFC  a  2^  and  the  meaiure  of  arc  ^=  Wh«  is 
the  raJius  of  the  circle? 

A 


DO  YOUR  FIQURINQ  HERE. 


A.  2 

C.  4  - 

D.  4s/r 

E.  t 

M.  The  product  cf  2  iniegctt  li  nefad^'C'  T^*"  »* 
^Kive.  How  small  could  the  largcf  of  the  two  inie|er» 

F.  .2 
C.  -I 

H.  0  -  .  • 

i.  I 
X.  2  . 

37.  If  Jane>ii4ye4r4>oun|erthan  Mary,  and  Mary  is  14 
limes  as  pW  as  Jane,  what  is  the  ptodwci  of  their  ages? 
A.  12 
».  45 

C,  54  • 

D.  H 
C.  165 


QOt>N  TO  THE  NEXT  PAGE. 
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3$.  Wh«n  teth  wu  I  month  oM.  the  wei|hMl  4  of  her 
btrth  -  wd||ht<  At  2  mooiht,  »h«  weiglMd  of  hef  I* 
month  wct|ht.  and  at  3  months  she  wciyhad  -t  of  her  2« 
month  wcitbi.  If  her  5*monih  weight  ii  IIS  pounds, 
how  many  poundi  did  she  weigh  at  birth? 

G.  3.00 

H.  4.2S 

I.  t40 
K.  too 

19.  If  lof  1*2  £  JOl  and  log,«3  s  .477.  then  tog,»72  >  ? 

A.  I.SM 
1.  IIST 

C.  XOJJ  ' 

D.  2.334 
C  2«3S 

40.  An  ecologiM  owns  flie  30'  x  40"  rtcumgutar  lol  ihown 
below.  She  wantt  lo  plant  a  rccuntular  garden  thai- 
wtB  lake  up  half  the  area  of  ihc  lot.  Ifthe  length  of  the 

,  fankn  11  13  feet  longrf  than  the  wMtih.x, what  equa- 
tion could  be  uMd  (o  find  the  width  of  the  garden? 


00  YOUR  FIQURiflO  HERE. 


garden.. 

40' 

yy 


f.  xi*  l3xr«J0 

G.  X** 

H.  2jr  *  13  s  40 
J.  2<*  ♦  13)  »  40 
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TEST  3  • 
SOCIAL  STUDIES  READING 

35  Mmufes^52  Questions 


OtMCTIONS:  E«ch  p«stao«  in  thit  tMt  is  f  oiIov««d  by 
••vtrii  Qo«»«oo».  A««r  iwadiofl  •  pMMO««  choot*  \h% 
tmX  »ns*«r  to  —ch  qimtJon  «nd  bUcfctn  th#  corr«- 
spending  spact  on  your  antwtr  $h*#t.  Yoo  may  r«f«r 
to  th«  pMM9»  M^«>  at  rMCMMry. 


Coniirm  recenUy  pasaed  kjrtUiion  requirmf  ihc 
lovernmcnl  lo  fund  Ihe  election  eamj»»iin»  of  Drtiijkniul 
candHj*ics  7he  followinf  ipcakcrs  dtKus»  ihn  kgnUtioa 

Spftkrr  I 

rnvatc  campAign  contribution!  trc  the  mtjor  lourcc 
of  eofrupi»on  in  Amcrictn  poKiic*.  UrfC  campaign  eon- 
inbttiion*  art  traded  for  favoraWe  k»»laiion  and  oiljer 
favor».  ItaiKcr  than  debate  Ihc  iMues.  eandtdaies  offer 
nseimelvfM  for  sale  lo  the  hifhert  bidder.  Furthermore,  the 
*>>tem  of  pri>aic  coninbunon*  ijmpotes  no  ceiling  on 
sMndmi  Candidaie*  can  win  sim^y  by  oui»per>dinf  iheir 
rivah  I  he  co»ti  of  eampanning  have  eonK<«ieniIy  soared 
^  pgWtc  campfliyn  financing  will  eliminate  ine  eorrupiion 
and  rrdu«  the  wwieful  expenie  of  ihe  preKnl  »y»iem 

Sptaker  2 

free,  pnvaie!>  eoni rolled  areas  of  life  have  inereai- 
*  iniK  come  under  governnKni  eor.troI  Now  Klf^lyfcd 
relofiners.  ob\iviou*  lo  this  ereepinf  socialism.  wan(  lo 
expand  |Ovtrnmeni  further.by  having  ii  ftnance  election 
camMifnt.  frlvaie  campaign  financing  has  worked  welL 
Naiuraily.  iwerest  group*'- from  business  lo  Ubor. 
induatry  to  environinentalisis-eomnbute  pencrouily  lo 
candidates  supporting  iheir  views.  But  ihi»  insures  that 
candidates  repreKnling  widely  diffenng  vkw points  are  well 
financed  and  can  conduct  vigorous  campaigns.  Public 
finandng.  fc>o*<ver.  ducdurages  interest  roup  participa- 
tion ind  undermines  the  pluralistic,  competitive  nature  of 
<Viwrtcan,po4itics, 

Since  pubhc  campaign  financing  would  substantially 
limit  the  need  for  private  eontnbuiions,  opponents  argue 
.  that  It  limits  freadom  of  speech.  jCampiifn  contributions, 
they  My,  art  indications  of  support,  and  thus  acts  of  speech 
Perhaps  theoretically  vilid.  this  argument  is  wrong  in 
practice.  Too  often  contributions  pay  for  special  favors*  if 
eoninhutwni  are  »ets  of  speech,  why  are  so  many  given 
secretly?  PublK  campaign  fitiancing  would  remove^  the 
unfair  advantaac  held  by  the  nch.  Rather  tlan  suppress  free 
speech,  it  will  help  give  everyone  an  equaPvoice 

•  Spf^krr  ^  ^  V  ,  , 

Pubbe  campaign  financing  has  one  overwhelming 
drawback.  Whenever  govrrnment  handouts  are  offered > 
Crowds  always  gather  to  get  a  share  of  them.  If  the  govern- 
meni  p^ys  candidates  «*>  «mpaign  for  olftce.  the  number  of 


candidatcs-'Cspecially  onc-issue  and  frivolous  candi- 
da(es*~wilt  increase  dramatically  It  >s  unfair  to  tax^iaycrs 
to  institute  another  government  giveawiy 


1.  By  "one-issue  and  frivolous  candidates."  i>pcak<r  4 
means  candidates  who, 

A.  have  no  chance  of  winning  but  run  only  to  attract 

publicity  for  themselves  and  their  causes. 
•.  run  for  unimportant,  honorific  offices. 
C.  lack  a  broad  cducatiorui  bae)(ground 

0.  are  inelttiMc  Jo  receive  government  payments 
under  public  campaign  financing. 

2.  When  Speaker  I  declares  that  "the  system  of  private 
contributions  imposes  no  ceiling  on  spending,  she 
means  that; 

F.  most  candidates  finance  their  campaigns  with  Urge 
contributions  from  a  few  pruate  sources. 

C.  modem  campaigns  arc  more  costly  than  cam- 
paigns in  the  past. 

H.  candidates  can  spend  as  much  as  they  wish  on  their 
campaigns. 

1.  almost  all  candidates  ne«d  vast  personal  funds  m 
order  lo  run  for  office. 

3.  When  Speaker  I  claims  th«t  'candidates  offer  them- 
Klvcs  for  sale  to  the  highest  bidder."  she  means  that 
pobtical  tiindtdatcs' 

A.  Mmply  pay  voters  to  vote  for  them, 

■.  spend  enormous  amounts  of  money  on  their  elec- 
tion campaigns. 

C.  arc  more  interested  in  making  money  than  m 
winning  elections  .  ^ 

D>  tailor  their  positions  on  issues  to  attract  <arge 
private  campaign  contributions. 

4.  Which  of  the  following  speakers  would  be  mo>t  likely 
to  favor  legislation  requiring  candidates  to  publicly  dis- 
close the'sourccs  of  all  campaign  comnbutions-* 

F.  I  -  - 

G.  2 

H.  I  and  J 
J.  2  and  4 
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5.  Whm  11  the  Mafair  advtnuiic*  o(  tbc  nch  to  which 

A.  They  wouU  receive  ifecie)  ftvon:undcr  puUic 

canfftifii  fiMiKiiu. 
t.  They  can  Wtter  alTofd  to  nm  for  puUic  ofTtce. 

C.  fvwic  rif  if  fiMnoni  would  luM  private 
contnhMliuw  and  thut  bcncfK  the  ridr  luyropor- 
tjoMtdy.  / 

D.  They  cm  make  rouch  iufin  cuofkm  cootnku* 
tioiM  ai^  thM  have  more  pohticaJ  ii^^ueoce. 

L  When  Speaker  2  iUtc»  that  advocata  of  puhlic 
campaitn  finaacuif  arc  ~ohliviou*<lo  thii  cr«cpio| 
todahoiu*  he  nean*  thai  they: 

F.  arc  unduly  iaAueiMed  hy  ipecial  uitcrett  $roup». 

G.  sre  baii^  uted  hy  locialiet*  to  fUrthcr  lodabil 
aim*.  V 

H.  fail  to  Me  the  daafcr  of  too  much  (ovemmeiu 
ooairol 

^  J.  Mriowly  undcmtimatc  the  hi|h  financtal  coeti  of 


.  Whkh  t^ker  u  moet  concerned  ahout  the  cxpcnie  of 
puWac  caaspaiin  financing  lo  the  federal  |overamcnt? 

A.  r  , 

2 

C.  3 
O.  4 


«.  If  S^er  ^Tf  arrunent  a|aiMt  pubbc .  ciunp«tn 
financuif  it  valid,  which  rule  «ii|ht  lawnakert  wmh 
lute  to  mm  hit  ohjectiooi?  . 

F.  Candidatec  will  not  reseive  awhwlict  ualm  they 
coUed  a  larfr  numher  of  HpMtiiree  from  au^ 
porten  in  all  TiAy  lutea. 

G.  Caadidaiea  caa  wiaplcmcnt  their  p«Mk  auhaidiei 
with  Mtvate  cantr»h«tiaM  d  they  wiah, 

H.  Caodaialae  wiU  have  to  forfeit  a  dallar  w  puhhc 
mhwdiei  for  ev^'doUar  of  pri^^te  ooatnbutioae 

i.  GiLiZMmuai make puhtic the 

vtduak  and  orguUationa  coatnhatiaii  to  their 


9.  ly  voiont  oppowtkm  to  poverameat  liandouU"  and 
...^|ivea«ay«,lSpcakcrJ  iaipliet.lhat)ieji.oppoaad  loL. 
A.  allawiac  foverameat  employ^ei  to  contnhuti 

money  u  pohbcal  caadidatas. 
K,  hifh  kveb  of  toveraaMM  «fp«ndint  in  leneral. 

C.  the  ^laftcfttl  expcftie  of  the  pmcat  syetem*  to 
which  Spoaker  I  refcn. 

D.  the  practice  of  hoUiag  frequent  doctioaa.  » 


00  ON  TO  THE  NEXT  PAQE. 


696 


692 


Amrica's  fwiw  h*v«  jridiuorully  6ccn  'he  tpnnj* 
board  lhal  UunchM  >ami|r*ni  groups  iruo  ihe  m,«n- 
^  itream  of  ouj'cuUureyvrovwled  into  itiiKrabte  jiumt.  new 
"^irivflij*  look  Tnenul{job»  and  struuictl  eduC*K  iheir 
children.  The  j<cOwI  or  ihitd  feneriiion  achieved  up\»^rd 
mobihJy^-Jhrouah  ccpnomic  adv«»etmct>t  and  poJiiical 
ortanirjjiort  MOM  fcere  able  lo  mer>e  evenJufcily  mio  the 
fcnerai  P'^oulaJjcn  and  leave  Jh«  jlumt.  The  Inih. 
German*,  Jewi.  Ualiank  and  Ea$i  European*  <»ch  in  Juin 
followed  ihis  process  unnl  legitUtion  rninclcd  foreign 
immitraiion  >n  ilic  I92<H. 

But  (he  How  of  rtew  people  lo  rcpopulaic  urban  »iums 
conlmued  uiubated-  Haraiied  and  driheariened  by  di$en- 
ffiri4hi&emeni  and  «he  imposition  of  Jim  Crow  laws  in  the 
South  at  the  turn  of  the  century,  blacks  began  lo  move  to 
northern  cities  in  large  numbers.  Emplo>ment  opponumtirt 
gefxrated  there  by  World  Wars  i  and  ||  aiimcted  them,  as 
did  the  ch«,»c«  for  their  children  to  get  a  better  education. 

As  had  been  the  cai^  uith>reignjmrnjjxajui.>U<*>..« 

 fSoveSTinto  iHe' vfum's*  loortHe  unskilled,  low-paying  jobs. 

and  placed  )heu  uiih  in  education.  But  thingi  had  chanted 
IndustruliMtion  had  reduced  the  need  for  unskilled  lab^r 
PuWjC  polic>  decision*  favoring  govemmenf»upponed 
honK  k>an*  aiW  »ub»idii»d  highway  svsieim  encouraged 
the  alfluent  lo%ove  to  the  suburbs.  With  the  urban^taK 
b»c  eroding,  schools  and  urban  conditions  in  general 
deteriorated,  l-urthermore,  racial  ditcnmination  against 
blacks  wti  panicularly  harmful  ni  housiAg  Blacks  >«ho 
»aved  their  rnoney  and  were  able  to  afford  better  homes  , 
found  rone  available  to  ihem  They  were  reilnaed  to  Vie 
ghetto^ 

fortunately,  the  ballot  bon  in  the  North  w;a  color- 
blind White  flight  combined  uith  black  migration  made 
the  black  urbinvote  a  Significant  factonn  national  as  well 
as  local eleciio«is  OrgiDifition  intoa  blotvote  hadbcena 
standard  technique  uied  by  foreign  immigrant  groups,  and  . 
blacks  adopted  the  same  tactic 

By  the  I960*,  several  major  American  ones  had  elected 
black  mayors.  Reapponionmeni  of  congressional  districts 
resulted  w  the  eicction  of  blacks  lo  «he  House  of  Repre- 
sentatives. Black  legislitor*  served  on  imporunt  com* 
nimee*  and  were  able  to  wQuenw  t*e  faderal  bureaucracy  ? 
i(f  respono'to  their  needs.  The  city  thus  began  >o  «rve  Afro- 
Americans  in  the  same  fashion  as  ii  had  earlier  served 
foreign  immigrants. 


I*.  Which  factor  Ws«  accoanis  for  the  success  of  bUck 
political  effons  in  recent  yean? 
F.  Republicans  have  suecesifulty  recruited  many 

black  cartdidites  ^ 
'  C.  Democrats  have  generally  held  the  governorships 

in  a  majority  of  the  states.  *  ^ 

H.  TlW  Supreme  Cnun  has  re({mrcd  thai  a  ccrunU-* 
»     percentage  of  elecfed"  officials  »ust  be  black. 
J.    The  number  of  black  voters  in  urban  areas  has 

increased  enough  for  blacks  to  control  local 

politics  to  some  degree. 


11.  Which  <rf  the  ^oltowiig  government  poliats  encour- 
aged people  to  move  fron  aties  to  suburbs? 

A.  The  fede/al  highway  programs,  vfrhich  enabled 
people  to  ^vc  at  some  distance  from  the  ctty-and 
still  commute,  to  worfc 

B.  Ugislation  thill  made  intet?si  :»aymenis  on  home 
morigagei  deducuble  from  incme  ux 

C.  Government  guarantees  for  mongages.  which 
brougb^jiome  ownership  wt|^n  the  reach  of  the 
lower  middle  clasa 

D.  All  H  |he  above  ^  > 

12. *  Which  vtuation  best  desaibes  one  effect  of  houung 

discriminatuin  ih  urban  areas? 

F    Because  only  infenor.  but  lowren*.  housing  was 
available  to  blacks.* they  were  able  to  devote  more  . 
of  their  income  to  other  needs. 

C  As  more  blackicomoeied  for  the  hmiied  housing 
units ^VUilaMe  to  trfem.  rents  increased  and  the 
peti^Mlage  of  income  necevwryjo  provide  shelt^, 
"^**  *^os<  markedfy/ 

H.  Assents  roK  for  inner-Cily  apartments,  housing 
became  a  proritable  investment,  and  private 
industry  rc^nded  by  undenaking  major  con- 
struct\pn  proji^-*  in  black  urban  neighborhoods 

J.  As  neighborhoods  beamr  identiHed  with  one  ra?e 
or  the  othert  pressures  were  relax' d  and  the  rate  of 
Violent  crime  decreased 

13.  At  the  end  of  Reconsi ruction  in  1177,  one  of  the  major 
means  of  disenfranchising  southern  blacks  wti  thr 

A.  grandfather  clauw.  which  permitted  flnly  older 
blacks  lo  vote. 
-    B.  bteraCY  test,  which  Vas  subjective  and  admin, 
tslered  by  white  officials, 

C.  requirement  that  age  be  documented,  which,  few 
)>lacks  could  do 

D.  residence  requirement,  which  few  blacks  could 
meet. 

14.  How  does  the  flight  to  the  suburbs  affect  the  urban  tax 
*ase^  ^  ■  ► 

J       ¥.  It  eliminate*  from  the  urban, population  those 
«         people  best  able  to  finance  necessary  oty  services 
C.  fhe  iiiC  of  suburban  shopping  centers  reduces  • 

congestion  downtovMi  « 
H.  those  who  remain  in^^city  need  very  few  city 

services.  , 
J:    fhose  who  move  to  the  suburbs  are  mostly  middle- 
aged,  affluent  people  whose  children.are  grown, 
and  who  thus  need  few  city  services. 

15.  Ai-the  turn  of  the  cenVury.  which  difficultics  did  blacks 
have  in  common  with  easierh  European  immigrants^ 

1  Thev  had  to  nuster  a  new  language, 
II.  Their  agrarian  background  did  net  give  them 

urban  job  skills. 
IILtThey  lacked  format  education 
IV.  They  faced  reiipoul  prejudice  ^ 

A.  I  and  III  only 

B.  II  and  III  only 

C.  Ill  and  IV  only 

D.  II.  IJI.and  IV  only 
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14.  How  dirf  MfWa  Cr^Mf  Motkiiritc  fomtn  immiiraiil 


1.  TW  hck  of  cllinic  mf^kothooit  fonti 
iniMgratits  to  arfjwt  to  AmmcM  cmom$, 
»      il.  Urtan  fokttal  ^omn  mmM  tlMl  aU  rem- 
Mats  of  MiKmal  oripa  be  ctMaOcf^  •  pff- 
MM  «mM  particMU  in  Uw  cbctoral  proMt^ 
Hi.  EaflMli  «Mtlw  huiaiiM'«'»*irucuonMithe 
pvMic  ■dHkolt,  AM  Ihc  cunictttttai  eniflM- 
timi  Ammn»  vaiifs  Md  iaMulioM^ 
loiiy 

G.  llloMlv  ' 

H.  lMdtlo«ly 
:J.  mi.  Mid  111 

17.  Wky4M«MMayMMMMUh«MiiwyMUMin«utollK 
U«l«tf  States        M  cilict?. 

I.  Mo«i  w«re  4««ittute  Md  covU  kK  ifforrf  to 
iaivc  llw  port  of  Mrtfy. 
'  II.'  Livii^  COM  were  lower  Ui  Uw  oiy  thM  ui  IIk 

oowrtfynie. 
III.  Mo«««reakiJMcr«flMMii,Mdtlicd 
for  iwir  aervicea  waa  gnoiar  k  il 

.\.  I  ooly 

r  lloiUy 

C.  IllooJy 

O.  II  aad  III  only  ^ 


It.  Atomi  1900.  ^jiadca-tlMMMiil  adacMioMl  offor- 
luniciaa  were  rT«tcr  »  iwrtMnr  dtaaa  baaiMr. 

F.  iMM  MMk  (HktN  were  located  tkcre. 

G.  pnMk  od«c«lioo  in  lite  Nofth  wia  fCMratty  far 
Miferior  to  lltet  in  lite  Sottlk. 


H.  Macka  advocated  iateMlwa  deapite  teforate  but 
tnriy  o^  Kbaola  m  Ute  Sowb. 
dawtecfatioo  af  laibini  tebaah  had  radooad  the 
qaahiy  of  adaeatioi  ia'tbal  rapaa  ^ 


If,  WbyhaaitboeaeaMarfiarUMbtobealaciod^ate 
KbuK  of  Kapriteatafivaa  thu  to  tha  SaMttfT 

A.  Urbao  ma  tend  to  raaloGt  tlw  aaM  poofk  to 
offiae  far  aaorc  fragaaatty  tbaa  nra]  araaa.  aad 
iboa  Of  yortuaky  for  tmw  yoaya  ia  inttkaad. 

B.  AteaatoriadactedtoaahorterlarairhaaaraMa- 
•aMativo,  mt  Iboa  noft  bwMaaMi  «aa  md 
tuBf  to  aervc  la  ibe  SoMta. 

C.  Saiteln  aia  liaated  frot  a  lanar  pagraphif ^aiaa 
ihaa  rearcacatelivea.  aad'tboi  ibc  Mack  vote. 
akhoiMfc  smaHar  tbaa  tha  white  vaia.  fravteatly 
iN>lda  Ute  bahuNC  of  i^war. 

O.  SaMtoraanealaciad  oaaatatawidabaaM,ladthia 
leadi  t»  ditete  the  abihty  of  an  urban  Hoc  vote  to 
'     •    BMorilyc  ' 
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5ariW  mowmtnis  occur  when  many  pwpk.  »etm| 
toaetfirr.  kccomc  Afouacd  akoui  Mjpcct*  of  iheir  mciaI  life 
that  ihey  «romly  IW  imdio  be  chanfcd.  RcbiiprMhifW 
iMCome  Mumettied  th«  people  have  irQ}ibkadjun»nt:di*. 
tMrbint  f^lmp  of  !or>eline«  moh,lhcK  Mmn  develop 
$poiiUfMOUiIy  out  of  vndesprckl  condiiiom  of  friMirtiion. 
IndividMlii  »tiemp«  to  join  olhera  l*c  Ihenwclvei  m  order 
to  find  belter  whitiont  lo  ihar  probleim.  A»  ihey  com. 
miwicsle  with  when,  t&ir  seme  of  deprivition.  mjiwtice. 
and  tmpMience  with  the  way  problems  are  being  reiolved 
Wrcatct.  iS'^si  J 

Socul  moveroenu  are  deigned  lo  ch^ftpe  w  Jo  reiut 
chanfc  in  one  or  moreihan  one  social  msiauik^-ot  the 
system  of  rule»  that  fovif  n  how  people  act  and  handle  i heir 
probkmi,  fhew  rule*^  which  may  have^become  Uwi, 
rcfulate  relatiomhips  in  »uch  areas  as  the  lamdy,  (overn* 
mem.  educatjon.  economic  acimiy.  and  iniertroup  con- 
tact. Many  of  ih«e  relationshipa  havjs  acquired  obhgatory 
characten«ic»'and  are  not  ca»ily  chan^  Strong  local 
iKeMUf'  u  exeried^n  iodividuak  lo  contmue  acting  a«  ihey 
have  in  the  pa»t-  UloiVk  ainved  originally  at  changing  cer^ 
uin  retationahtpt  are  counteracted  and  are  often  redirected 
bief  to  other  goab.  The  nowth  of  »ociaI  moveinents » fre- 
quently related  lo  how  succeufuUy  miiial  goaH  of  ihofc 
movemnts  are ^hieved, 

A$  people  tncreaic  iheir  pamopaiion  in  soaal  move- 
meni».  ihe)r  ties  lo  previoue  social  refciionship*  are 
weaVered  Cowiant  inieractriTi  *ith  rthen  provide*  a 
seme  of  tagethernes*  and  causes  participants  to  believe  they 
can  accomplish  almost  any  feat  Thdr  acts  are  motivated 
largely  by  momemary  emotional  diicomforts  rather  than 
by  eusiomary  social  restraints.  Tradiiipna!  w^ys  of  behav* 
ing  tradually  l«e  some^of  iheir  cohesive  power  and  can  be 
chalknfed,  These  r.ew  w«y»  of  acting  are  repeated,  becom- 
mg  both  the  example*  for  other  people »  conduct  and  the 
bases  for  new  sodal  rdafowhip*.  Iaw*»  and  insntutions. 

Memberjhip  in  social  move;nent»  tend*  to  fluciuaie 
during  the  early  periods  of  thetf  growth,'. with  a  small 
.^lumber  of  people b^mg- fifniy.iomrniited  and  a  much 
'Urrr  number  being  qaly;margin^ly  involved, The  smaier 
Voup.  which  IS  \H  cbre'of  |i  s«;^al  movement,  is  usuiily 
iorgamud  around  a  cgariKHatk:  kader  Thcleader  person* 
•iTies  ihe  character  ofihe  movemtni  and  actively  Kctttto 
enUrgc  the  membership.  Through  such  activities  as  ralhe*. 
ceremonies,  parades,  and  pamphleteering,  members 
associate  with  each  olhef  and  conduct  nitial  recruitment, 
Uur.  the  nwdia  are'  UKd  to  pubiicwe  goaU.  retain  old 
members,  and  attract  new  recruits.  In  time,  the  oytan"** 
tlon  of  socwl  movements  becomes  formal  and  established, 
resembbng  in  many  respects  the  pattern  of  any  other  large 
formal  ffoup. 

If.  Which  statement  correctly  describes  the  nature  of 
social  relatipnships? 

F.  Social  relationships  force  people  to  conform  in  cet- 

(am  Ways.   *  '  ». 

C.  Social  relationships  >fld«mpertain;Io  groups  other 

\  than  the  faniSly,         "       .  ^  ^  < 

H.  Sodal  relationships  caiyusually  wic^nged  wiiA- 

out  difficulty.     v-  , 
J,  Liltle  or  no^^hmifcnt  is  attached  to  social  rela^ 

tionships.  >  "      .  •  ,  *  * 


21.  The  Otcurrence  of  whKh  event  best  indicates  the 
success  of  a  social  mo\em<nt? 
A.  The  formation  of  a  professional  football  team 
•.'  The  American  Revolution 

C.  World  War  W 

D.  The  xlectjon  of  a  corporation's  president 

M:  Which  actmty  could  mo!t  likely  be  associated  with  a 
Socia)  movement? 

F.  People  leaving  a  stadium  following  ihe  defeat  of 
their  f^vojiie  team 

C.  The  daily  movement  of  people  from  the  city  to  the 
suburb*  ,  ,  . 

H.  A  leiter.wnting  campaign  to  solicit  support  for  the 

Equaf  Rights  Amendment 
J.   A  group  of  people  passing  out  leallets  to  advertise 

a  iQtthcoming  movie  for  a  theater  chain 

23.  MeeiinK  conducted  by  members  of  social  mo>ements 
often  include  >ongs  and  emotional  speeches  probably 
because 

A.  oery  member  must  be  given  the  chance  to  express 

hn  views  fully 
•.  it  IS  essential  to  reinforce  a  sense  of  community 
C  leaders  can  thereby  maintain  control  of  thcu 

followers^ 

D.  other  Opportunities  for  interpersonal  communica* 
lion  are  unavailable. 

24.  The  author  implies  that  dunng  the  early  development 
of  social  movements,  the  relationship  bciween  the 
leader  and  the  «>re  membenhip  is 

F.  direct  and  strong, 

C.  impersonal  and  weak 

H.  unpredictable  and  callous 

J.  acciden^t  and  undefined 

25.  Ihe  people  involved  in  social  mo>ements  often  coK"' 
sidcr  their  ideas  "antiestabtishment"  because  of 

A.  the  ineffectiveness  of  bureaucratic  regulations 
f .  their  perception  of  weakness  m  the  leadership  of 
''  socul  movements. 

C.  their  detachment  from  existing  S<ku1  constraints 

D.  the  lolluence  of  ideas  as  sources  of  social  power 

2*.  According  |o  the  passage,  which  statement  best 
descnbes  the  relationship  octween  social  movements 
and  sodal  institutions? 

F,  When  social  institution*  fail,  social  mo>emenis 

cannot  develop 
C.  Socwl  institutions  and  socul  mo\ements  refer  to 

the  same  kind  of  behavior 
H.  Soaal  movements  are  more  effective  when  social 

institutions  are  strong. 
J..  Social  institutions  and  social  mpvemenis  hl>e 

reciprocal  influences.  I 

27.  Which  circumsunce  is  most  likelylo  pre\ail  dunng  the 
early  penods  of  social  movements? 
A.  f  ogical  discussion  of  issues 
i.  Careful  attention  to  democratic  procedures 
C.  Uncompromising  commitment  to  a  position 
'O.  Willmgitess  to  appreciate  all  sides  of  a  problem 
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It.  Wbkk  phoKNMciKMi  could  moM  accuraiely  be  ctiM  ■ 
socMl  Mslitution?  ' 
F.  A  cUstfoooi  acttvHy 

/     C,  A  kmnime  fncMMuf  ^ 
,    H.  The  w»y  •*>pJe'|et  in«in#J 


J3.  SlMp.  4tv§  tiMc*.  aMl  h>ffio«i»  art  all  AMcs  of  eoa^ 
actoMMM  tiMt  on  be  <tcKnM  at  Uinp 

A.  alMionML 

B.  noriMl. 

0.  piydtic 


J 


34.  The  Sufftac  Court  4«owmt  in  EuoMo  v.  ttHnais 
•nd  Mwmtda  y.  ArUcm  were  luwmi  «ith: 
r.  kfiiblive  apportiboiMiit. 

G.  Ike  rifbu  of  aecuMd  penon*;' 

H.  reh'pout  fraed^n. ' 

J.  Ike  MtwMl  foT«maMnt*»  power  of  taxMtea. 


-OuMtion*  2>43  trw  nd  bsMd  on  a  TMding 
jmnff  You  art  to  trwtm  Vtmtt  quaauont  on 
iha  baaia  of  your  pravioua  achooiwortt  in  tha 
aocial  studiaa. 


The  prtHdent  Mf«  ih«rc  r««Wk  policy  when  he: 

A.  dclivm  the  St•leH>^^he•Uniofl  Uitm. 

B.  nakeeiM.MtrtwMriM. 

C.  itMM  cMCMive  Ofden. 
O.  '4an  all  o£  the  tkove. 


.n.  Under  k>m«  ruk.  •  eky  gomnmcAt  cui  joven  M 
fcwdeati  with  leei  inteifcfefwc  than  othcrwue  from  the: 
f.  eounty  foveminent. 

G.  areiidem^ 

H.  Supfetac  Court. 
J.  aute  iDvtrnnicnt 


35.  What  it  ike  iatpact  of  iMrrfor  m*wr  paiiticil  paitici 
on  the  Amerietn  pobtkal  lyttem? 

A.  Iheyueuatty  operate  oataide  the  ic^l|oyemmcM 
ttrwtarc. 

B.  They  ty^tyinnuenec  Ike  la^Fobtial^artiee 
to  Moiaotc  third'party  rtfonai. 

C  They  aiiieraUy  exwie  du*Ji  FaMure  00  iMikUc 
ofticUito  ofpOK  any  major  fOverBBtent  chaaaee. 

O.  They  unMUy  prevent  the  deetioa  of  major-party; 
candidatct. 


^  Aceaidii^  to  the  Coaititutiaa.  the  Houee  of 
Riiriiwtatwet~and  NOT  the  Senile-  perfomn 

which  of  the  fotlowiag  functiom? 


.^^   Miu   made  by 

pnMdent' 
IL  Approving  tnatiee 
III.  Origiaatias  rcvcauefftMni  bijk 

F.  lonly 

G.  Illoiity 

H.  I  and  fl  only 
J,  t.lLaadlir 


31.  OtiatM  of  the  United  SUte^  pradiee  •  fottcwey  « 
they: 

A.  ipptoud  the  perfonner  at  a  oroM. 

B.  add  cMoriae  to  ihe  city  water  wpply. 
C  lehiee  to  pey  ■  debt, 

O.  obey  t>c  Khool-zonc  ipeed  bmit. 


32.  RegardieM  of , Ihe  Ivae  of  economic  lyMcm.  eeona«ic 
irewth  CM  oecur  ONLY  %  ' 


F.  vaJuee  of  free  enlerprtie  aad  individual  initiative 


G.  apaal  gkined  frem  productive  cntcipriiee  i«  used 
to  improve  productwa. 

H.  •  nattaa  cam*  i>fa  great  deal  of  foteifn  tiade 
J.  the  popaktion  ic  growing. 


37,  Which  tax gitfrraUy afTecUMopk with iefwer lacoMct 
more  tavcialy  thaa  it  affecU  people  with  higher 
ineomei? 

A.  EeUte  aad  inheritaaoe  taxes 

B.  Sake  taxee  on  food  aad  iMaU  dcoie 
C  Corporate  taxee 

O.  /Hm  praveaMvc  federal  awome  tax 


3t.  The  nincteeath-eentury  PopuheU  were  laativated 
chiefly  by  theU  desire  io: 

F.  achieve  juaitee  for  the  caaiaMNi  maa. 

G.  put  an  cad  to  ilavery.      , ,  . 

H.  niaintain  an  equal  number  of  free  and  tkvc  Maiae. 
J.  extend  U.S.  aifluenoc  in  worU  afTalrt, 
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»,  TW  Tiwty  of  V«nwU«.  which  concI»*<ejl  WorW 
^  Wtr  I.  iiii^o«^  which  of  the  fotiowinf  condiitoM  on 
GcrmMy?      '     '\  * 

I.  Gcnnmy  wmi  U>tmd  to  pay  aUicd  w«f  to»l». 

II.  Gcrmuiy  c«l#d  temiory  to  Frinct, 

III.  AUMd  form  .occupbd  all  ol  Germany. 

A.  lowly  ^ 
a  tMdllooiy 
C.  11  mmI  ill  only 


4i.  The  i«mi  S<rmnblt  M  AMr^iifv^  »h«  P«nod 
when  \atp<rmltm  \*«$  e^efci»«tf  by: 
r»  A/fk»iii.cwho  struoM  lo  re|«in  cootron 

their  own  deHiny.  \ 
C.  Europ«in».  who  tswWi»h«J  colonic*  over  moit  of 
ihe  conlincAl  1  At' 

H.  ChrtfiUn  denomiiuii<jrnii.  who  compctM  lor  Air»» 

on  converts,  ]  .  .. 

J.   Europcaju,  who  compctid.  vi|orou»Jy  w«h  one 
aiKHher  for  African  slaves. 


\ 

,  A  /mtnitnttt  soody  »  one^tn  which, 
A.  a  woimn  inay  have  only  one  huslwnd  al  a  time, 
t.  a  loalc  raaftio  one  of  his  mother's  km, 
C  ancMliy  m  lrac«i  thrwif^  the  moiher*  hnt. 
D.  dwWren  take  bo«h  Iheit  mother's  and  father's 
names  as  surnames. 


42.  Which  s»al«iieiil  heat  distw|wi«hes  bet*ecri  the  feudal 
Hid  the  manorial  systems  of  the  Middle  A|es7 
F;  reudabsmswas  based  o«  ^ney<  while  mano- 

nahsffl  waOMwl  on  land.  \  .  ^    ^.  ,       .  . 
C  Feudahsm  wa^NMSooated  .>nth  chivalry,  while 

manoriahsm  was  alsocatad  ^ ijh  chasniy. 
IH*  FeUdahsm  refers  to  a  pohutal  'mi  socul  strue- 
'  lure,  while  manoriaSsra  fefers  to  an  economic 

structural  \ 
J,  l^irfahsai  rifers  lo  ail  economic  ittuctur^  while 

muioriabsm  refers  tor  s  pohtwal  and  sooal  stnio- 

turc. 


43  Before  WorW  War  ll,  arm*  limitation  mptanwu 
typkaUy  ewablisberf  which  kind  of  restriettons? 

A.  Quotas  oa  naval  armaments  \ 

B.  Selective  Kmits  on' military  itouniil  forces 

C  Courts  of  arhHration  to  handle  international  dii^ 

agreements  .  I 

D.  UiMts  on  jround'lo-air  imssU 


The  followina  speakers  present  ditferent  viewpoints  on 
the  problem  of  air  pollution  by  automobiles 

Spt0k<r  /  ' 

If  consumers  wantad  automobikijwth  wpcnsive  »nti^ 
p6llu(ion  devices,  they  could  bujr  such  devices  «•  oj«.oi«J 
Muipmem.  The  beauty  of  Amervcan  capiulism  « *« 
Set  that  the  consumer  is  kini.The  povcmmeni  should  not 
restrict  the  frcwiom  of  choice  of  its  citizens. 

Consumen  are  wilh'nf  lo  buy  only  those  foods  that 
benefit  them  direct^.  When  a  mojonsi  ^wf"^;; 
mobile,  he  bnalhes  hltlc,  if  any.  of  the  pollution  ejnitiM  by 
hi,  «^  Sn«  lirSriv?;  httle'benefit  he  will  <H>t  >«nl  to 
buy  the  tquipmenl.  On  Ihe  other  hand,  he  would  benefit 
from  antipoUution  equipment  on  the  automobiles  of  other 
motorisis.  but  they  too  are  unlikdy  to  spend  money  for 
^quipmcai  IImI  would  befiefil  someone  else  When  the 
iJaefiu  of  a  commodity  |o.  to  someone  other  than  tne 
buyer  lifeWsrnm«»l  must  «ep  in  to  insure  thai  the  com- 
modity is  projawd^^nUpollulion  equipment  must  be 
required  bf  law^ 

Spt^ft  3 

People  should  be  able  lo  buy  any  type  oflrotoinojMle 
Ihey  desire.  Why  not  measure  the  amount  of  poHul'oni 
duMd  by  every  make,  aswfn  a  moneury  value  to  *.  ind 
then  impoK  a  faderal  license  fee  of  an  aquivaleni  amount? 
Thfs  would  encouraie  people  to  chooee  aulomobiJes  with 
Ins  harmful  environmental  impact. 

Spttkff 4 

Incrt^^  taxes  will  make  automobile  ownership  more 
expel^pS^f  people  wiU  be  able  to  effort  cars. J^rort 
wiH  aet  sick,  and  aulomoUve  workers  wiH  be  standinf  m 
front^f  unefflp»oyme«t  ofTicea  rather  than  asKfflbly  hne«. 
Perhaps  we  should  pvc  a  tax  break  to  those  companies  that 
ate  wdiing  lo  hire  engineefs  lo  develop  cheaper  antipoHu- 
lion  aquipmenl. 

CoflwetJtion  in  the  automotive  industry  hu  always  led 
to  bctter  products.  Power  steennf,  automatic  transmis- 
sion and  other  improvements  came  about  without  iovem- 
S2«^e"«UoJ!  1  .m  jure  Detroit  wiU  eventoally 
improve  the  environmenul  impact  of  its  products. 


44.  Which  speaker  most  clearly  expiesses  the  view  that 
peoples  economic  decisions  are  motivated  solely  by 
setfiMerest? 
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48.  Which  speaker  impltcs  that  histonoil  trendi  can  be 
UMd  to  prtdict  iKe  future? 
A.  I 
».  2^ 
C  4 
D.  5 

46.  Which  lovcrnmeni  action  \\c-id  Speaker  4  mo»l  bkdy 
suppon? 

r.  fumnt  a  hw  re^uinni  equipment  that  decrea»e» 
auiomobiie  emiMioni  i 

G.  EaUblishini  ait  agency  to  itudy  the  impact  of 
urtan  poitution  on  the  hdihh  of  the  atiieni 

H.  Imfoaing  a  IO%«aie»  tax  on  automobiles  with  hi^ 


J.  AwarJmi  a  bonm  to  the  eompaoy  that  first 
produces  emiSMonOowcnnf  equipment 

47.  Which  pair  of  speaker*  «/ould  differ  moM  on  the  issue 
of  fovemmcnt  intervention  in  the  economy? 

A.  1  and  2 
1.  1  and  5 

C.  2  and) 

D.  3  and  4 

4K.  When  Speaker  4  declares  that  "Oetroit  will  let  sick."  he 
nteant  that: 

F.  tmo^  in  Oetrott  will  increase  and  cause  senoui 

respiratory  diieases. 
'  G.  engineers  in  Ort'rorf  will  become  unemployed. 
H.  autoinob^ile  tales'  will  decrease  throughout  the 

nation/ 

J,   Detroit  wiH  be  forced  to  default  on  iti  munlapal 
bonds. 


49.  With  which  statement  would  Speakera  3  and  4  agree? 
A.  Antipollution  equproent  makes  automoWea  oaore 
experwive. 

■.  Fighting  pollutioo  will  increase  unemploymcntv 

C.  Pncc  it  the  major  determinant  of  oontuRicrspcM' 
uig.  ^   

D.  People  will  never  buy  automobile*  with  antipollu^ 
tion  devto». 

5t.  Speaker  3  recommends  a  tax  utcrtMSf  while  Speaker  4 
recommends  it  tax  dftrtmte  because  they  disacrae 
about  the 

F.  seriousness  of  the  pollution  problem, 
^G.  cost  of  loKing  the  pollution  problem. 

effeaofmcrcasadjaxetonthedeiaandlbraM 
J.   wilbnipMsa  of  consumers  to  hocept'tax  cut*. 

. 

51.  Which  government  action  would  reflect  Speaker  7s 
economic  philosophy? 

A.  Making  seat  bciti  maodatory  equipment 
1.  Tying  boense  fees  to  horsepower  « 

C.  Katsmg  the  federal  gasoUnc'tax 

D.  Taxing  people  who  benefit  from  Uving  near  public 
tmnsporution 

'52,  Some  economist*  believe  that  krge  companies  dedde 
what  Jhcy  want  to  produce  and  then  use  advertising  to 
persuMc  consumers  to  buy  the  eoodi.  This  belief 
CONTRADICTS  the  viewpoint  of  Speaker  - 
F.  I. 

C.  3.   "  ~ 

H.  4. 
J.  5. 
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NATURAL  tCICNCES  REAOINO 

35  Questions 

mmcnom:  EMh  mmh*  J"  mx  it  loHowtd  by 
i»vf al  qutrttont.  Aflf  rtadtnfl  •  pMMOt.  choo—  tnt 
t>M(  •ntww  10  ••ch  quMtion  tod  W»ch«i  Ih*  corr^ 
•pondtng  •p«c*.Ofl  your  aMtmt  tt^m.  You  may  rtltr 
to  lha  pMMO*  w  olt«n  n^cmtv)^. 


iMKtjVorbw  jiknu  we  hifWy.iApied  for  «ptunnj 
itirf  tfMMfit  iMceu  tbr«M|h  uim|uc  iiructum.  TyrtcaUy 
men  Bfaiil*.  mort  inwrtivofou*  irUoM  mamifaclurf  food 
Sy  aliodMr^inM  aiMl  aiv  capaWc  of  aMorhng  mlrofen 
from  tiK  M^reuoMgh  iheif  roo«,  Howew.  iii^ivorpw 
•Unu  ha%«  evolved  a^aiNaliom  ihM^Iow  for  the  dirMion 
m4  the  iUofplion  of  wtro^n^h  proteiii  ihiough  the 
Itif.  Omnium  thai  tit  captared  by  jptciahfed  kavei 
provide  \h€  niliofea  necewary  for  the  piani  lo  wrvive  if  Ih: 
plant  live*  in  a  nitrofen-poor  habiui. 

The  atichci  plant  u  one  inMciivofoiu  plant  (hat 
wrvives  in  wet.  Uagy  »fea»  wheit  there  »  l^Mlf J"»[orn 
avaUaMt  in  the  loiTTtitt  plant,  which  hat  boUow  Jeaves 
ihapad  hke^pttchcn  or  hora*<  umi  a  pitfall  trap  to  inare 
ofi»rtm«.  ii^ly  colored  hwves  exude  a  iweet  Jinellio 
attract  the  inaeci.  and  neclar  |lande  further  entice  the  inteet 
iBia  (he  mouth  of  the  leaf.  Once  imide.  however,  the  intert 
caaaot  eeaiiy  e«ape.  Downward^atiof  ham  on  the 
ionrr  walb  of  the  pitcher  haMen  the  inaM^^  '*fL'"***c! 
CMiem  conlalninii  water  and  difMlive  ewyraet.  Once  the 
imect  m  d«»«(ed<  nilrofea  and  other  maiefiaif  tte  abtorbed 
i(Mo  the  W  hy  »f»cial  aelle  hoinf  the  cirtern. 

The  Venui'i-llytrap  n  another  example  of  an  ineectiv- 
ocou*  r^M.  Uke  }he  piteher  plam.  il»  kavei  ar e  "(tapted 
for  inMct  irappi'of.  The  leaves  are  hiAMd  m  the  center  and 
have  iharp  ipTne*  along  their  outer  edr»-  When  an  inieci 
Wuahc*  at  Ic«l  2  of  the  interior  tngger  hair*,  the  leave: 
Map  thul  like  a  mo4Meirap.  Once  an  inaect.«  caught, 
digeitive  fluid*  iJowly  dtMolve  it;  cdibk  part*.  After  icvcral 
day*;  the  }mi  reopeiWv 

The  Mindew  alanl/  found  in  ho»  and  wer  peaty  area*, 
i*  another  type  of  imectivorow  plam.  Iti  method  of  trap- 
■iag  M  ttmiiar  to  flypaper:  the  ends  of  the  hMve*  are  covered 
With  <maU  leatack*  or  ihon  hair*  which  bear  a  clear.  *ticky 
iMuid.  AtnMect  mituke*  thw  bquMl  for  dew  and  abgiiu  on 
the  gluehke  droplet.  th»  kcommg  lacwely  trapped,  Soon 
the  plant  leaf  bend*,  and  the  lurrounding  tentacles 
I  the  imect.  In  time  the  inasci  »  difesicd. 


2.  Some  in«ectivotou»  plant*  ^mfghi  be  *weei-smelhng 
while  other*  might  have  z  pungent  odor  becau»e  the 
plant*  have: 

reached  different  evolutionary  *Uge*. 

G.  adapted  to  differeni  habiui*. 

H.  adapted  to  attract  different  orpnum*. 
J.  different  flower  color* 

3.  The  pitcher  plant  *utvtve*  iQ  area*  where  mo*t  other 
noAiniectivorou*  plant*  do  not  because  ihe* 

A.  seed*  of  moit  other  plants  do  not  fall  in  the  bog. 
t.  digettive  eniyme*  of  the  pitcher  plant  kill  mo*t 
other  plant*.  ^  , 

C.  tack  of  nitrogen  in  the  »oil  prevents  the  growth  of 
mo*t  other  ptant*. 

D.  imcdsofthe  area  consume  most  other  ptani* 


4.  Which  factor  wa*  probably  LEAST  relevant  to  the 
development  of  the  trapping  mechanttm*  of  the 
*undew  plant? 

Favorable  muution**of  the  ptant'*  genetic  code 
Gr  fypes  of  orfsnitms  captured  by  the  (Hani 
H.  Lack  of  nitrogen  io  the  boggy  *oil 
J.   Color  of  the  ptanl'*  flower 


5.  An  experimenter  faiU  lo  stimutaie  a  sundew  pbnt  with 
*UMr.  *urch.  and  tloohol  solution*  but  u  *uccea*fu} 
with  *  solution*  eontaining  milb  albumen,  arid 
ammonium  lalu.  The  experimenter  might  conclude 
that  the  sundew  ^ni: 

A.  seleeiivtly  choose*  it*  nutrient  *ource*>  

i,  re*pond*  more  readily  to  albumenlhan  to  miik. 


C.  i*  seMitive  lo  some  touch  stimub.  . 

D.  can  digest  food  in  solute  form  more  easily  than  it 
can  insects. 


1.  One  adaptation  of  the  pitcher  ptam  that  prevents  the 
escape  of  the  captured  insect  i*  thr. 
A.  tweet'smethng  flower, 
hollow  Isaf.. 

C.  brightly  colored  leave*. 

D.  downward-pointing  hairs. 


4.  The  digestive  eniyme  Kcretcd  by  insectivorou*  ptants 
would  be  expected  to  be  analogous  lo  thai  eniyme 
found  in  humans  called: 

F.  pepsin/ 

G.  carboxylase. 

H.  catataK. 
i.  lacuse. 
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if  2  tniftr  htm  in  ib«  VMiuVflytra*  arc  «imtttei«d. 
or  4 1  tntver  Imh*  m  Muniibiurf  iwmc.  tne  k«f  will  clo*c. 
Tb«  WaiNMiofl  iMi*  oociirTfd  ia  or4cr  iJmI: 

A.  Ibc  ham  dk>  not  >friaf  iliut  for  falM  ahrtm, 

B.  M  mmmI  too^iMfr  fof  ^  flytrap  cm  ««gi|K. 
X.  the  lotvc*  cfcwc  wlMT^nHM      ujf  forcifR 


D.  ihc  (i<iiiM  CM  ckcmkaiiy  dclcrnunr  if  tb«  orftniim 
cMittint  mtrogcn. 

The  pncfclM  ^  a  ihkilc  have  cvolvad  in  order  thai  the 
ihMile  caJi  be  carrM  hy: 
F.  wind. 

G*  Mxiaa  aatiMlt. 
H.  Sirde. 
.   J.  bwe. 


Which  if  NOT  aa  exaai^  af  pbni  adapcattM? 
A.  Thick  ba'rfc  of  an  oak  trac 
■l  Shaltow.wkkafrcadraolqrMcaiafacacttM 
C  Had  iMVctof  an^aatunaaliMpletfae 
O.  NaedMype  leaf  cf  a  ^  iiae 

19.  A  Venu«'»-nytrap  plaat  n  raiaed  under  aoraal  griea- 
/house  coadmoM  and  Wi»a(  fad  aay  iwani.  Daai  thii 
ylani  kocyiw? 

F.  .  Yei.  heeaaae  ade^aate  nitrofM  ii  availaUe  ta  the 

soU. 

G.  Yc»..hea«ae  the  alanc  d««  not  need  to  caiapetc 
with  other  phiatt  far  its  aalricatt. 

H.  No.  heeauM  oajv  teiacii  provide  the  autrieatt 
mc«aiary  to  MMlaio  the  plaat. 

J.  No.  hacaaK.the  pkat  caanot  adpMl  to  the  mea- 
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To  uii4crfU»l  why  obf«M  float  oc  A«k  whc«  plMcd 
r#  water,  Me  mmc  study  Uk  tMcral  ntettoMlOr  b«t««n 
tlw  fonM  Miiaf  on  u  o^Mt  imoienei  in  water  and  the 
moAtm  of  that  objoct  b  water. 

Ncwtoa't  «eeo*d  law  dcfiae*  the  fenefa!  reUltomhip 
ietweca  focvet  mmi  motioa  u 


12.  WheitaitohjecliipUcwIinwMer.theWwoyantforcrof 
the  water  on  the  ohjeci  it  equel  to; 

F.  the  weight  of  the  ohtect.      .    ^  ^  ^ 

G.  the  weifilt  of  the  water  4i»|ilac«l  hy  the  o«>ject 
when  rt  enters  the  water.  . 

H.  the  mast  of  the  ok^fect  nwkiplMd  hy  lU  a««d- 
eration. 

J,  zcro< 


where  «  *  the  aawfcralioa  of  the  dject, 

F  X  the  net  force  aeuaf  on  the  obfect, 
and  M  3  the  imm  af  the  o%yact. 

An  nNaet  at  rcM  or  movtag  in  ■  straight  hac  with  a  CMMUnt 
velMity  haa  aero  acoeleraiiM.  Hence,  the  net  foree  acting 
onnnMtalMhezrro.  Ifthca«fo«oe  acting  on  aao^  is 
aero,  thin  the  mm  of  the  foccaa  acting  m  ane  direction  must 
•qnal  the  mm  of  the  foroea  acting  in  the  ofpoerte  direction. 

When  aa  ohject  it  in  water,  however,  there  ma/  he 
eeveral  forcct  aaiaa  on  it.  The  earth  wtii  exert  a  gfavitatiooal 
faccc  on  the  aMect;  this  downward  force  »  called  the  weight 
of  the  a^cei.  feuayant  force  aictt  on  an  object  hnmeraed  in 
waiar  ai  wcU.  Archimedea*  pripci^  ttatc»  that  a  body  , 
I  in  a  h^uid  k  huoye4  u>  with  a  force  equal  to  the 
Naf  the  d — * 


A  ttudeni  conducted  J  expeiimenu  to  valiiUu 
Arehimades*  principle.  The  same  steel  Mock  was  uiad  mall 
Um  ( 


£Mptrimmt  I 

To  detennine  the  weight  of  the  Had  Wock,  thestuienl 
hMg  the  Mock  from  a  spring  baUnce. The  balance  read  9.5 


To  detcfMiac  the  foree  of  the  water  on  the  Uock.  the 
stndeM  wmm  hug  the  block  from  the  baUncc  The  Wock 
(bM  not  the  balance)  was  then  submeffed  in  a  unk  of 
walariThe  Maek  did  not.toach  the  bottom  or  sides  of  the 
lank.  Tlia  bnlaaae  rtad  t.)  J>cwf  ns. 


Ta  dtiirwna  the  woiffat  of  iht  water 


bythe 


Hack,  Utt  sindaM  pat  a  pan  weighing  5  7  netnana  i 
Uk  Mak«Thi  tank  fvaa  than  filM  to  the  brim  with  water, 
the  black  WW  subasaifid  in  ihttnnk,  and  the  watarthat 
~  wad  tht  brim  waa  cai«ht  In  the  pan.  The  weight  t( 
I  plaa  tht  water  thai  rt  caught  waa  ftf  newtaaa. 


11.  ineai 


1 3,  the 


ruiad  the  lank  ta  the  briai 


A.  bete  demanae  the  inaial  amoun)  of  water. 

B.  iMke  laAciaat  room  ta  submeric.  the  block 


camflstely* 


lurc  of  the  amount  of  water 
buoyanTforea  af  the  water  an  the 


bythe  Mock, 
the  b« 


13.  In  the  figure  below,  the  directiona  of  the  fofon  acting 
on  each  of  4  olijacts  (Ubeled  I  through  IV)  arc 
indicated  by  arrows,  and  the  magro'tudes  of  the  fofces 
(in  newtoaa)  are  noted  beside  the  arrowv.  Which  object 
has  zero  net  force;  acting  on  it? 


A.  <I 

B.  II 

C.  Ill 

D.  IV 


14.  Why  did  the  readmgi  on  the  spring  balance  m  Experi* 
menu  I  and  2  differ? 

F.  The  water  does  not  exert  a  force  on  the  block  in 

Expetiment  1  but  does  in  Experiment  2.  I 
C.  The  accderalion  of  the  Mock  wai  equal  to  zero  tn 

the  second  experiment 
Jf.  The  force  of  the  earth  on  the  block  m  ExpenmeM  i 

k  greaifr  than  in  Expenmem  2. 
J.  The  fotrce  of  the  earth  on  the  Mock  m  Experiment  I 

tt  leu  than  in  Experiment  2. 


of  which  of  the  following  would  buiUers 


IS.  In  tiK  dcMgn  of  which  of  the  foltowmg  would  mi 
be  LEAST  ^cly  t<i  uae  Archimadei*  principle? 


A.  Canoes 

•.  Winther  balloont 

C  Submarines, 

D«  Rockeu 


».  Onihe  hasa  of  Expenroent  3.  what  is  the  weight  of  the 
water,  in  newtoiu.  dtsflaced  by  the  Mock? 

F.  00 
C.  I.I 
H.  5.7 
i.  il 
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17.  la  Expftvimi  2.  ivhtt  m  the  buoyant  force  ot  ibc 
wi(«r,  in  ncwions,  on  the  Mode? 
'A.  00 

C.  $3  / 

D.  9^ 


f  liont  IS  and  It. 

The  mM*  Mov  liiu  ihc  mum  and  ad  foroct 


MM)     N«t  Force  (f<) 


I- 
II 
III 
IV 
V 


I 

5 

.  10 
40 
30 


10, 
)0 
30 
40 
10 


It.  WhUh  of  the  $  otjMtr--would  have  ihe  trcaiest 
accclenlion? 
F.  I 
C.  Ill 
H.  IV 
J.  V, 

19.  Supfow  iJic  5  objcdi  aJlluirf  a  net  force  of  10  ncwtont 
actmt  vtpn  them.  Which  olijact  would  have  the 
fTMtnt  a«c«lcraliqn? 
A.  I 
S.  II 

C.  Ill 

D.  iV 


'  OiMtiona  3Cf-34  ar«  ~noC  bM«d  on  a  rmding, 
pail  HI.  You  ara  to  'ana«f«r  thaaa  quaaikma  on 
th9  baaia  of  youf  aravtoua  achoolworli  fn  tha 
natural  aoianoaa. 


aouibl  .   

Wmer.  one  ihouM  ■41jii«(  the  aurner  so  that  Ihc  flime 


tL  A  pefKXi  hypa>>ciiaci  that «  roaw  <aa  W  cnli<  if  aa 
ekctric  rcfnfnatar,  which  naads  in  the  aaMIc  af  the 
room,  u  Ml  open  while  il  aperalw.  After  aiaa|  period 
o(  tiaic.  however,  ihc  okccrvM  that  the  tcf  eratare  af 
Ihe  room  is  iacreaiini  nuher  than  4r:reaMa§.  Which  - 
'  iiatcmeat  captaiat  thMt  accanvfic^ 

F.  The      that. leaks  from  the  rcfriferatar  rtleaM* 
h«cta»ii«xpandf. 

G.  The  frceciaf  compartaient  it  liiot  apcn. 

H.  The  rtfriferalor  molar  fcttcrate*  heat; 

J..  Thcrefrlferaiorhnotpawerfttleaoaihiotoolihe  ' 

roam. 


23.  If  ^  man  who  u  kft-fiaaM  aad  Mue^  (hoch 
recetMvc  liaiu)  marrie*  a  woman  who  ii  lefl*hamlad 
and  hrown-qrad.  their  chiWran  ooaM  iaheril  which 
traiu? 

I.  Uft-harMM»c«  aad  hhie  tym 

II.  Left-haadadwwi  aad  hrowa  eyct 

III.  llifhl>handedn«H  aad  Wuc  cyei 
A.  I  only 

».  II  only 
C.  I  or  If  only 
a  I  or  III  only 


24.  Dew.  which  u  CMcntially  moieiiire  condentcd  oat  of  > 
,the  air,  will  form  when  there  \»i 

F.  a  dacrcMC  in  tcmperalttre. 

G.  an  iocicaae  in  barometric  iKCMure 

H.  a  decieaae  in  haroaieirtc  prcMure. 
J.  aa  abaenee  of  wind. 


2S.  ■aumkt  define  a  fruit  at  a  ri^iMd  ovary.  Accordiag 
to  this  ^efmition.  which  fiMd  ia  a  fniit? 
A.  Sweet  pouto  \  * 

1.  Turnip 


Cucumber 


16.- Air  bubhiM  fiaaratad  daap  under  water  uwt.^  .  . 
vohimc  as  ihey  nae  to  the  surface  hea  ')e  the  / 
F.  preaaurc  inside  the  bubblas  inciaasas.  ^ 
^     G,  atr  tmidc  the  bubbles  decreases  in  tempcraluir. 
H.  air  in  the  ^bbles  dissolves  in  Ihe  water. 
J.  preaaurc  of  Ihe  water  on  the  babbles  dacraaaes. 


/ 


F«  at  imall  ai  possiUe. 

G  bfifht  yellow. 

H.  bbe.  ; 

J.  pale  Mue  wMh  a  darker  blue  inner  core. 

21.  Which  material  doe>  NOF  act  as  a  conductor? 
k.  Clipper  »ift 

I.  Silver  metal 
C.  Sah  water  I 
O.  Class  tubini 


37.  Smee  molds  eaaaal  ooadtict  phatosyntbesis,  it  auai  be, 
true  that  in  their  interaaion  with  their  eaviraaaiaat* 

.       .  C  ■ 

A.  muM  uihamt  areas  raoeivaif  t  haun  af  aanh|^  la 

order  to  fkMinah. 

B.  ffluM  obtain  orpnic  nutrieats  from  their  enviroa- 

C  deplete -ihf^oayfcn  in  Ihctr  eavirodmeat,  aad 

therefore  thetr  growth  is  h'aiiiad. 
O.  lend  10  kMC  orfinie  nutrients  to  their  aavironflHal. 
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'0mm  al  m4mmnt  kmftntv 
Cum  Wmi  lo  b^wcfy  u  hi|h 


)i.  TlM  luMtkilHMyoraiMS«HHMUMl  thcr«af«no 

r<^'  Om  m  mdmag^^m^mtt^fm  id  pmrntrtt  arc 
prMMirvf  m4  at  oool 

a  TilT'iii^"  vol^  of  aU  gaM^  al  tundard 
V    tm^mmii  aW  pmatire  »  apfroximatfly  32.4 

J.  G«Mt  ipo«iM«o«Mly  expand  !•  occufy  aU  the 
vilwn  availaWc  thcnw 


It.  To  dctcfmin*  wkctlicr  kciOMfl|  i*  an  etodrolyte  in 


1}.  Tbc  eirth*»  •^uaiorial  nitw  k  grMicr  than  lU 

■  e  to  the; 


A.  nni —  kt  loUihUity  m  water. 

B.  mnnirr  the  dcnaiiy  of, the  herocenc^nd-watCT 

MhkHMk. 

C.  aiMMie  kt  comnhulion  lo  the  conducitviiy  of 
wslef. 

D.  ohfcrve  ii»  eleciro«ic  tpc^ra  in  water  with  a 
lyectroMOfe. 


3%.  In  which  ^Oferty  do  X  rayi  and  light  rays  diffet^ 
P.  Wavelliwth 
•  G.  Sfced 
H.  diarie 

J.  NorK  of  the  ahove 


31,  The  tenet  >n  a  cefl  would  he  immediaidy  altered  >f  the 
experimenier  tuhttnuted  iffthercH  one. 
A.^  amino  acid  for  another  m  a  ^otcin. 
■w  Nucleotide  for  another  tn  DMA. 
C.  iiikJeoiMte  for  another  m  UNA. 
O.  tuprJor  another  in  a  aurch. 


12.  What  doe*  the  phaic  diagram  of  carhon  dioxide  shown 
helbw  reveal  ahout  carbon  dioxide'^ 


F.  rrcmendout  prcMure  »  needed  to  lique^y^carbon 
dioxide  al  -Tt*  C. 

G.  Cafhon  dioxide  cannot  cxiM  as  a  liquid  at  iwrmal 
aimoifherie  ^rcaaurc.  ^ 

H.  arhon  dioxide  cannot  txM  at  a  mt 
.7»*  C. 

J.  The  triple  foint  of  carbon  dioxide  oocurt  at -7t*C 
and  1 0  aim  preuurcs 


A.  earth's  routioo. 

B.  jraviiational  attraction  of  the  wn. 

C.  yraviuUional  attraction  of  the  moon. 

D.  hi^r  lemperaturct  near  the  equator. 

,  AdewwM  tri^MMphate  (ATP)  i«JiM*rt«ni  to  the 
•cttvetranifortiyMem  of  the  ocU  membrane  heoMiwit 
provide*  the  eril  mkraM  with  the  Mwaary: 

I',  nuid. 

C.  energy.. 

H.  iiotq^^  ,  . 

J.  chkNtiphylL  . 


Theoreiical  and  jrtiyMCal  molecular  modd»<  whkh  show 
how  elearoM  form  the  bonds  that  boW  mokoiles  together, 
are  used  by  chemiMS  to  lUuMrate  relatiomhipt  between 
aioms  in  a  molecttle.  One  tbMiretical  mo*ecuhr  model  places 
electrons  ia  concefMrc  orbits  around  i  ceatral  aiom;  each 
orbit  or  jhtit  has  a  maximum  capacity  of  I  electrons  A  full 
outer  shell  it  regarded  as  the  most  stable  eledronk  con- 
figiration  that  an  atom  can  have.  A  bonding  theory  iniro' 
duccd  by  LewN  uses  this  principle.  Lewis  assumes  thai  (1)  a 
bond  between  atoms  involves  2  electrons  that  are  shared  by 
ihe  atohis  Ihey  join,  and  <2)  each  atom  is  surrounded  by  4 
pairv  or  I,  ekcirons.  Exceptions  to  t  his  ocfrf  theory  occur  in 
the  ernes  of  the  ligNesi  elements  Hydrogen  needs  only  I  pair 
of  elections  for  a  complete  outer  shell.  Bcr)  Ilium,  boron,  and 
aluminum  sometimes  form  compounds  with,  respectively. 
2,  y  and  3  pain  in  their  outer  shells. 

Strttctural  models  can  lUastrate  the  octet  theory  of 
Lewis.  Baca  use  only  the  electroM  in  the  outer  shell  of  an 
atom  come  in  contact  when  2  atoms  hond  together,  only  the 
outer  dectrona  are  depicted  in  the  model.  The  atoms 
electrom  are  arrangad  lo  give  each  atom  in  the  molecule  a 
group  of  I  etectrons.  The  rollowing  eumPle  shows  how  the 
mdividua)  outer  electrom.  represented  hv  dots,  bond  m 
carbon  dwxidc;  the  short  bnes  represent  the  electron  pain 
m  Ihe  moleaik.  _  _ 

:0'.C:.0:  10*C»0l 
To  tranihte' these  theoretical  structural  models  into 
physical  nodck,  the  chemist  determines  the  siae  and  shape  - 
ofthemoUcule.The  sin  of  each  atom  in  the  njoUcuk  can 
be  estinrnted  by  cakulaiing  the  atom's  radius  from  (1)  Uie 
experimentaUy  delarminW  bond  length  between  boikding 
atoms  AmAB  (tAB),  and  (2)  the  electronegativiiiet  of  Ihe 
2  atom*. 


1>ie  radius  (r)  of  atom  A  then  may  be  cakubted  by  the 
formula:  ^ 


'A    tlMtt9mm**\*yA  *  «l«if<Nl«aiiiv«)'j  Am4» 

The  radius  of  '  is  then  equal  to  the  bond  length  minus  the 
,  radius  t>f  A. 
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Ml  of  ilMlim  pMn 


tiM'Mtnl  atom. 


ifet  Mi»  Mf  amMfitf  HUfMr  M  |Jmi  tkcy  an 
by  ilM  (TMiMi  imaaii  aa4  aagk  fttmMt.  TW 
*  limum  Um  eummi. 


Ommmy 

fISS? 

Til  mint  ♦nrf 

l»l 

TiigiwIpfciMnJwrf 
tiMtfiiMi'  *M 

"|5-C-D| 

ImMT.  2  MW«f  (IMMM 

J8w  TW  priaMiy  factor  that  ^«niuiM(ihc  ahapc  of  a 
.   iMolooMle  ii  Ute:  ' 

A«  awbar  of  Mto  of'dMtroii  pain  Mifrouaduic 

NMitaiWf'oiMral  awM.  j 
i.  bo«tf  MaMT'balwMii  2  atMM  t«  iht  moloaik. 

C.  i«ulaMaNraf«lMiro«aiiitke'm»l«culc 

D.  iMgiii  of  tlic  rarfii  of  mi^niml  atonu  in  tb« 
niiTifuh  ' 

Ji.  If  Uw  cwMml  nwa  of  a  walacitlc  were  wmwin^  hy  3 
■tt  af  ilacirM  iain.  tilt  iMaMry  o(  tiw  molecule 
wovU  prvhttMy  br. 
L  tiaaar. 

IL  trijaaal  r^trntr, 
IIL  MuaMral. 
F.  I  only 

C.  Ilgak 

M.  I  or  III  OiUy 
J.  UorUlomy 

XI.  Hy4stm  (H)  has  I  daetroii  in  h»  outer  iball.  and( 
Mprn  (N)  has  5.  Which  fymhol  accurately  4e^« 
the  dbdraa-dat  ttnictpfc  for 
A.  fiHHH 

'*  H 
■l  hj-Rh 
H 

C  N.HH 

D.  HikH 

H 

The  MnMluialBMrfcl  for  carhoa  dioxide  4<|Hcte<4  in  (Im 
woaad  pan|ii^  Migpnl*  lhat: 
>  F.  a  d— hte  hoad  caa  he  fomiod  bctmen  2  aioim. 
C.  t  electroM  farm  t  hondt.  4 
H.  earhaa  dioxide  it  not  a  MaWe  moltcule, 
J.  oiihr  half  of  carhon't  outer  ihtU  elcctroiu  arc  UMd 
10  lor 


3$.  To  cakvlaic  titt  liat  of  aa  aiaar  it 
aatdt  t«.ha«w  tht: 

I.  tltrtraaaprinty  af      aua  aad  af  Um  oat 
10  whi^  k  it  haaiid. 

II.  haad  dlttaaaeWaai  ttei  atOM  la  the  cm  la 
which  it  it  htadid^ 

III.  auaher  af  ttU  af  Uiatia  pain  tprrtaadiag 
Iht  otntial  aloM. 

IV.  laial  atuaher  af  tladratw  aurrauadtat  UmC 
atoflk  ^ 

A.  II  oaly 
■l  ill  only  ' 

C.  laad  ll  Mdy  ^/ 


O.  HI  J 


m.  Acaardiaf  lo  the  Uwit  tiMoty,  the  litttrtai  thai  ait 
iavohad  m  hMrtiai  aMMl  htc 


F.  eantrihulad     hath  k  ladiai  atoiat. 

C.  iraatfarrtd  from  oat  aiaai  la  iha  oihtr. 

H.  ihartJ  hy  hath  aiaaH.  tipffdlmi  af  the  ittttfaai' 

on|ia. 

J.  pairtd  wah  4  oihar  eliciraw  ta  form  a  haadiai 
aaet.  »  • 


41.  Sett  of  dattraat  are  muaUy  fouad;  atparalad  hy  tht 


A.  dactraaMliaanhebrokMiaalyiatoe^aalpam. 
IL  aioam  are  mm  ^hk  at  the  aaracn  af  rapdar 


C.  the  etMral  atom  attract*  dtt  atMM*  alaciraaaain. 
pttivt  charfH  cauat  tht  titttraat  to  ra^tach 


O.  acfati" 

oth-r. 


form  the  boadt  with  oxygen. 


41.  The  bond  l|««th  bttwata  iht  hydracn  and.  carhan 
atom  in  CH4  U  1.09  anfttranM.  aad  the  cltetr»< 
ncaaiivtly  for  carban  it  2.3  aad  thai  for  hydroftn  it  1 1. 
Wbch  aquation  ibauld  be  uiad  to  fifure  the  n^utjuf 
tht  otrhaa  atom? 
r,  f  ■  2Jiil.« 

*      M.  f  -  (2.5  *.2.l)  X  4gt 


43.  Hydraitnnatdtoaly  I  yair  ofeltctrontforaaanylm 
oMc'thalL  Which  kateMcat  U  INCONSISTENT  wKh 
ihit  inadcl  of  hydrofen?  ^ 
A.  Hydragca  atomt  are  not  found  at  the  ccntan  af 

molacukt. 

■l  Hydrofm  aiomi  do  not  determine  the  laOHMtriai 

of  mott  molacukt. 
C.  An  outer  ihcU  conuininf  t  ciactront  ti  required 

for  a  ittWc  confifuralion. 
O.  Only  the  outer  ihell  elactront  are  involvad  in 

bonding. 


GO  ON  TO  THE  NEXT  ^AQE. 


Mbrden^  tkc  coMUKitft  u  a«  undcnM  Mfc  of  rock 
(mMI  tht  coiuimrm^l  tMf.  Ai  Ks  v^ie.  ibc  amtm«mt»l 
tiopr  bcaiiu;  Uic  coMin«iUl  ik>pc  drop*  u>  tiM  ^ec^-ocetn 
flooc  Mmt,  Much  of  liM  d«c^ooc»ii  floor  it  niafwl. 
comtd  with  n4|e«  and  Ireiwhct.  Oity  Ac  «6>»m/  ptiins. 
[tcMiUtwi  Wow  t  "       ■  -  --i 


f«tt  of  iM 
of  Mdijncnit' 


Dw  and  beyond  \kt  oMituicaul  tlofc  arc  flat 
Tl.oufh  itMir  rocky  ^oma  »rc  at  ruMad  at 
ic  MUloor.  Ihey  are  oovervd  with  great  thick* 


ihcy 
'Mnd.  Mk, 


I  cky. 


How  did  ihcie  MdinacfMi  come  (o  tiw  abyMl  ptaini?  A 
Idy  of  a  lf»  canKqtukc  tiwt  onpiMia^  on  Ncw- 
fodndkAd*!  cofHHMnUl  ilofe  Mfod  provide  mformMiofi 
pirdwi  Ike  origiR  of  thcK  aadiMOHft.  After  Uie 
canlmnBltc.  underKa  tckr^Hi  caklc^snappad* 
cannaiMkc  Htetf  had  been  rcapomiHc  foe  (he  krtakafc,  all 
Ike  caNca  thoUd  have  broken  at  nearly  the  Mme  inttaai. 
The  dau  in  the  uWc  bdow.  however,  reveal  otherwiK. 


CaMt« 

tdai  •(  OmhmmaI 

ItatWarwk 

thftr  tv\knm1tt 

UMtMMMMMft 

♦ 

:«> 

10 

«)• 

ti 

1)0 

fhr.  1  M. 

K 

m 

10  hr.  If  ma. 

1) 

Sctenutfi  hypoihcairad  that  tke  eanbquake  had 
uartad  an  undcrwa  Uodilidc  whu*  broke  ikc  fini  •  oaWcv 
Sedimenu  then  flMad  the  water,  increaiing  in  dciiMty.  Hiii 
ffluck  dent^  water  began  lo  flow  down  the  ilofc.  gaihering 
more  tadiiMMt  and  incrcaung  At  tfewl.  and  mapfwl  the 
caUct  m  ks  path.  Reaching  the  Hat  floor  of  the  abyMt 
pUina,  the  tadimenl-denM  water  ilowad.  Finally,  the  Mdi- 
mmtt  tettlad  out  of  the  water,  fofniing  a  layer  with  the 
coaraer  meftriato  at  ihc  bottom  and  the  finer  matenah  at 
ihc  top. 

Columnar  lamplcs  of  Mdimenii  in  the  ar**  rcveaM  a 
graded.  I  •meter  layer  of  ladimenU  that  eomaioad  the 
remamt  of  coniineMal>«helf  orgawMM.  Thw.  the  locnttiti 
concluded,  iticae  ik>w»  of  NdiawM-ladeii  water,  called 
ttirMity  ewrmt$.  mm  have  craalW  the  abyiul  plairn. 
Such  currcnu  noad.o<Uy  a  lotfrec  or  aaduMntt.  iomc  kind 
of  dHturbane*  Iwch  a*  a  Morm  or  an  eanhquakc)  to  Kt 
ihem  M  motion,  and  an  unobetruded  path  to  the  Mafloor. 

TurbMity  currtnl't  aiao  account  for  Mibmanne 
canyoM.  For  years,  loantati  bahcved  that  theae  ouiyont 
were  origMally  above  lea  level  o«i  the  cotiaaiHil  margiai 
and  had  been  rormeM||  terrcttnal  nvciv.  Now  tbey  have 
concluded  (hat  turbid^  c 


currents  muM  have  carved  them 


out. 

44.  Sedimentt  that  cover  the  abyml  pUini  arc  carried 
theie  from: 

F.  deef-ooaaa  trcnchet.' 
«     G.  (he  coMtncMal  ih^. 
H.  Mibmanne  canyofli. 
J.  coaiul  riven. 


45.  In  (he  di^rtm  bek>w.  which  numeral  indicatet  the 
moel  hkcly  k>cation  of  an  abyaaal  plam? 


44.  Compared  to  the  organisms  hving  on  tiw  abyssal 
plains,  ^thosc  creatures  inhabiting  the  continenul 
^hdvet  are  best  adapted  to.a  habitat  which  u; 

F.  shalk>wer< 

G.  colder. 

H.  smoother. 
J.  darker. 


47.  Suppose  a  ecru  in  submarine  canyon  becomes  deeper 
after  storms  and  shallower  du^ng  quiet  weather  This 
o^vation  wouhf^offn'  suggon  for  (he  hypothesis  iha( 
siorms'  V 

A.  auKwea(heriha(  resembles  earthquake  aaivity. 

B.  set  off  landslides  .on  the  continenial  shdf  that  TiU 
submarine  canyons  with  sediments. 

C.  set  qff  turbidity  currents  in  submarine  canyons  thai* 
carry  accumulated  sediments  beyond  the  continenul 
slope. 

D.  set  off  turbidity  currents  in  submantircanyoes  that 
carty  accumulated  ledtmentt  onto  the  continenul 
slope. 


4t.  Which  rtaiemcnt  supporu  the  sciemiiU'  hypothesis 
that  the  Hrst  I  caMes  were  broken  by  the  landslide 
generated  by  the  Newfeundland  earthquake? 
r.  The  eablea  were  wiilHii  160  kilometers  ef  the  edge 
of  iIk  cemiuenial  shdf. 

G.  The  cablea  brvkc  almoat  at  the  laMMt  ihe  eanh< 
quake  oecurred. 

H.  The  eaMca  were  located  quite  deee  to  one  another.  , 
J.  Turbidity  currcnU  Med  an  unobstructed  path  if 

Ihey  are  to  slay  in  nwtiM,      ^  « 


QO  ON  TO  THE  NCXT  PMt. 


4 


A.  Cmm 


WiMt  itMMU  KMNIMU  4*  t«  4tHttmim  bow  «My 

twMiiy-ClimM    t^t  tiW  tMltHMMS 

>twtoi«f  t^wtiMkr  •kyml  (Amine 
ftl  mmmnmoM  imsnkti  caa  be  natfc) 

M.  TsUy  Iwv'  May  ymn  ef  ii<iawatt  Ittvt 
nwatoM.  aMwaMf  tlM  j  iMMr  of  M*iaca(  ^ 
•niKMMMi  I  year't  McaaMilMioa. 

C.  Cmm  th»  ^iM^  of  oanb^aakM  tarf  ii*nai  la 
Uk  am  tacb  >«ar  uM  RMiMHrt<M  awaMr  by  the 
ue-  of  tiw  unli. 

D.  fXmjm*  tim  tkkkmm  al  leiiiiMm  mtkaf  — « al 
iMatMiar  m  J  y«ar  aad  AvMe  *■  mmkm  mm  ih« 

af  Uif  iiiiwui  •miyMC  Um 


Ml  WlMi  af  Ike  faUawilif  eNenratiaw  M«Miad  M,*e 
mmm$  a  farce  ailMr  tliaa  aa  eaiil^vakc  ha4 
b?ak«a  Uw  caUei  off  Uie  tivvfnniM  ihoft? 

A  giaal  B—fcir  af  caWae  were  brafccn. 
C.  Gmn  fmm  «m  la^airai  la  snap  aa  iia^rwa 

caMe. 

It  TiM  eaWee  kt9kt  at  w«My  varyiof  ttaiee.  - 
J.  AMafUMabvve 


n.  If  the  calutaaar  Miaaki  af  tiw  tcafloar  off  New- 
fawatftMi'k  eaatuKfUl  ilapr  U4  leveaM  aathan  but 
racky  Manoar«'^tMe  KieMiiu  wavU  Man  kfcdy  have' 
coacluM  that  the  cabk  breaks  caaM  be  aicauaia<  far 

A.  a  tarbi4Hy  carreai  that  had  baea  m  aff  by  laaie 
cveat  ather  thaa  an  •arthqaakc. 

Stbe  hndihdf. 
MMc  eveat  ather  thaa  a  tvt^t^y  caneat. 
D.  a  twrbiAty  a'fvfM  that  bad  camad  aa  M* 


S2.  The  iafacaiatiaa  la  the  paiiagt  wawK  aapyart  whiih  ai 
the  Mlvwiac  niiiaati  abawt  larbiiay  carraaM? 
F.  They  travel  at  aa  avtrafe'  tpmi  af  300  hilewimi 
aer  hoar. 

Q.  They  are  aacaie  tt  depaiMia.  bat  aat  af  irmia. 
H.  They  awy  flaw  far  haan  befare  the  lediaiiti  la  the 

carrenu  MiUt  aat.  ' 
J.  Anafiheabavt 


UI00FTCtT4 

STom  bo  NOT  retuhn  to  any  pther  test. 


Antww  K«y  to  Sam^  TmI  loolM 


I2>0 
I).  D 

14  N 

15  D 
!«.  N 

IT.  a 
le.  r 

11  A 
Ml  F 


2i  A 
32.  J 
2)  D 
J 

25  C 
27.  • 

n.  K 
)e  A 
'ja.  F 


]2.  K 
».  D 
K  F 
M.  D 
>.  J 
]T.  D 
M.O 
)*  D 
4i  C 


0U  D 
42.0 
4).  ■ 
44.  J 
4S  D 
4ft  F 
47,  D 
4i  r 
m.  D 

M  J 


SI  A 

>r  F 

5)  A 
M  N 

».  t> 
».  h 

s;  D 

»  O 
51  C 

Ml  H 


II  D 

21  ■ 

51.  A 

4t  c 

21 K 

II  r. 

22  K 

>2  C 

42  K 

no 

.1),  ■ 

25  a 

55.  C 

45  A 

4|  K 

14^ 

24  r"" 

54.  0 

-41.  G 

f  D 

15  a 

d-r 

»  a 

4S  D 

k 

\K  c 

2i  J 

>  0 

4ft  J 

17  A 

.27  C 

37  • 

47.  A 

II  a 

)i  r 

J«  M 

r  » 

.1*  t> 

2*»1i 

5*  a 

m  c 

T  * 

:«  » 

^  J 

4e  G 

M.  D 
U.  G 
ft)  A 
K  J 
«5  • 
ft*.  G 
«7.  A 
F 

ft*.  • 

7a.  J' 


7t.  D 
72,  F 
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74,  N 
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•A 


1,  D 

II.  c 

21  C 

II.  a 

2.  N 

12.  G 

22.  J 

It  N 

).  c 

II.  c 

25  D 

15.  D 

4  F 

14.  P 

24.0 

K 

J  C 

15.  A 

25,  C 

55.  A 

ft.  K 

1*^  0 

2I.-J 

51  K 

7.  D 

17  C 

27;  C 

57.  D 

F 

II.  G 

2t.  J 

51J 

«.  C 

If.  C 

M.  C 

If.  a 

la.  K 

3«L  H 

5a  0 

41.  P 

51  C 
52.  H 
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AchMlTMt 


TIM  MM  eoiKaim  tour  Mi-f nf«»f» 
<>lrt»»im»«  UMfti  SmM  SfutfM  /lM«n»  «n« 
MMuraf  Sdmmt  Mw^nf,  Th»  tour  9Mli  mMMira 
riUM  Mtf  iMMM  «M«  »•  NfMy  r«M  It  MOOM  In 


Curing  tfw  lint  hilf  •!  KM  twUnf  mmim,  you  wM 
oiiripHH  «w  CA«Nt»i  UMf»  TmI  and  »w  MMht* 
nwHct  UMtt  TMt  In  «w  Mc«f«tf  Mf.  ywi  wW  ^tmw 
pIM  «ij  SmW  Stuitot  WM<im  TMt  wi«  th«  NHural 

<  JmiM  l»  mch  Itx  art  miW><f<>  mi  mttour 
•r  fWt  IniiiHM  anMPWV  tor  Mcfi  i|uMMon,  am 
iMlwwtf.  On^lha  MwiMr  ahMt  ttw  row*  of  o««li  tm 
numkMi  !•  mMch  iht.^uwHom  ani  tht  avato  in 
oach  row  am  fmm94  to  cortwpond  to  m>  lug^aaUd 


for  aach  ^uaatfon.  ftral  dacMa  wttich  anawar  la  baat 
^NaMi  lacala  on  ttia  anawar  tHaat  tha»row  of  ovalt 
numkarad  M  mm  aa  Mia  ^uaation.  Than,'locata  ttw 
aval  k)  that  roar  Mtarad  tha  «vna  aa  your  anawar. 
FinaMy,  Woctoan  tia  ovaJ  complalaly.  Uaa  a  aofT  laad 
panc«'in<n«ia^your  marlii^haavy  and  blaclt.  OQ 
MOr  use  A  BALL'POtN T  KN. 


admMairator  laNa  to  do  ao.  If  you  fMah  a  taat. 
iMtoro  lima  ia  callad.  you  should  uao  tha  tima 
i«maMn9  to  raeonaidar  auaatlona  you  ai»n<ncartaln 
about  in  MMl  laat  You  may  NOT  took  tack  to  i  toat  on 
whlah  tlmr  hat  alraady  Nan  caHad.  and  ywi  may 
NOT  fa  ahaad  to  anothar  toat  To  do  ta  wlH  dla^uaHfy 
yau  from  tha  aaaminatlaru' 


Your  acara  09  aoeh  laal  wM  ta  taaad  only  on  tha 
numtar.of  quaaltona  you  anawar  aorraiHly.  YouwM 
NOT  ta  panallBad  for  guaaainf.  H€NCe  tJ  tSW 
YOim  ADVAMTAQE  70  ANS\ye^  eve^Y  QlMS' 
TION, 


If  you  chanfo  yaur  mind  atout  an  anantor.  araaa  your 
Hrat  mark  thoroufhly  bafora  marklnf  your  naw 
anMf^  For 'aach  quaadon,  maka  oartoin  that  you 
Wk  ^  iharowofowMawhhthawmanurfiharaatM 


Do  not  fold  or  tear  tha  pagaa  of  youf  toat  booklat 
Kaap  tha  tKMklat  in  aa  good  a  condition  aa  poaaiWa. 


00  HOT  OrCM  fnrt' •OOKUt  OWTIt  TOtO  TO  DO  $0. 
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'  Summary 


\ 


'  This  inveitigation  compared  the  predictive  validity  of  the  ACT 
tests  with  the  SAT  and  SCAT'.teifc.for  a  sample  of  21  colleges  and 
universities.   Grades  in  »peciiic  couries  as  well  as  over-all  grade 
point  average  were  studied.    Multiple  R's  xyere  computed  for  each 
test  battery.    The  ACT  and  SAT  tests, potfessed  about  the  same 
degree,  of  predictive  validity.  and,both  were  bettor  predictors  than 

the  SCAT.  . 

Predictive  results  varied  from  school  to  school  ^nd  from 
course  subject  to  course  subject,  thereby  suggesting  that  predictive 
validity '/or  individual  colleges  and  uriiversities  and  for  specific 
Subject  matter  areas  should  be  establisJied,   Ir  addition,  a  collegers 
choice  between  the  ACT  or  SAT  probably  can  not  be  made  on  the  basis 
of  their  relative  predictive  validities,  but  rather  should  be  made  on 
the  basirofUhe  total  programs  of  services  offered  by  the  respective 
testing  agencies* 
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Comparative  Predictive  Validitiet  of  the  American  CoUege  Tetts  

and  Two  Other  Scholastic  Aptitude  Teiti 
Leo  Munday 

Standardised  tests  of  academic  potential  are  used  in  nearly  all 
American  colleges  and  universities  for  admissions  and  guidance  purposes 
Institutions  have. a  wide  variety  of  such  te^ts^^from  which  to  choose. 
While  many  considerations  are  relevant  to  this  choice,  a  major  consid- 
eration is  predictive  validity.  ' 

This,  report  compares  the  predictive  validities  of  three  of  the 
most  widely  used  tests  of  scholastic  potential.    These  were  the  American 
College  Testing  Program's  tests  (ACT),  the  College  Entrance  Exam- 
inatioii  Board's  Scholastic  Aptihide  Test  (SAT),  and  the  Educational 
Testing  Service's  School'ai^Gtfllege  Ability  Test  (SCAT).    The  ACT 
battery  consists  of  tests  in  English,  mathematics,  social  studies,  and 
natural  science;  it  requires  180  minutes.    3oth  t^e  SAT  and  the  SCAT 
have  verbal  and  quantitative  parts;  the  SAT  requires  180  Jtinute^  and 
the  SCAT  requiives  70  minutes.  -      .  . 

Procedure 

Sample.  Both  ACT  and  SAT  scbres  were  available  for  freshmen 
at  five  colleges  and  universities  which  participated  in  the  1964  ACT 
Research  Service.    ACT  and  SCAT  scores  were  also  available  for 
students  at  six  other  colleges  and  universities. 

Additional  data  from  three  other  studies  were  made  available  to 
the  investigator.  ^  In  two  of  these  (Chase,  et  al. ,  1963,  Kling^lhofcr, 
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1964),  the  ACT  *nd  SAT  tett»  ^ere  adminiftered  to  randomly  selected 


portJb'ni  of  the  entering  clatt.   SCAT  tcorei  were  ftlio  available  for 
virtu^ly"an  of  Klingelhofer't  ttudentt.    In  theiOther  itudy  (Eelli, 
1962),  bo,lh  ACT  and  SCAT  were  adminiiteredjat  eight  coHegei;  and, 
at  two  of  thete,  SAT  results  were  available  for  a  legmentof  the  ianic 
groupie   Altogether,  daUwere  available  for  students  at,21  colleges 
and  universities*  ^ 

Since  some  of  the  cblleges  subdivided  their  samples  by  fex  or 
curriculum,  we  obtained  a  total  of  29  groups  from  the  21  colleges.  All 
tests  were  taken  prior  to  college  instruction,  ind  all  grades  w€re 
ear^cTduring'the  freshman  year.    Table  1  describes  these  in'stitutions 
in  terms  of  their  enrollment,  control,  level  o£  instruction,  and  gco- 

1    '  *     ■ ' 

graphic  region. 

Table  1 

*  Selected  Institutional  Characteristics  of  Schools 


in  This  Sample 

Total 

Source  of 

Geographic 

College 

Enrollment 

Xicvel  of  Instruction 

Control 

Region 

1 

3,910 

Offers  M.A.  Degree 

State 

West  Coast 

2 

19.557 

Offers  Ph.D.  Degree 

State 

Rocky  Mtn. 

3 

930 

Offers,M.A*  Degree 

State 

New  England 

4 

2,040 

Foiir  years-liberal-arts 

Private 

New  England, 

5 

^  280 

Junior  College 

Church 

Middle  West' 

6 

580 

Four  years-liberal _arts 

I  CfhCirch 

Middle  West 

7 

'614  p-? 

Junior  College 

-Private  _ 

New.J^ngland 

8 

1.423  1 

Four  years 

State  ^ 

South 

9 

954  ' 

Offers  M.A.  Degree 

Church 

Southwest 

10 

31,581 

Offers  Ph.D.  Degree 

'State 

Middle  West 

11 

.2,488. 

Offers  Ph.D.  Degree 

Private 

Canada 

71; 
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TabJeJ..{P-P^tJ. 


College 

•  Total 

Source  of 

Geographic 

Enrollment 

Level  of  Instruction 

Control 

Region 

12 

33,956 

Offers  Ph.D.  Degree 

State 

Middle  West 

13 

5,374 

Offers  M.  A.  Degree 

State 

Middle  West 

14 

3,664  , 

Offers  M.  A.  Degree 

State 

Middle  West 

15 

6,571 

OffersrM.  A.  Degree 

State 

Middle  West 

16 

9,863 

Offers  Ph.D.  Degree 

SUte 

Middle  West 

17 

^16,843 

.Offers  Ph.D.  Degree 

State 

Middle  West 

4,624 

Offers  M.A.  Degree 

State 

Kliddie  West 

4,146 

Offers  M.  A.  Degree 

State 

Middle  ^est 

20 

17,024 

Offers  M.A.  Degree 

State 

West  Coast 

21 

354 

Junior  College 

Commuivty 

Middle 
Atlantic 

Criteria.  Over-all  freshman  CPA  was  available  for  all  but  one 
sample.    Additional  criteria  include  .CPA's  in  the  following  specific 
freshman  courses:  English,  mathematics,  social  science,  humanities, 
and  science. 

Statistical  Treatment.  Multiple  correlaticjns  (R)  were  computed 
between  the  four  ACT  scores  and  each  criterion.  The  same  p.rocedure 
wa'8  followed  for  the  two  SAT  scores  and  for  the  two  SCAT  scores. 

In  the  application  of  test  results,  scores  are  usually  combined 

c 

with  high  school'grades.    However,  high  school  grades  were  not  routinely 

We  assumed  that  all  tests  would  have  similar  correlations  with  high 
school  grades,  and  therefore  the  increase  in  validity  obtained  by  add- 

ing„high  school  grades  to  test.scores  would..be  jrelatlvely.  constant. .  . 

This  assumption  was  not  formally  tested,  but  it  is  consistent  with  most 
of  the  literature  in  academic  prediction  and  with  the  experience  of 
ACT»s  Research  Service.^ 
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^Within.ei^ch.cri»rioii.*rea-miatljaeL.co«:Lelation*JR)j5^^   


using  FUher's  X  procedure  (Edwardi,  1950).    Thit  procedure  wa«  not 
strictly  a^ropriate,  ^  but  it  provided  a  convenient  summary  of  two 
columns  of  R's  that  took  cognizance  of  relative  sample  sizes. 

Results  and'Discussion 
Table  2  compares  the  validity  of  ACT  and  SAT  for  predicting 
over-all  grades. 

Table  2  r 
Comparative  Validity  of  ACT  and  SAT 
for  Predicting  Over-all  Freshman  Grades 


Multiple  Correlation 


College   Group  N  ACT  SAT 

1  Men                                   308  .33  .38 

2  Men                                    445  .37  .33 
20               Men                                175-  183  .47     '  .38 

1               Women                                469  .46  .42 

Women                                700  '    .50  .42 

Women                           223  -  232  .54  .45 

All  Freshmen                       127  .45  .44 

All  Freshmen                      433  .48  .48 

All  Freshmen                       531  .4^  .41 

Vocational  Majors               202  .37  .33 

.4               Business  Majors                  264  .41  .41 

4               Secretarial  Educ.                 215  .38       .  .64 

1 1  Science  Majors   187  -43  .40 

 HumaniRe's"Mfej  o  r  s               ^r66^  ^ 


2 
20 
.  3 
12 
13 

1 


11.  Soc.  «Sci.  Majors  149  .41  .43 

Totals  4594  -  4611  .44**  .42** 


*When  two  N»s  are  given,  a  different  sample  took  eacK  test;  ACT  N  is 
given  first. 

\    ■  ^  \ 

♦♦Computed  \y  transformingj's  to  £«s,  weighting  by  N,  and  retrans- 
forming  to  R's.    (Edwards.  1950). 
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 TableuJ^ummaxlze»^th«te.daUk  and  predictiv*<validiti«t4n  other 

academic  areas  for  thes'e  two  batteries.^  A  timilar  tummary  of  ACT- 
SCAT  comparative  validity  it  found  in  Table  4. 

fable  3 

Comparative  Validity  of  ACT  and  SAT^— ^  ^     -  - 
for  Predicting  College  Freshman  Grades 


Criterion  Area 
Over- all       English       M^th        Soc.  Sci. 


Science 


No/ of  Colleges  8                5  4  5 

No.  of  Correlations  VS               10  6  10 

KangeolN's  127  to  700  123  to  585  30  to  605  97  to  26 1 

ToUlN  4594-4(11  2427-1988  1033-1406  1452-1461 

Range  ol  R's,  ACT  .33  to.  54  .27  to.6l  .40  to.  66  .  23  to  .  70 

Range  of  A's,  SAT  .33  to. 64  .29  to.67  .35  to  .66  .23  to. 66 

No.  times  ACT  higher  9                6  5  7 

No.  times  SAT  higher  5                4  12 

MsanR*  ACT  .44            .45  .51  .48 

MeanR*,  SAT  •  .42             .43  .49  . 44  ' 


4 

11 

62  to  254 
1576-1524 
.31  to  .72 
.  30  to 

9 

1 

.52^ 
.50 


70 


*  Computed  by  transforming  R.'*  to£*s,  weighting  by  N,  and  retransforming 
to  R's.    (Edwards,  1950).    At  one  institution  where  sample  sizes  for  .  ' 
some  criteria  were  not  available,  the  average  sample  size  for  that  school 
was  used. 


Table  4 

Comparative  Validity  of  .ACT  and  SCAT 
for  Predicting  College  Freshman  Grades 


.Criterion  Area 


Over -all 


No*  of  Colleges 

15 

5 

5 

3 

No.  of  Correlations 

17 

6 

6 

5 

Range, of  N's- 

66  to  1857 

108  to  255 

135  to  227 

108  to  204, 

Total  N 

9376-9771 

993 

987 

765 

Range  of  R's,  ACT 

♦  30  to  .  69 

.51  to  .  72 

.35  to  .64  - 

'  .36  to  .54 

Range  of  R*a«  SCAT 

.25  to,  .  70 

.41  to  .  74 

.  23  to  .  62 

.24  to..  58 

No.  times  ACT  higher 

16 

5 

5 

3 

No.  times  SCAT  higher 

1 

1 

o' 

2 

Mean  R*,  ACT 

.53 

.57 

.53 

.44 

Mean  R^  SCAT 

.49 

.51 

.44 

.40 

*  Computed  by  transforming ^'s  to  z's.  weighting  by  N,  and  retransforming 
toj's.    (Edwards,  1950) 
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 TTfeit^brcrtufgeit-icvcTal-concluticni;  ~  

1.  Predictive  retulti  varied  widely  from  one  campui  to  the  next. 
The  tpecUic  validity  of  any  tcit  ihould  be  eeUbUihed  for  the  individual 
collage,  ^  V 

2.  Differences  were  noted  in  thc'predictability  o^  curricular  and 
•ex  iubproupt  at  individual  coUeget.    These  reiultt  imply  that  complex 
colleges  should  develop  several  different.equations  for  predicting  grades 
so  that  various  contingencies  can  be  taken  into  account, 

3.  The  ACT  and  SAT  tests  possessed  about  the  same  degree  of 
predictive  validity.  The  slight  predictive  advanUge  to  ACT  'hown  in 
Table  3  is  too  smaU  to  be  of  any  practical  consequence. 

4.  ACT  appears  to  be  a  reliably  better  predictor  than  SCAT,  both 
in  terms  of  oyer-all  grades  and  grades  in  specific  courses. 

There  are,  however,  certain  limitations  (inherent  in  these  con- 
clusions.  In  the  first  place,  because  the  Zi  colleges  were  not  selected 
to  be  representative  of  any  known  population,  the  statistics  can  be 
applied  in  a  strict  sense  only  to  the  sample  institutions.   Since  a 
reasonably  diverse  group  of  institutions  was  ijnvolved.  however,  and 
sipce  the  results  from  college  to  college  were  similar,  this  limitation 
is  probably  not  serious. 

Secondly,  we  did  not  know  whether  one  or  the, other  test  had  been 
used  for  admissions  purposes.   Whatever  the  situation,  the  test  used 
for  admissions  would  be  at  a  disadvantage. 

And  finally,  while  sample  sizes  for  specific  courses  were 
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— occa»ion»U3r  « a  small  thatthese-tampler^bbably'yrodu^ednr^ 
correlations,  the  average  j^'s  reported  in  Tables  Z,  3,  and  4  are  exceptions 
to  this  deficiency.  > 

Within  these  limitations,  we  can  safely  conclude  that  all  three 
tests  pOBBeBB  useful  predic^ve  validity.   SCAT  scores  were  least  pre- 
dictive, ^probably  because  SCAT  is  a  muchxShorter  test  than  the  other  two. 
The  sUfht^predictive  advantage  enjoyed  by  the  ACT  battery  is  probably, 
a  function  of  its  more  comprehensive  nature  (four  tests  as. opposed  to^ 
two)  and  its^  content  (which  is  explicitly  related  to  typical  college  fresh-  ^ 
man  courses). 

Most  colleges  today  participate  in  one^of  the  two  national  testing, 
programs      ACT  and.CEEB  -'->  whose  tests  were  compared  in  this  study. 
Other  colleges,  will  likely  make  a  choice  soon.   Our  findings  suggest 
that^differences  in  validity  between  ACT  and  SAT  were  so  slight  that 

■C 

this  choice  might  better  be  made  on  the  basis  of  such  other  considerations 
as  availability  of  scores,  type  of  reports  on  individual  students,  costs > 
convenience  tb  the  student,  and  special  services  offered  by  the  test- 
ing agencies. 
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Footnotes 


Gratelul  acknowledgment  is  hereby  made  to  Dr.  Kenneth  Eells, 
Dr.  £•  Ij,  Klingelhofer,  and  Dr.  Clinton  Chase  for  their  cooperation. 

? An  illustration  of  the  importance  of  adding  high  school  grades 
to  test  score  data\is  found  in  the  ACT  Technical  Report  (American 
College  Testing  Program,  1965).    For  almost  600' colleges,  the  median 
correlation  olACT  scores  with  college  freshman  CPA  was  .53;  when 
"Kigh  school  grades  are  added,  this  correlation  is  increased  to  .64. 

^The  assumption  that  all  samples  came  from  the  same^ population 
was  nor  thought  to  be,  tenable.  ,  ^ 

^Tables  which  give  individual  correlations  for  each  group  and 
each  criterion  are  in  the  appendix, 

^Colleges  participating  in  either  the  Americ^jn  College  Testing 
Program  or  the  College  Entrance  Examination  Board  Program  are 
eltgibie  to  receive  local  validation  studies  at  uo.  cost  as  an  aspect  of 
these  programs. 
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Appendix  1 
Comparison  o£  ACT  and  SAT 


1  ne  xTcuiciion  oi  ^oiie^e 

Grade  s 

Coll 

<  Sanlple 

N* 

ACT-R 

SAT-R 

Men 

211 

.41 

Womtn 

369 

.29 

il 

vocational  2>tuoenti 

.  7 

.  3b 

Freshmen 

123 

.38 

.33 

Business  Majors 

257 

.'46 

.34 

4 

Teacher'and 
Secr'l.  Educ. 

214 

.42 

.67 

4 

Teacher  and 
Secr'l.  Educ. 

215 

.28 

.49 

10 

Freshmen 

585  -  NA 

.ll 

.55 

10 

Freshmen 

NA  -  NA 

'  .56 

.50 

11  ' 

Humanities  Majors  X 

165 

.39 

.40 

College 


The  Prediction  of  College  Mathj 
 Sample  


.4 


atics  Course  Grades 

N* 


3 
4 
4 

10 
10 
11 


FreshVnen 
Business  Majors 
TeacheV 

Educ. 


ajors 


103 
259 
215 

30  -  37 
239  -  605 
187 


*Uf  two  samples  werV  in/olve 
the  ACT  sample;  on  thi 
school,  not  all  of  the  h 


ACT-R 

SAT-R 

.51  , 

.46 

.62 

.57 

.42 

.66 

.66 

.62 

.53 

.42 

.40 

.35 

  th/numb4r  on  the  left  it  the  lize  of 

right,  thjk  size  it  the  SAT  iample.    At  one 
i  were  avaiUbleVNA  refers  to  "Not  Available. 
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Appendix  1  (conU) 


The  Prediction  ofjSpecific 
ColUge  Sample  


College  Social  Science  Cog^e  Grades 

N         ACT-R  SAT-R         Couriia  * 


10 

Freshmen'  % 

99  -  n 

.55 

,94^ 

Economics 

11 

Social  Science 

135 

.49 

.44 

economics 

10 

Majors. 
Fi^eshmen 

^80  -  188 

.70 

«66 

4 

Government 

Freshmen 

130  -  133 
107^' 

.52 

History 

11. 

Social  Science 

.46 

.32 

Histo.^y 

10 

Majors 
'  Freshmen 

NA  -  NA 

.66 

.58 

Sociology 

u 

Social  Science 

130  , 

.38 

.42 

Sociology 

1  ^ 

.  Majors 

Women 

139 

.44 

v-42 

Social  Science 

3 

Freshmen 

125 

.31 

«34 

Social  Science 

4 

Business  Majors 

2ol  • 

.23 

'23. 

Social  Science 

Itbllege 


The  Prediction  of  Specific  College  Science  Course  Grades 


1 
1 

3 

10 


10 
10 
11 
10 
10 
11 


ERIC 


Sample 


ACT-R  SA1 


Colu-se 


Men 
Women 
Freshmen 
Fresfimen 

— FxraKmen- 


Treshmen 
Freshmen 
Science  Majors 
Freshfnen 
Freshmen 
Science  Majors 


V 


Science 
Science 
Science 
Anatomy 


Chemistry 

Chemistry  * 

Chemistry 

Geology 

Zoology 

Physics 
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Appendix  1  (cont> ) 


The  Prediction  of  Other  College  Gr^(<s  \ 
Sample   N       -  ACT-'R    SAT^R  Xourte- 


4 

f 

Butinett  Majors 

4  260 

.16 

-  \ 

Accounting 

grades 

4 

Teacher  and 
:SccrU,  eV:uc, 

215 

.  22 

.  47 

\  Accounting 
\  grades 

10 

Freshmen 

YD  -  9* 

'  AQ 
•  07 

Education 

10 

Freshmen 

48  "  188 

.69 

.56 

Fine  Art€^ 

10 

Ff  eshmen 

42  -  NA 

.54 

.38 

piiilosophy 

11  ^ 

Humanities  Majors 

165 

.32 

.34 

FhuoaQphy 

10 

Freshmen  ^ 

NA  -  'NA/ 

.62 

.59 

Psychology 

.10 

Freshmen 

NA  -  NA- 

.46 

.19 

Music 

10 

Freshmen 

NA  -  NA 

.72 

.43 

Business 

10 

Frfshmen 

.  NA  -  NA 

.45 

.37 

Foreig^n 
Language 

11 

\  Humanities  Majors 

1*64 

.28 

r41 

Language:  ^ 

10 

Freshmen 

NA  "  NA 

.40 

.39 

Speech  A  « 

721 


X    Appendix  2 
Compariion  of  ACT  and  SCAT 


College 

The  Prediction  of  College  English  Grades 
Samole                            N  ACT-R 

SCAT-R 

5 

Freihmen  \ 

255 

.56 

.45 

6 

Freshmen 

159  ' 

.55 

.41 

.  7 

Medical  Secretarial  - 

108 

..57 

.52 

7. 

Business  ^ 

135 

N  .53 

.45 

8 

Freshmen 

205 

.51 

.4? 

9 

Freshmen 

i>           '  -  * 

131 

.72 

.74 

Th  s  Prediction  of  College  Social  Studies  and  Humanities  Grades 


Collefe 

Sample 

5 

Freshmen 

6 

Freshmen 

t 

Business 

8 

Freshmen 

,5 

Freshmen 

9 

Freshmen 

i 

N 


ACTrR 


SCAT-R 


Area 


227 
156 
135 
197 
137 

135 


.64 
.63 
.55 
.36 
.35 

.53 


.45 
.44 
.24 

.23 

.53^ 


Soc.  Stud. 
Soc.  Stud. 
Soc.  Stud. 
Soc.  Stud. 
Foreign 

Language 
Theology 


The  Prediction  of  College  Natural  Science  and  Mathematics  Grades 
College  Sample   N  ACT-R       SCAT-R   Area_ 


Freshmen  121  .54 

Medical  Secretarial  108  ^  *4\ 

Freshmen  197  .36 

Business  135  .51 

Freshmen  204  '  .40 


.44 
.34 
.24 
.58 
.41 


Science 
>  Science 
Science 
Math 
Math' 


V 
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Appendix  2  (^ont. )  * 
The  Prediction  of  Over-all  College  Grade  Point  Average 


College 

Ooinpie 

N 

ACT-R 

SCAT-R 

5 

FresKmei^ 

1S9 

.58 

^  .51 

o 

164 

.67  y 

.48 

■y 

M^Hir'al  S^crfitari&l 

108 

.40' 

.36 

7 

135 

•  54 

.52 

8 

JC  ICVlllIiv**  1 

205 

.  54 

.53 

Q 

7 

XT  r»  •  Vi  »vi  m  r\ 

135 

."69 

.70 

12 

Freshmen 

1857 

./50 

.49 

13 

Freshmen 

1457 

i48 

.42' 

14 

Freshmen 

263 

.44 

15 

•  -Freshmen 

647 

.61 

.57 

,16 

.  Freshrxien 

1875 

.47 

17 

Flreshmen 

1371 

'.59 

.55 

\^ 

Freshmen 

66 

/  .53 

.44 

19 

Freshmen 

«  387 

.52 

20 

Freshmen  Men 

175  -  338 

."42 

20 

Freshmen  Women 

223  -  455 

.45 

21 

Freshmen 

149 

/  .30 

.25 

y 

m 
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PREDICTIVE  VALIDITY  OF  THE  ACT  TE*TS 
.     AT  SELECTIVE  COLLEGES 


AMTRACT 


Thf—  tttidiM.  Mch  dMhng  with  an  ttptct  of  cocnptntlvt  valWity  of  ACT  and  SAT  at  Ml«ctiv« 
coK^OM,  art  (nchid^.  Th«  f  ir»t  atudy  comUitwd  th«  prtdictlva  atf  Icitocy  of  tha  ACT  tatt  scprts 
"nhd"  ACT  taat  scotm  plua  high  achool  gradas  at  120  co»ag«a,  aaparattd  Into  thrt*  groupa 
accofdiog  to  tvtrag*  coltw  ACT  Compballt.  Pr«dctiv«  afflci^ncy  wa»  not  found  to  vary 
apof •CMbfy  at  varioua  point*  on  tha  acora  acala.Fof  40  colltgaa  whtra  tha  maan  ACT  Compoalta 
*«  245  Of  hightf ,  tht  rMdian  muftlpla  R  uaing  ttw  ACT  taat  acoraa  waa  .46  and  uaing  the  ACT 
taat  acoi^  plua  high  acbool  gradaa  waa  .5$,  By  contraat.  at  tha  40  cdlagM  whaw  tha  mmn  ACT 
Compoa^la  wa«  15.5  to  20.0,  th9  median  muftlpla  R  uaJng  the  ACT  taat  acorea  waa  .4«  end  uaing 
the  ACT  laat  acoiea  pint  high  achool  gradaa  waa  .56-  The  difference  is  negligible.  Tha  medien 
borrelation  of  >5«  uaing  ACT  taat  acorea  and  high  achool  gradaa  at  aelectivecollegea  comparea 
fMorabty  with  .54  reported  in  CE£B  materiaH  aa  the  median  correlation  uaing  SAT  taat  atoraa 
ar>d  high  achool  rank  at  coliegee  defined  by  the  same  level  of  selectivity.  Further,  when  the  40 
collegea  with  the  high  mean  ACT  Compbertea  are  analyzed  more  cloaely,  there  Is  note  tendency 
tor  the  predictive  efficiency  of  ACT  test  acorea  and  high  school  gradaa  to  decline  aa  college  mean 
ACT  Composite  goee  up.  The  aecood  sfOdy  concerned  four  aelecthfecollegea  where  ell  students 
had  taken  both  the  ACT  and  the  SAT.  aUiI  four  of  thesecolleges.the  mean  ACT  Compoelte  score 
waa  above  24.5;  thelneen  SAT  Total  score  was  above  1200. 1  n  all  fo^r  caeea.  the  ACT  test  acoraa 
gave  a  better  predfction  of  fraahman  overall  Grade  Point  Average  than  dkJ  SAT.  The  medien  R 
with  ACT  waa  .407;  with  SAT.  .31«.  The  third  study  took  place  at  the  U.S.  Air  Force  Academy,  a 
hIghVaelective  inetitution.Afocue  of  concern  in  this  study  was  to  corractforseiecttonononeol 
the  testa.inlhiacaBe  the  SAT^bydeaigningthe  study  In  sucheway  that  prforaelecttonofstudents 
by  the  SAT  would  r>ot'be  an  axtraneoue  factor  in  the  analysis  of  the  comparative  predictive  s 
validity  of  ACT  and  SAT.  Using  the  conventional  formula*  for  coriectton,  the  comparison  of 
cor^lation  coefficient*  again  favored  the  ACT  over  the  SAT,  .5«to  .52  for  Sample  1 ,  and  ^1  to  .43 
for  Sample  2.  Finelly,  when  CE£B  Achievement  ;a*ts  in  English  end  mathematics  were  added  to 
the  two  SAT  scores  in  a  multiple,  the  R  obtained  was  comparable  to  orbetowthatachleved  by  the 
ACT  tests  atone.  The  evidence  In  the  three  studies  points  to  the  conclus^n  that  ACT  •nd  SAT 
scoraa  typlcalty  yieW  similar  reaultn  at  aelective  college*,  and  where  they  do  not  tha  ACT  is 


usually  favored  with  higher  correlatton  coefficients. 


\ 


\ 
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WICOICTIVf  V/U.IOrry  Of  THf  ACT  Tf  «T1  AT  «UCTIV«  «>tUGes 
Oscar  T,  Lttmlnf  * 


WhM  Th9  Amancan  Collw  TWtir»g  Program 
(ACT),  with  tte  coKaga  admiMioiw  and  guidartca 
battary.  waa  Introducad.  at  tha  baQlrmkig  of  Uia  latt 
dacada.  soma  cbllaga  aducator»  wara  concarnad 
about  whathar  thia  rm^  battaiy  would  pradict 
fraahman  gradaa  aa  wall  aa  okfaraxamirfatfona  such 
aa  tha  Schoiaatic  Aptltoda  Taala  (SAT).  Tha 
cooaanaua  of  studiat  pubtiahad  s}r>ca  that  Xim, 
howavar,  haa  baan  that  tha  ACT  Aatattmant 
pradicts  gradaa  for  typk^ai  collaga  populationa 
ganaraHy  aa  affactivaly  as  or  battar  than  tha  SAT 
battary  (Boyca  4  Paxson.  19eS:  Buma.  1904:Chaaa. 
at  al..  1963a.  1963b;  Lins.  AbalL  4  'Hutchina.  1906; 
Lannlr)g  &  Maxay.  1972:  Munday,  1965;  Pasaons, 
1967;  ZJmmarman  t  Michaal,  1967).  Furtharmore. 
by  1971   mofa  than  hlghar  aducatton 

Instltutlona  wara  partfcJpalJng  In  tha  ACT  Program 
(Tha  Amarican  Collaga  Tasting  Program,  1971.  p.  3), 
In  spita  of  tha  ganatat  accaptanca  of  th^  ACT 
AsaMsman  t  ona  quaatk>n  haa  not  baan  answarad  to 
avaryooa's  satisfaction.  Although  thay  would  «gr«* 
-that  ACTis  aaafficianta  pradlctor  as  SAT  for  typical 
coHagas^  it  Wbaan  tha  subjactiva  contantion  of 
soma  that  ACT  should  not  pradict  as  wall  as  SAT  for 
highly  salactlva  cotlagaa  having  a  prapondaranca  of 
studants  with  axoaptional  acadamic  ability  Thara 
haa  baan  no  objactlva  avkJanca  to  support  such  a 
baliaf;  rsttiar  it  has  baan  basad  on  tha^fact  that, 
unliica  tha  SAT.  tha  ACT  waa  not  spaclflcally 
daaignad  for  usa  by  highly  salactiva  collagas. 


It  was  tha  purpoaa  of  this  profsct  (o  collact  all 
availabia  obfactiva  if^formation  baaring  bn  tha 
quaation  of  comparativa  pradtctiva  validity  of  tha 
two  tasts  at  salactiva  collagas.  Thraa  saparata 
studios  providasuch  data,  and  thay  arasummarizad 
hara.  1" 

Tha  first  study  prasants  corralatlbns  typically 
oblainad  with  ACT  data  at  collagas  having  quita 
diffarant  ability  (avals.  This  not  only  addressas  tha 
quaation  as  to  whathar  validity  va'rias  appraclably  at 
various  points  on  tha  scora  scala.  but  also  parmlts 
comparison  with  validity  figuras  on  tha  SAT 
raportad  by  Angoff  (1971).  Tha  sacond  daalswith 
four  salactiva  col  lagas  whara  all  studants  had  takan 
both  tha  ACT  and  SAT.  and  comparison  of 
poadictlva  validfUaa  was  thus  possibla.  Tha  third  is  a 
caaa  study  of  OfM  salactiva  Institution,  tha  U.S''Air 
,Forca  Acadamy^n  this  study  porractionswa'C^rnada 
for  salactton,  so  that  this  axiranaous  («ct6r  would 
not  baar  on  tha  rasults. 


Tht  author  ersitfuHy  ackmrnMaM  Mv«r«l  p«oai«  who  h«lp«d 
wWi  thit  tw^mx  FlrM  U  Ritdoo  J.  WMt*n  o(  ttM  Unttod  SutM  Air 
form  Acwtvmf,  eoMtfior  of  tta  third  slu^  r«aortod  hor* 
S«contfar«  Nancys. Col*. L«o A  Mun^. and EJamaa Maxay. 
jal  of  tht  ACJ  Aaaaarcn  and  Owaiopmant  OivlaioA.  Fomtif  a 
mamkar  o(  tha  ACT  Plaaaarch  and  Oavalopmani  itaff.  tha  auttror 
m  now  Sanior^taff  Aaaociata  wiih  iha  National  Canltr  for  Hioh«r 
Education  Manafam*nt  Sysfami/Waatarn  Intaritata 
Commiaaion  on  Highar  Education, 
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S(M#y  1:  ^rtilcthn  Efffcitncy  of  th«  ACT  TMto  •!  $<licW»f  Cott«9M 


SMmpl0$  und  Design 

BMic  and  Stindtrd  RMMrch  S«rvic«>  records  for 
th«  yors'  1970-72  wer«  starched  to  identify  colleges 
having  en  ACT  Compof  tte  score  mean  of  24  5  or 
above  Thie  score  was  choeenae  a  cut-off  because  it 
corresponds  to  e  SAT  TotaU^eof  1.100,  using  the 
Chase  «nd  BerrittT^|»<«<fCo7K.'Ui  40111*11^966). and 
permits  comperje^inof  ACT  data  with  thrSAT  data 
repoded  by  Angoff'(1971)  for  colleges  with  a  SAT 
Verbel  mean  of  550  or  higher^ 

Forty  colleges  having  an  ACT  Composite  mean 
score  of  24.5  or  ebove  were  found  and  included.  For 
colleges  participating  more  than  or>ce  in  the  ACT 
predictive  reseerch  services  during  those  3  years, 
their  latest  data  w^ re  used  tor  the  study,  Th« 
freshrnan  student  group  sizes  ranged  from'96  lo 
4,976,  With  an  average  of  740.  Because  colleges 
participating  in  these  research  services  ara 
instructed  to  include  either  all  or  a  representative 
sample  of  their  freshman  class,  it  was  assumed  that 
^^^e  groups  were  representative  of  the  entering 
freshmen  at  those  colleges. 

Next.  «quai  size  samples  of  medium  and  low 
ability  colleges  were  sought  for  comparison  with  the 
40  high  ebdity  colleges.  All  colleges  participating  in 
the  1972  Basic  and  Standard  Reseerch  Services 
were  listed  iri'^CT  college  code  number  order  A 
table  of  random  numbers  wes  used  to  select  e 
starting  point  and  the  total  number  of  colleges  was 
dtvtded  by  39  to  determine  the  number  of  colleges  to 
skip  tech  time  before  selecting  e  college.  (This 
procedure  in  effect  provides  rendom  selection 
Within  geogrephic  strete  because  each  state  has  e 
certain  range  of  code  numbers  assigned  to  it.)  If  the 
college  fell  Into  the  ACT  Composite  meen  score 
range  of  20  0to245.it  was  placed  into  the  medium 
comparison  group,  if  not«  adjacent  colleges  in  the 
ordered  list  wera  checked,  alterneting  front  anO 
beck,  until  a  cpltege  felling  into  the  proper  score 
rangs'^  wes  foOnd.  Then  the  proper  number  of 
colleges  from  the  point  of  lending  was  skipped  and 
another  mediurn  college  selected  in  like  manner 
(Institutions  such  as  nursing  schools,  business 
schools,  end  vocetionel  schools  were  notincluded.) 
This  process  was  carried  6n  until  a  group  of  40 
colleges  was  selected. 

The  table  of  random  numbers  was  used  once 
•gein  to  select  a  new  Initial  starting  point.  Identical 
procedures  were  then  used  to  select  a  stratified 


random  group  of  40  colleges  with  ACT  Composite 
means  between  15.5  and  20.0. 

Frequency  tabulations  of  validity  correlations  for 
the  three  groups  were  prepared,  and  a  median 
correlation  wa?  calculated  for  each  group.  This  was 
done  for  ACT  test  scores  as  predictors  (T-lndex 
multiple  correlatione).  and  also  for  ACT  test  scores 
plus  high  school  grades  as  predictors  (TH-lndex 
multiple  correletions). 

An  additional  procedure  that  invorved  only  the 
high  ACT  Compoeite  score  group  of  colleges  was 
used.  Frequency  tebulations  of  validity  correlations 
were  prepared  separately  for  six  different  ACT 
Composite  score  mean  levels.  Once  again,  this  was 
done  for  both  T'lndex  end  THHndex  multiple 
correlations  ^ 


R9SuUs  Bnd  Conctushns 

The  results  of  the  study  are  presented  in  Tables  1 
and  2  Table  1  presents  validity  correlation  distri- 
butions and  medians  for  the  three  groups  of 
colleges.  Considering  the  restricted  range  or  greater 
homogeneity  for  the  high  ebility  colleges  in 
comparison  to  the  other  two  groups,  the  true 
predictive  efficiency  for  thdhigh  ebility  groupwould 
seem  to  be  comparable  to  thatfor  the  medium  ability 
group  and  better  than  that  for  the  lower  ability 
group.  Such  a  finding  implies  thet  the  predictive 
vfridity  of  the  ACT  tests  is  as  fully  satisfactory  for 
u.'^^t  selective  institutions  as  it  is  at  more  typical 
colleges  end  universities. 

Angoff  (1971)  reports  medien  multiple  corre- 
lations of  .52  for  men  and  .56  for  women  at  selective 
colleges  using  tha  two  SAT  scores  plus  high  school 
rank  as  predictors.  Based  on  ACT-SAT  equivalency 
tables,  Angoff  s  colleges  and  our  40  colleges  with 


nt\9  6mk  RMMrch  S«fvic«  tnd  th«Sundtrd  flMMrch  S«rvic« 
art  two  prvdKthr*  rMMrch  MrviCM  olf«r«d  tach  f—t  by  ACT 
CoMg*  olfKitb  c*n  um  rcpofts  pfovKtad  by  thM*  MrviCM  to 
•nalyxf  ttWprtdict/vc  •fficttncy  or  ACT  tf«U  (or  thtir  C4r  pus.lh* 
grMing  PraciicM  on  carnpu*.  «nd  ovh$t  factors 

The  TH*{rH>«x  IS  Ktusily  npt  j  muil<pl«  corrttsiion  It  ii 
<S*v9\offd  by  obtaiflmg  grad*  pradicttons  bM«d  on  a  muttipia 
mmQ  ih«  (our  tMtt  and  on  another  multtpia  using  tha  rour 
studani  rtponad  h*0h  school  gradM  Tha  grada  pradicltons  ara 
than  avaragad  saparataiy  for  anch  studant  Tha  rnuit  ror  MCh 
studant  ii  TH  rrtdax  pradictad  grada.  To  obtain  tha  THHndax 
multipia  corralation.  IN*  TH-rndax  pradictad  gradM  art 
corrttstad  against  tha  actual  gradM  racawad  by  tha  studants 
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TAtLEI 

ACT  TMt  MuMpte  CarraMM  wMi  Ovwai  OPA  !• 


X  Cr  Compo$H9  Mm/i 

fS  5-300 

T-If»d«x  THrlnd#x 


>tCr  Compotif  M^n 
20  0^24  S 

T-lndtx  TH*lnd«x 


ACT  Compo$it0 
T-Iodtx  TH-lndtx 


•5 

1 

7 

3 

17 

1 

6 

•^•4 

2 

6 

3 

• 

0 

8 

55-5t 

3 

10  , 

5 

5 

5 

15 

50-54 

5 

$ 

10 

3 

5 

8 

45-4f 

12 

0 

a 

2 

14 

1 

40-44 

H  5 

4 

5 

4 

10 

2 

36^ 

5 

2 

1 

1  > 

3 

0 

30-34 

3 

2 

4 

0 

1 

0 

3 

1 

'  1 

0 

'  1 

0 

15-24 

0 

0 

M«di«n  R  T-lndtx 

49 

50  ^ 

46 

58 

MMllin  R  TH-lnd«x 

56 

63 

Numtwr  of  Coihgm 

40 

40 

40 

40 

^  40 

40 

N«l*.  Th«  top  frowo  »ftcJo<l*»  «H  eoM«fl«  P»nict9»i*t>9  in  th«  ACT  pf«Kt«v»  rwMfch  —nicm  th«t  h«l  *n  ACT  CcmfiotM 
mMO  tor        »lw<*M*»  Of  24^  or  •bov*  LAt  numt>«f«  ol  coJItOM  wUh  ACT  ComK»«  mMO*  in  Iht  omer  two  MOflts 
Miadtd  tt  random  m  t>M«d  on  xtmt  1171*72  Imhnmn  ^ 


m««n  ACT  Compost t«  scores  abov«  24  5  raprtsent 
tho  Mm«  ltv«)  of  Ml«ctivity.  Th«  midpoint  for 
Angoff's  correlations  ta  54,  which  could  t>« 
conftidarad  as  tt)«  Indax  of  SAT  pradictiva  accuracy 
at  stiactlva  coltagas.  In  contrast,  tha  madfan 
multipla  corraiation  for  the  ACT  TH-(ndax  is  .58  for 
slmii^fiy  dafinad  salactiva  coHagas  (saa  Tabto  2). 

Tha  diffaranoa  batwaen  correlations  of  .58  ar)d  .54 
is  amaM.  And.  tha  two  group*  of  collagea^may  n<A  be 
as  companbie  as  om  would  thir)k.  The  ACT-SAT 
equivalency  procedure  used  in  thia  study  to 
determine  what  ACT  score  would  correapond  to  a 
SAT  Verbal  of  550,  is  not  precise,  it  may  also  vary 
weir  be  that  there  are  oome  basic  dtffererKes  in 
characteristics  between  the  ACT  selective  colleges 
and  the  SAT  selective  colleges  which  could  cause 


one  group  to  Im  more  predictable  on  grades  than  the 
other  group.  On  the  other  hand,  if  such  biases  do 
exisu  they  could  }ust  as  easily  favof  SAT  as  ACT. 
Therefore,  even  though  the  data  suggest  that  ACT« 
prediction  compares  favorably  with  SAT  prediction 
at  selective  colleges  (with  any  difference  favoring 
ACT),  we  must  wait  for  predictive  studies  using  the 
two  tests  on  the  same  students  for  a  definite 
conclusion. 

Table  2  preaents  val!&^.ty  correlation  diatnbutlons 
and  rnedi'ana  for  specific  ACT  Composite  mean 
rangea  for  the  high  group  of  cbltegea.  The  numbers 
of  colleges  In  the  various  cells  aro  too  small  to  draw 
dftflnitive  coTKlustons,  but  there  </oas/iof  seem  to  be 
substantial  Interaction  between  predictability  ar)d 
ACT  CompoaHa  mean  score  level. 
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r/uui 

ACT  TttI  MwlU^tt  C#ff9lirtlvfw.  vM)  Ovsnl  QI^A    49  NIfh  AMNy 

|I»ACT~ 


ACT  Ciwp  wilt 


Ind9x 


•044 

S6-5« 

50*64 
4S^ 
4(M4 
36-3f 
30^ 
25-2t 


1 
0 
5 
5 
14 
10 
3 
1 
1 


15 
• 

1 
2 


0 
0 
3 

'1 
0 
0 


r- 


T 


T'indtx 

TH- Index 
No.  of 
Coii««« 


46 


40 


56 

40 


47 


14: 


42 


56 

14 


50 

12 


42 

46  52 
4  5  5 


50 


70 
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study  2:  V»IMHy  CbmparlMn  of  ACT  and  SAT  on  8«m«  SHidvnli  «t  S«l«ctlv»  CoM«flM 


Oita  in  'a  study  previously  published  by  L^nntng 
and  Mvcty  (1973)  suggest  that  the  ACT  battery  can 
predict  grades  at  selects  e  colleges  at  least  as  well  as 
the  SAT  battery.  Ali  of  the  ACT  Standard  Research 
Service  records:  for  the  3  years  from  1969  through 
1972  vvere  aeerched.  and  17  colleges  that  had  * 
included  SAT  score$*:af'L6cal  Predictprs  ^n  their 
studfet  were  found.  For  these  i nstltutrori9<  ACT  and 
SAT  data  were  available  for  the  same  students.  It 
was  found  that  ACT  had  decidedly  better  predrction 
than  SAT  at  over  half  of  the  colleges,  but  thet  SAT 
wee  «  definitely  better  predictor. si  only  one  of  the 
colleges. 

Four  of  the  17  colleges  happened  to  be  selective 
>netitutK)ns  (ACT^Composite  mettn,  scores  above 
24.5  and  SAT-Total  means  above  I200}rali  students 
in  each  cot^ge  had  taken  both  ACT  and  SAT,  As 
shown  by  th^  multiply  correletions  given  In  the  two 
nght*hand  columns  of  Table  3.  in  all  four  cases.  ACT 
gave  better  prediction  of  freshman  overall  GPA  (han 
SAT 

Some  of  the  colleges  used  different  tests  for 
selection  Cotiegee  A  and  8  used  ACT.  College  C 
used  SAT:  «ml^Col(^ge  D  used  ACT  «nd  SAT 
(whichever  the  studenftooK  first)  This  is  pertinent 
because  the  test  used  for  selection  will  generally 
yield  a  lower  correfetion  with  a.  criterion  than 
another  equally  good  predictor  available  (Gulliksen. 
1950),  For  this  reeson  the  overeM  results  in  Table  3 
are  conserve tive.  because  If  formulas  for  prior 


TAtLE  3 

ValMfty  Comparison  of  ACT  and  SAT 


ACT  SWT 
Compoelte^  Total 
H     Mean     Mean  ^^ACT  '^SAX 


College  A 

619 

27.4 

1250 

.421 

.307 

College  B 

116 

26.1 

1263 

^25 

.257 

College  0 

299 

25  8 

1212 

,392 

,325 

Conege  0 

\,V59 

24.6 

1206 

.473 

.410 

Median 

.407 

.316 

selection  were  applied,  the  disperity  between  the 
median  ACT  and  SAT  Rs  would  Increase. 

The  only  conclusion  one  can  draw  from  this 
evidence  Is  that  when  the  same  students  at  sefectrve 
colleges  are  tested  with  both  ACT  and  SAT.  ACT  Is 
at  least  as  efficient  a  predictor  as  SAT  and  generally 
la  t}etter>  Of  course,  we  must  remember  that  only 
four  selective  colleges  were  studied,  and  thet  they 
mey  or  may  nof  be  representetive  of  selective 
.colleges  In  general  However,  for  these  four 
colleges,  the  difference  favoring  ACT  was  quite 
large.  •       '  ^ 


Study  3:  VaMMy  Cemperleon  of  ACT  wid  SAT  on  Same  Sludenis  at  e  SelecMve 
InaWulion  wHh  Cerrectlem  Made  fer  SelecMon* 


Sampfee  and  Procedures 

The  study  took  place  at  the  U.S.  Air  Force 
Academy.  Two  different  samples  were  used  for  the 
study:  the  second,  served  as  a  reptlcetion  sample. 
SAT  had  been  required  of  all  entering  cedetc:  but 
tome  had  also  If  ken  the  ACT  Aaeeesment.  A  search 
was  made  of  the  ACT  Aaeesiment  Program  fiiee  to 
determine  which  of  the  freahmen'ln  i9S7-fS  and 
IttS^  had  taken  both  batteriee.  Student  Sample  1 
for  ttm  study  conelated.of  (he  19S7-4S  Air  Force 
Academy  freehmen  who  had  taken  both  the  ACT. 
and  SAT  (n  '  271):  Sample  2  included  the  l9S6-e9 
freshmen  who  had  talten  both  ACT  and  SAT  (n  » 


34a):Sample  1  had  en  ACT  Compoeite  mean  of  27.7 
and  a  SAT  Total  mean  of  1250;  Sample  2  had  an 
ACTCompoeHe  mean  of  27,2  end  a  SAT  Total  mean 
of  1249.  As  an  Indicatfon  oihoyt  academically  able 
these  groups  were,  one  should  Keep  In  mind  that 
national  norma  for  enrolled  freshman  men  have  a 
Compbaile  mean  of  20.4  for  ACT  (The  American 
CoKege  Testing.  Program,  1971,  p,  97)  and  a  Total 
mMn  of  949  for  SAT  (Angoff,  1971.  p.  83). 


Thic  study  >MM'onf]naMy  pvWtthtd  m  ^fratfictioft  ct  a  Hitft»y 
S«(«ct^  InttHutlen  «n*r  Corr«etlon«  H«v«  tttn  M«a«  for 
Sanction-  ACT  vvrtM  SAf  ky  R.  J,  Wf«t«n  and  O  T.  lt\n\nq, 
Cothf  $n¥  Uoh^nfty,  if73. 4e.  H-H.  With  tUfht  rwiilon.  It 
•eeMt  tif     pmmmion  of  th«  |oum«l  •ditor. 
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End  of  frtshm«n  y««r  ov«raU  GPA  wM  th« 
^rittrtonfor  the  study,  Pearton  product 'moment 
correction  coefficients  (r)  were  catculated  between 
ovf  rail  GPA  and  scdres  on  each  battery  subtest.  In 
addltton.  stepwiee  multiple-regresston  analyses 
were  conducted  and  multipJe  correlations  (R) 
computed.  For  each  battery,  the  computer  program 
initially  entered. that  predictor  variable  having  the 
maximum  zero*order  correlation  with  the  criterion 
At  each  succeeding  step,  the  variable  was  alddejfil 
which  produced  the  greatest  reduction  in  the  erfbr 
or  residual  sum  of  squarec  or,  alternatively,  y^/twch 
produced  the  maximum  increase  In 

Because  of  the  selective  entrance  requirements,  it 
waa  assumed  that  the  ot>served  correlations  with 
GPA  would  not  give  good  estfmates  of  the  pre- 
dictive efficiency  of  the  two  batteries.  Increased 
homoganelty  results  in  lower  than  normal 
correlations  which  underattimate  the  predictive 
efficiency.  This  rasult  might  be  expected  for  ACT  as 
well  as  for  SAT  (even  though  SAT  was  used  in 
selection),  considering  the  high  correlation  typically 
found  betv»een  SAT  Total  and  ACT  Composite. 
Therefore,  all  the  predictor  correlations  with  GPA 
were  corrected  for  homogeneity  using  the 
correction  formulas  lor  multivariate  selection 
outlined  by  Gulliksen  ( 1950. pp  t5»-t66)  (Alsosee 
Lord  and  Novick.  196«.  pp,  146-149.)  As  Gulliksen 
noted  (t9M>.  p  t58),  the  equations  for  multivariate 
selection  become  "almost  prohibitively  complex" 
unless  matrix  algebra  is  used.so  matrix  notation  will 
be  used  in  the  remainder  of  this^ik;tion 

Although  selection  to  the  Air  Force  Academy  H 
also  based  on  a  number  of  other  variables  (e.g . 
physical  aptitude,  athletic  activities  index* 
nonathletlc  activities  index),  only  two  explicit- 
selection  variables  viwre  of  concern  for  this  study. 

(a)  SAT  Verbal  plus  CEEB  English  Achievement  and 

(b)  SAT  Quantitative  plus  CEEB  Mathematics 
Achievement.  Three  incidental-selection  variables  . 
were  of  concern  for  correcting  the  SAT  correlations 
with  GPA  (SAT  Verbal.  SAT  Quantitative,  and 
College  Freshman  Overall  GPA);  and  frve  were  of 
concern  for  correcting  the  ACT  correlations  with 
GPA  (ACT  English,  ACT  Mathematics/ ACT  Sofial 
Studies.  ACT  /Natural  Sciences,  and  College 
Freshman  Overall  GPA).  Incidental-selection 
variables  are  Ihoee  variables  of  concern  for  which 
there  is  not  a  specific  cutoff  score  but  for  which  one 
would  expect  homogeneity  to  t>e  affected  becausf 
of  their  sizable  correlations  with  the  explicit- 
selection  variables 

ifXreprseants  the  explicit-seleclton  variables  and 
Y  represents  theincidental-selaction  variables  and  tf 
upper  case  tetters  refer  to  the  applicant  group  while 


lower  case  lettars  refer  to  the  selected  group  of 
students,  the  multivariate-seiection  equation  is 

Cyy  -  Cyy  +  c'vx*^"'}(x^XX*^' xx^xy-<^*yx^*xxSy 
Where: 

Cyx  and  Cxx  ^^fi  varianc^-covariance 
matrices  for  the  explicit-selection  variables,  and 
Cyy  ano  cyy  are  the  vanance-covariance 
matrices  for  the  incidental-selection  variables. 

Standard  devtationa  and  intercorretations  for  all 
explicit  and  incidental  variables  were  calculated. 
The  variar>ces  and  covariances  were,  in  turn, 
computed  from  these  and  substituted  into  the  <bove 
equation.  I  and  the  equation  was  solved.  This 
equation  ^as  solved  separately  for  each  set  of 
incidental  variables' and  for  both  student  samples 
under  study.  The  corrected  correlations  between 
the  predictors  and  the  overall  GPA  were  contained 
in  the  iTMulting  Cyy  matrix.  These  correlations  were 
then  squared  and  multiplied  by  toO  to  give  th^ 
percentages-  of  - criterion  (overall,  GPA)  variance 
accounted  for  by  the  predictors. 


\ 


Results 


Interco^relations.  means,  and  standard  deviations 
for  the  two  study  groups  are  shown  in  Table  4. 
Incidental-variable  data  were  available  only  for  1968- 
69  applicants  Since  it  was  Known  that  the 
academy's  applicant  group  vanes  little  on  these 
variables  from  year  to  year,  these  data  We  re  used  for 
making  calculations  for  both  of  the  study  groups 
The  zero-order  correlation  between  thetwo  explicit- 
selection  variables  for  the  applicant  group  (a  large 
of  which  was  notselectedforadmission)  was^6. 
The  expl»cit-variablemeansand  standard  deviatiqts 
for  the  applicant  group  were  as  follows  \ 


SAT  Verbal  plus  CEEB 
English  Achievement 

SAT  Quantitative  pt  js  CEEB 
Mathematics  Achievement 


Mean     S  0 

1065  7  t65.3 

t2t5  4  t699 


Qne  should  note  how  able  and  homogenaous  the 
two  student  groups  were«  in  comparison  to  the 
applicant  group. 

Table  4'> shows  that  three  'of  the  four  Student 
Sample  t  ACT  subtest  correlations  with  GPA  are 
appreciably  larger  than  both  SAT  subtest 
correlations  with  GPA  For  Student  Sample  2.  all 
four  ACT  correlations  with  GPA  are  larger  than  both 
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lnt«rcorr*totlom,  M««m,  and  Stamtard  OvvUfhm 
'  lor  th*  Two  GroufM  of  Cad«li  / 


/ 

1— 

1 

7 

Sludant 
Sampk  1 

1(tudan 
Saiifpla 

1 

2 

3 

4 

'  1 

• 

• 

f 

'  MaaM 

S.O.'s 

1   SAT-V  ♦  C6EB  Epg.  Ach 

34 

86 

33 

51 

23 

36 

27 

1160.4- 

114  J 

2  SAT-Q CEEB  M«th.  Ach 

32 

29 

91 

50 

*  28 

35 

13415 

119.7 

3  .SATV«rb«l 

87 

29 

30 

27/ 

43 

28 

580  0 

66.6 

4   SAT  Ou«ntitativ« 

31 

86 

28 

17 

27 

29 

670.4 

60.3 

5  ACT  Englii||> 

52 

19 

39 

~20 

41 

35 

24 

23.9 

2.6 

6  ACT  Mathematics 

21 

50 

19 

52 

35 

51 

39 

302 

30 

7  ACT  Social  Stud(«a 

42 

06 

46 

12 

24 

^52 

57 

33 

272 

32 

8  ACT  Natural  Sciances 

39 

22 

43 

24 

33 

32 

28  A 

33 

9  ColtaQ*  Overall  GPA 

16 

29 

20 

22 

24 

33 

28 

30 

2>7 

06 

Student  Sample  2  Maans  1166.613215  587.6  661.3  23.2  29.5  27.0  28  6  27' 
Student  Simple  2  SJ^.'s         1129  110  3  61,4  54.4     2.8    3  0    35     3.6    0  6 


SAT  corraletions  with  GPA  The9«  results  would  be 
expected  to  chenge  after  corrections  lor  selection 
have  been  ma  da. 

Table  5  givea  the  obaarvad  correlations  with  G  PA, 
tha  corrected  corretatton*  with  GPA.  and  the 
adjusted  percentage  of  vananc^  accounted  for  by 
each  predictor.  The  ACT  deta  accounted  for  mo  re  of 
tha  overeli  GPA  veriance  than  did  the  SATdete  for 
both  atudant  samples:  31.8%  versus  27.4%  for 
Student  Sampla  1.  end  26.1%  versus  18.4%  for 
Student  Samp^  2<  Persons  more  interested  in 
predictive '^correletiorta  should  note  that  the 
corrected  mu/fipla  Rs  for  SAT  are  .523  and  .429. 
while  thoaa  (or  ACT  are  .564  end .511  for  Student 
Sampla  1  and  Student  Sample  2,  respectively. 

Also  of  interest  toAlrForceAcedemyofficieisWas 
how  much  tha  CEEB  English  Achievement  end 
Mathematics  Achievement  Test  scores  edded  to  the 
prediction  obteined  with  only  the  SAT  scores. 
OKkmIs  felt  tnst  theaddltlonal  half  day  oftMtmg  for 
each  student  should  add  eppreciabt/  to  the 
predictive  efficiency  of  the  SAT  scores  alone. 


Table  6  gives  observed  correlations  with  GPA. 
corrected  correletions  with  GPA.  and  the  adjusted 
percentage  of  varience  accounted  for  when  the 
CEEB  Achievement  scores  were  edded  as 
predictors  along  with  the  SAT  scorits.  The  edditlon 
of  CEEB  Achievement  scores  f9r  Student  Sample  1 
brought  the  corrected  multiple  H  almost  up  to  the 
corrected  obteined  with  the  ACT  tests.  For 
Student  Sarppla  2.  however,  the  corrected  SAT 
correlation  after  the  achievement  tests  had  been 
edded  as  predictors  was  still  appreciably  below  thet 
for  the  ACT  tests. 


Discussion 

The  results  suggest  thet  ACT  scores  cen  be  at 
least  as  predictive,  and  likely  more  predictive,  of 
gredes  et  highly  setactive  institutions  than  SAT 
scores.  Thts  conclusion  seems  even  more  evident 
when  one  considers  that  data  at  colleges  reported  In 
Mundey's  stud/  (1965}  suggested  the  possibility 
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OkMfv*^  C«rffM«» 
yffiilUr                       wNh  wMh] 

4  %«{0M 
A§s#Miili^ 

)  ^(^) 

/                    OkMTVV^     CWTMIN     %  ,9f  Q^A 

/              C«rrtMten  C«n«Mi«n  VarlMwt 
VMWMt       /                 QM(II«)    QM(%)  ^f•r(ll«l) 

■          -      ^  1 

Sttxhnt  Smpf  1  (N  ■  271)*  j 

SAT  Vtrbil                         .212  .452 

SAT  QuantiWfvc                 M  .4df 

SA.T  Multipit 
RagrtMion  Analytte           .354  .523 

20.4 
22.0 

27.4 

ACTvEngllfll                      .237          .3j0          14.^  , 
ACT  M«trSn«tic»                 .3«7          .503  25.3 
ACT  SoclJl  Studio               .326     -      .441  19.4 
ACT  Natdral  Scl»nc««        ^   .321          v436  19.0 
ACTMuKlpte 

RtgrtStton  Analysis           .444          .564  31.8 

SAT  V«rbal                       .201  .353 

SAT  Quantitativt                 .223  .3M 

SAT  MuHipIt 
R«grMtk>n  i^^nalytis           .2<5  .42t 

125 
15J 

Ua 

ACT  English                      .241          ,357  12.7 
ACT  Msthtmstkis                .327          .444  9.7 
ACT  Social  Studiss              .277          .349          1  2.2 
ACT  Natural  Sciancas           .302          .401  16.1 
ACTMultipIt  ^ 

--fl^grssslon  Analysis           .406          ,511  26.1 

A«rndfC««dmth#'^pi««irtdPfO€*dgf««"*«etionotirUikio<>yS<mpl*Uncfu<»««  •illH7^AirForc#Ac*<J#mylfwhmeo 
*tK>  h«d  UkM  bom  ACT  «nd  SAT  \ot  »<lmiuk>n«  mfK«««.*h«i  S«mpJt  2  locludM  atl  t»M-M  Alf  f  d««  Ac*d#my  ff  whMen  who 
^•d  Mli«n  boih-ACT  <nd  SAT  i<>t  tdmtMlooi  purpoM«.        |  ^ 
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0Wnrm4  CmtaMtm  wMh  OvaraN  QPA«  CarrtclM  'CorrtiiH«m 
wlii'Ovtrsll  O^A,  ani  Ptfctirtift  •!  ttw  CrtltrtM  Vartenc* 
iHt^  Itr  Wlwn  CtU  AoMtvtmmt  TmH  Art  AMm(  to  SAT 


Ohasrvs<  C«rrteM 
C#fvstaClMi  Cwfslill#n 

.mm  wHh 
QfA(ll^  QM(lle) 

%•!  QfA 
Varlanct 

f#r  («ct) 

Pfstflctof 
Vartafcls 

OMarvid 
warravaaan 

Canaclsd 
Canalatlan 

QPA(nc) 

%afQfA 
VartMiaa 
Acaamila^ 

1                             Student  Stmpta  1  ] 

CEEB  EngtttK'Ach, 

.3M.' 

15.1 

r 

CEEB  Mathematics  Ach. 

.34« 

.507 

25.7 

SAT  MuHibit 
®  ^       R«gr«wion  Analytit 

.354 

.523 

27^  , 

i. 

SXTf  CEEB  Ach.TMttt 
Multipto  RagrtMion 
Anaiytit 

.4Q4 

.555 

30.8 

ACT  MuHlpia 
Ragrasslon  Analysis 

f 
1 

i  .444 

-564 

31.6 

* 

Stu<f9nt  5a/np/f  2 

CEEB  English  Ach. 

;  .099 

.275 

7.8 

! 
I 

CEEB  Mathamatics  Ach. 

.215 

AU 

19.2 

SAT  IHultlpIt 
Ragrvsslon  Analysit 

.265 

.429 

18.4 

1 

) 

SAT  *  C£EB  Aoh.  Tasts 
Muitfpit  Rsgrsstlon 
Analysis 

.205 

.4M 

21.7 

/ 

ACT  Multiple 
R^resjlon  Analysis  / 

.406 

.511 

26.1 
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that  ACT  might  more  often  predict  better  then  SAT 
for  women,  and  that  this  study  invofved  only  men.it 
should  be  remembered,  however*  that  this  study 
pertains  only  to  c  le  institution,  an  institution  with  a 
very  specialized  purpose.  Whether  the  sanrie  results 
wopid  occur  at  the  more  prevalent  types  of  selective 
;oHeg?s  and  universities  must  be  determined  by 
similar  research  in  those  types  of  institutiorw. 

Another  important  limitation  of  this  study,  one  , 
which  also  appears  to  be  a  pro^Mern  of  some  of  the 
studies  cited,  should  be  benUoned.  ACT's 
experience  has  been  that  students  who  take  both  the 
ACT  and  the  $AT  tend  to  have  characteristics 
different  from  those  of  students  who  take  omy  the 


battery  thai  is  required.  A  5«mple  cc^^ld  be  selected 
at  random,  and  thoe«'not  submitting  scores  on  the 
s«cond  battery  could  be  lesle^  on  this  battery  on  a 
residual  basis  so  that  *he  sample  wpuld  ^be 
representalrve  of  the  entire  freshman  class.  Th*«%, 
hovwer,  one  wouW  have  the  prol)l€^m  of*a 
difference  in  motivatfon  between  the  testing  for  the 
required  battery  and  that  for  the  battery  no't  required 
for  entrance.  Testing  aj  different  times  for  different 
tests  (e.g..  long  periods  between  the  testing  arid 
testing  occurring  at  dj|ff  rent  times  of  the  day)  may 
pose  other  potential  problems.  It  would  se^mihat  an 
expenmental  design  to  overcome  such  problems  is 
needed. 


CofKhjelorM  from  the  Thite  Studiee 


Each  of  thejStudies  reported  here  contains  certain 
limitations,  and  applicable  limitations  have  been 
noted  in  the  discussions  of  each.  However;  the  bulk 
of  the  evidence  indicates  that  ACT  and  SAT  are  both 
vahd  predictors  at  selective  as  well  as  at  more  typical 
colleges  Where  ACT  and  SAT  do  not  yield  similar 
results.  ACT  «s  usually  favored  with  higher 
correlation  coefficients  Whif  lUs  pematvf  to  sty 
th^t  ACT  ts  g%n%r9lly  more  v^Ud,  tt  is  fattBCious  to 
sff  lh%t  SA  f  '5  99n9nlly  moh  vlfd. 

in  conducting  any  on>campus  study  comparing 
ACT  and  SAT.  s4iect(ve  institutions  should  heed  the 
precautions  pointed  out  in  the  LSree  studies 
presented  here,  it  is  imperative  that  student 


motivation  and  other  testing  conditions  be 
controlled  for  the  jwo  test  batteries  and  that 
corrections  be  made  for  selection. 

Because  both  ACT  and  SAT  generally  have 
adequate  predictive  validity,  predictive  validity 
differences  between  the  twp  battenes  perhaps 
should  not  be  the  factor  determining  which  battery 
Will  be  of  most  value.  Selective  institutions  (as  well 
as  more  typical  colleges  and  universities)  may  judge 
which  of  thetwotestingprogramstouieon  grounds 
other  than  relative  predictive  validity,  such  as 
college  services  provided  by  tho  testing  agency. 
usafulr>ess  to  students,  and  value  in  the  admissions 
process-  / 
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NO  54  Co;/*9aS(adonfAf.9ra/,on,byR  H^Fenske.C  skcotl.&XF  Carmady(NAPSNo  022l5;p.oto  $500  microfK:he 
$150) 

/>,e</<^o/). 0/Por/ormance/n Career ftfucaf^on.  )yM  R  Nov.ck.P  K  Jono5.&N.S  Cok)(»^APSNo  022l6,photo. 
$5  00,  microfiche.  $1  50) 
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No  5«  PMdieton  of  GrtdMtion  trbtjtCott^g*.  by  £  Ntoho(»on  (NAPS  No,  02217.  photo.  $5  00^  mtcrofJCh*.  $1  50) 

No*  57  Schooifflg  snd  Sut>S0qu*nt  S<\#m.  intiu9nc9  ot  At>itity.  Background,  tnd  forma/  Ematton^  by  L  C  Soimoo 
;  (NAPSNo.022l8;photo.$500;iWfof»cbOrSlJ0) 

No  5*  Common  F^IUtcm  *t>oot  h9r9dity\nvironnfnt.  Mnd  Hunan  B#/)#v/Of,  by  A,  An«ta»i  {NAPS  No  02220.  photo. 
$500  -niCfoficht.  $150) 

t40  69  A  Study  ot  m  Coffg*  invsm^nt  Dtcaion.  by  W  McMahoh.  A  A  P  Wtgntr  (NAPS  No  02219.  photo.'$S  00 
microfiche.  $lv50)  \ 

No  «0  tmpfm9nt$tiQn  Of  a  8a/f  s«fi  Systtm  lor  D^ctsion  Analysis  tn  »  Prog  nm  of  tndivfdu»)iy  Pres<fnb4d  h^structton.  by 
R  L-  Ftrguson,  I  M,  R.  Novlcic  (NAPS  No  not  avai!«bi*  at  ihts  lim*  )  i 

No  61  NiUonwKJt  Study  of  Student  C«r««r  D^vtopwnt  Summary  of/?«u/«.*y  D  J  Pff^Jigtr,  J  0  RoUi.  A  B  J  Notth 
(NAPS  No.  not  avaiUble  at  ihrs  (im« ) 

No.  62  varfUm  of  Accompli  ttwnt  Mittr  Coil^g;  P9ntp9ctivs  on  th9  MMntng  of  Academic  Tif9nt  by  L  A  Monday,  A  J 
C  Davs  (NAPS  No.  not  avaitabf#  at  ih{»  tim« ) 

No  63  Pitfrns  ot  Concentration  in  LarQ^  Foundations  Grants  to  US  Collages  and  Unnfrsitias.  by  Colvard.  *A  M 
e«nn«tt  (NAPS  NO.  not  avaifabi*  at  this  itme.) 

No.  64  vocational  Choica  Changa  pattams  of  a  National  Sampia  of  Community-Junior  Zollaga  $tudants.  by  C  S  Scott. 
B  H  F«n$k«/&  E  J.  Maxey  (NAPS  No.  not  avaitabi*  at  ihts  tim» ) 

No  t  ^fdarattons  and  Procedures  tn  National  Norming  An  illustration  Using  the  ACT  Assessment  of  Career 
Detefopment  and  ACT  Career  Pfanning  Program.  GreddsS-n:  by  0  UBaytess.J  W  Berg$ten,L  H.Uw«.&f?.J, 
Noeth  (NAPS  No  not  avail^bl*  at  this  iim*) 

No  66  Jtte  Measurement  ot  Economic  WeiiSemgin  Need  Analysis  Models.by  W  J  Goggm  (NAPS  No  not  available  at  thi$ 
t»ma )  ,  \ 

No  6?  AssetSfng  the  Career  interests  ot  College  Youth.  Summary  otHesearch  and  AppltcatioM.  by  G  R  Hartson  (NAPS 
NO  not  ivailab)«  ai  this  time  )^  ^ 

No  66  Sex-Rofa Socialization  i/^d Employment RealitiesJmpiicattons  for  Vocationeifnterest Measures,  by  D  J  Prcd»ger  * 
N.  S  CoJ*  (NAPS  No.  not  ayaiJable  at  thi»  lima ) 
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AtSTRACT 

This  repor:  investigates  the  validity  ot  prediction  equations  based  on  ACT  t9St  scores  and  high 
school  grade,  it  presents  separate  results  for  prediction  equations  based  on  ACT  test  scores 
only,  on  h>yn  school  grades  only,  and  on  both  kinds  ot  prediction  jointly.  It  also  includes  a 
discussion  ol  the  reiationshtp  between  the  validity  ot  the  prediction  e<^(;ations  and  the  le'^gth  o( 
limc  th<^y  have  been  m  use. 

The  study  is  based  on  data  collected  from  a  random  samplrof  260  colleges  that  participated  in 
the  ACT  Research  Services  from  1972-73  to  ]976-77  Separate  prediction  equations  for«ach 
college  were  calculated  from  data  for  the  years  1972-73, 1973-74. 1974-75.  and  1975-76  These 
pre<}(ction  equations  were  then  appNed  to  data  (rom  1976-77  freshmen,  and  the  predicted  and 
actual  grades  were  compared. 

The  accuracy  of. the  prediction  equations  based  on  ACT  test  scores  and  high  school  grades 
jointly  was  quite  stat^e^over  time  The  mean  absolute  error  ot  prediction  ranged  from  .53  to  .55 
over  the  four  years,  the  proportion  of  students  whose  predicted  grade  was  within  20  o(  Jheir 
earned  grade  ranged  from  .24  to  .25.  and  the  cross-validated  correlation  ranged  from  ,55  to  ,56. 
A  similar-^^tabtlity  was  noted  in  the  accuracy  of  grade  predictions  for  males  and  females 
separately.  ^ 

G/ade^Cfd^ct»ws  based j5niy  op  ^PT  te^t.scorji^^aflfa.sijshtly  smaHf  r  mea«  absolute  error 
than  grade  predictions  based  only  on  high  school  grades,  and  showed  slightly  greater  stability 
over  tint)^  The  mean  absolute  error  of  predictions  based  only  on  test  scores  was  about  .57  for 
the  whole  four-yc^.  penod,  For  predictions  based  only  on  high  school  grades,  the  mean 
absolute  error  ranged  from  57  to  60  over  the  four-year  period,  ^ 

One  can  conclude  that  although  most  colleges  experience  some  change  in  their  students 
academic  abilities,  their  curncula.  or  their  grading  practices  over  a  period  of  lime,  freshman 
grade  average  can  in  most  cases  be  accurately  predicted  using  equations  as  otd  as  four  years,  it 
ts  ACT  policy  that  colleges  update  their  prediction  equations  at  least  every  three  years  (t  they 
are  to  receive  grade  predictions  for  future  applicants.  The  data  from  this  study  suggest  that 
more  frequent  revision  js  not  generally  necessary  In  considering  whether  revision  ot  equations 
IS  necessary  before  the  required  date,  college  researchers  should,  of  course,  determine  whether 
some  change  has  occurred  which  would  necessitate  an  early  revision 
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THE  VAIIDITY  OVER  TIME  OF  COUEGE  F«E8HMAN  GRADE  PREDICTION  EQUATIONS 


Rkh«rd  Sawy«r 
E.  Jamt*  Max«y 


A  prObl«m  commonly  encountered  »n  predictmg 
college  freshman  grades  f'^om  starxJardized  test 
scores  and  high  school  grades  is  the  validity  over 
time  of  the  prediction  equations.  Changes  over  t»me 
m  thejlistnbution  of  ability  among  entering  5tu- 
""dents,  m  a  college  s  entrance  requirements,  in  its 
freshman  curriculum,  and  »n  instructors  grading 
pofitfies  can  be  great  enough  to  make  old  predic- 
tion equations  inaccurate.  Deterioration  of 
the  accuracy  of  grade  predictions  has  obvious 
negative  implications  for  both  colleges  and 
students  On  the  other  hand,  collecting  and 
ceportmg  the  data  needed  to  revise  prediction 
equations  can  tie  expensive  and  time'COnsummg. 
Therefore,  many  college  researchers  would 
naturally  want  to  me  prediction  equations  as. long 
as  possible  before  updating  them 

To  accommodale  the  time  schedules  of  colleges. 
-ACT  updates  its  prediction  equations  each  fall 
using  data  collected  front  students  who  were 
freshmen  m  the  previous  year  Prediction  equations 
are.  therefore,  based  on  freshman  grades  that  arc  at 
least  one  year  old  Because  most  students  who  take 
the  ACT  Assessnr^ent  in  the  fail  of  one  year  wilt  be 
college  freshmen  in  the  fall  of  the  next  year, 
prediction  weights  are  typically  calculated  from 
college  grades  that  are  at  least  two  years  older  ;han 


the  grades  being  predicted  To  minimize  the  error 
from  out-of-date  equations,  ACT  requires  colleges 
to  participate  in  its  predictive  research  services  at 
least  once  every  three  years  If  they  wish  to  continue 
to  receive  grade  predictions  for  future  applicants 
Thu5<  predicted  grades  are  typically  based  on  data 
that  a;e  two  to  four  years  older  than  the  grades 
being  predicted  ^ 

The  primary  purpose  o!  this  report  is  to  document 
the  relationship  between  the  validity  and  the  age  of 
grade  prediction  equations  based  on  ACT  Assess- 
ment test  scores  and  high  school  grades.  A  second 
purpose  1$  to  summarize  the  validity  ol  locally 
developed  grade  prediction  equations  based  on 
ACT  test  scores  only,  oahigh  school  grades  only, 
and  on  Duf-  KMs  of  predictors  lointly  A  third 
purpose  IS  to  suggest  various  techniques  for 
evaluating  local  prediction  equations 

Prediction  equations  were  calculated  for  a 
probability  sample  of  individual  colleges  using  data 
frora  the  years  1 972-73.  1973-74.  l974-75.^nd 
1975-/6.  The  predicted  'grades  from  these 
equations  were  then  compared  with  the  actual 
freshman  grades  earned  in  1976-77  and  the 
comparisons  are  stated  in  terms  that  are  easily 
interpreted  and  used 


Previous  Research 


There  is  roiattvely  little  published  research  on  the 
ratrai  whiCh  predictive  accuracy  declines  over 
lime  Hilis.  Kiock,  and  Bush  it965)  compared  the 
predicted  and  earned  grades  of  students  at  seven 
colleges  m  Georgia  over  a  three-year  period  They 
found  th<it  the  average  correlation  between  the 
predicted  freshman  grade  average  and  the  actual 
grade  average  one  and  two  years  later  was  64  and 
63,  respectively  The  average  correlation  between 
freshman  grade  average  and  predictors  m  the  base 
year  was  67 

'BoAors  and  Loob  (107Z  found  that  in  predictir^ 
grades  lor  U«%hmn  at  i>io  University  of  Illinois,  the 


weights  for  ACT  Composite  scores  were  unstable 
over  a  five-year  period  They  found  that  the  weight 
for  high  school  percentile  rank  as  a  predictor  of 
freshman  grades  was  more  stable 

pcrrin  and  Whitney  j(1976)  studied  the  ACT  scores, 
high  school  grades,  and  freshman  grades  from  a 
national  sample  pi  student  records  They  found 
very  little  difference  in  the  accuracy  of  expectancy 
tables  two  and  three  years  older  than  the  freshman 
grade  expectancies  they  were  predicting. 
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Th«  ACT  AM«t»m«nt  Prpgrtm 


The  ACT  Assessment  Program  is  a  cornpreheosive 
evaluative,  guicfaince.  and  placement  service  for 
students  and  educators  mvoued  in  the  transition  Of 
students  from  high  school  to  college  This  program 
iS  based  on  the  ACT  Assessment,  which  consists  of 
four  academe  tests.  sel{>reported  high  school 
grades,  the  Student  Profile  Section  (SPS).  and  the 
ACT  Interest  Inventory  The  prograrr\  also  includes 
a  number  of  supporting  research  services, 
described  below. 


The  four  academic  tests  of  the  ACT  Assessment 
measure  abthties  'O  the  subject  areas  iradilionalty 
identified  with  college  and  high  schocfl  programs 
Engtishc  mathematics,  social  studies,  and  natural 
sciences  The  English  Usage  Test  measures 
students  understanding  and  use  of  the  basic 
elements  of  correct  and  effective  writing,  the 
Mathen^tics  Usage  Test  measures  their  mathe* 
matical  reasoning  and  problem -solving  ability,  the 
Social  Studies  Reading  Test  measures  the 
problem  solving  skills  required  in  the  social 
studies,  thtf  Natural  &fience  Reading  Test  mca- 
suios'ine  critical  reai,6ning  and  problem-solving 
Skills  required  tn  the  natural  sciences.  The 
arithmetic  average  of  the  scores  on  these  four  tests 
IS  the  ACT  Composite  score,  which  is  often  usedas 
a  measure  of  ovefall  academic  ability.  ACT  test 
scores  are  reported  on  a  standard  scale  that  ranges 
from  1  to  36  More  detailed  descriptive  and 
technical  infcrmajiion  about  ACT  test  scores  can  be 
found  m  the  T%zhmcii  Report  for  ih%  ACT  Asse^s- 
mtnr  P(ogr»m  {t973) 


W^on  students  register  for  the  ACT  Assessment 
Program,  they  report  the  last  grade  received  >n  each 
of  the  four  subject  areas  prior  to  the  senior  year  of 
J^igh  school  The  arithmetic  average  of  these  four 
grades— defined  as  the  high  school  average— pro- 
vides another  measure  of  overall  academic  ability 
Maxey  and  Ormsby  (1971)  investigated  the 
accuracy  Qf  self-reported  higti  school  grades  and  - 
,  found  ihdt  about  78>  of  the  students  reported  their 
grades  correctly,  ' 

Another  component  o!  the  ACT  Assessment 
Program  is  the  Student  Profile  Section  (SPS; 
Through  the  SPS.  students  provide  information 
about  their  background,  extracurricular  accom* 
plishmepts.  specrdi  academic  needs,  housing 
plaiiS.  finanQiat  need  ptaq^ned  major^  and  career 
plans  Students  complete  tt\e  SPS  when  they 
register  for  the  ACT  AsscssmchU^ 

The  ACT  Interest  inventory  measures  students 
preferences  for  jOb-related  activities  in  Six  basic 
mterest  jiimensions  Science,  Creative  Arts,  Social 
Service.  Business-Contact.  Business  Detail,  and 
Technical  Students  complete  the  Interest  inven- 
tory when  they  register  lor  the  ACT  Assessment 

information  from  all  these  sources  the  ACT  tests, 
high  school  grades  SPS.  anU  interest  Inventory  -  is 
uiganized  'nto  individual  Student  Profile  Reports 
sent  to  students  and  colleges  With  the  summary 
information  provided  by  the  Student  Profile  Report, 
students  and  educators  can  rtiake  informed 
decisions  and  plans 


The  ACT  Predictive  Retearch  Services 


ACT  offers  without  charge  to  colleges  two  genera} 
plans  for  predicung  freshman  grades.  Each  plan  is 
designed  to  meet  the  varying  needs  and  resources 
of  college^  which  use  ACT  data 

The  Basic  Research  Service  requires  minimal  effort 
by  a  college  »n  reporting  data.  To  participate  in  the 
Basic  Research^Service.  college  personnel  simply 
mark  on  a  computer-generated  roster  the  overall 
grade  point  averages  of  each  of  their  freshmen  A 
minimum  data  base  of  ICtO  records  is  required 
T^rough  the  Basic  Research  Service^  a  college  can 


obtam  predictions  of  overall  fieshman  grade 
average  based  on  tf)e  lour  ACT  test  scores  and  «he 
high  s(,hool  average.  It  they  have  data  for  at  least 
too  students  of  each  sex  colleges  can  also  obtain 
separate  prediction  equations  for  mates  and 
females,  Ounng  the  1977-78  academic  /ear.  461 
colleges  reported  grades  tor  126.680  freshmen 
through  the  Basic  Research  Service 

The  Standard  Research  Service  .s  designed  for 
colleges  that  want  to  predict  specific  course 
grades,  develop  prediction  equations  fof  sub 
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groups  of  stud«nl».  or  us©  predJCtors  oth«r  th»n 
ACT  test  scores  and  njgh  school  grades  A  large 
variety  of  research  studies  can  be  accommodated 
by  the  Standard  Research  Service  Data  can  be 


supplied  either  throu3h  punched  ctrds.  optically 
scanned  cards*  or: magnetic  tape  Ounng  1977-78, 
185  colleges  reported  for  1$0.998  students 

through  the  Standard  Research  Service 


Data  iM« 


This  Study  »5  based  on  a  cample  from  a  date  base 
consisting  of  student  records  submitted  by  institu- 
tions through  their  participation  in  ACT's  predictive 
lesearch  services.  The  institutions  represerfttd  m 
this  data  btse  partJcipated  in  the  ACT  predictive 
research  services  m  the  academic  year  1976-77  and 
in  one  or  more  o(  the  academic  years  1972-73, 
1973-74.  1974-75.  and  1975-76  Therefore  « 
grades  earned  b/  the  1976*77  freshmen  at  tht,*c 
mslttuttons  were  available  for  comparison  with 
grades  predicted  .from  equations  developed  m  one 
Or  more  of  the  four  preceding  years.  Tf>ere  art  605 
colleges  represented  in  the  data  base 

Because  the  data  'n  the  study  were  collected  from 
colleges  participating  in  ACTs  predicuve  research 
services,  in  some  respects  they  are  not  representa- 
tive of  stOdents  nationally 

•  Colleges  using  the  ACT  Assessment  are  located 
mainly  m  the  Rocky  Mountains.  Great  Plains. 
South.  and.Midwest  With  comparatively  fewer  m 
•the  East/Northeast  and  on  the  West  Coast 

•  Pnvatety  controlled  i/istitutions  are  relatively 
underrepresented  among  colleges  that  us»  the 
ACT  Assossmcnl.and  publicly  controlled  institu- 
tions are  overre presented 

•  Because  participation  in  ACT  s  research  services 
IS  voluntary,  the  data  base  is  self-selected  even 
among  colleges  that  use  the. ACT  Assessment 

*  Program 


The  results  of  the  study  are.  therefore,  not 
npcissanty  representative  of  the  results  that  would 
be  JbUined  if  data  from  all  colleges  in  the  nation 
could  sonwhow  be  collected  One  should  be 
cautious*  therefore,  in  applying  the  results  to 
institutions  which  do  not  us*  the  ACT  Assessment 
or  do  not  participate  rn  ACTS  predictive  research 
services.  Neverthelessf,  the  study  will  suggest  major 
trends  and  extend  knowledge  in  this  area  beyond 
the  results  avaifribfe  to  date. 

To  maximize  the  number  of  colleges  from  which 
data  were  available,  the  variables  used  in  the 
predictions  were  restricted  to  the  following 
specifications  overall  grade  average  as  criterion, 
high  school  grades  and  ACT  scores  as  predictors, 
and  subgroupiQg  on  sex 

Most  ol  the  grade  averages  in  this  study  are  from 
the  first  semester  of  the  freshman  ^  jr  Colleges 
partirjpating  m  some  of  ACT's  research  services  do 
have  the -Option  of  pooling  grades  from  previous 
years  or  reporting  grade  averages  based  on  the 
entire  freshman  year.  ACT  does  not  maintain 
records  of  individual  colleges'^  choice-^ of- criteria. 
However,  from  eximiriing  prodgClion  volumes 
throughout  the  year,  we  estimate  that  over  60S  ol 
the  colleges  in  the  data  base  reported  first  semester 
grades  for  the  current  academic  year,  and  the  rest 
either  reported  first  year  cumulative  grade  averages 
or  pooled  data  from  previous  years 


Sample  Detffn 


To  reduce  the  computational  costs  of  this  study- 
weights  were  calcitlattd  and  prediction  equations 
were  cross-validate^d  on"  a  probability  sample  ol 
records  selected  from  the -above  data  base  The 
sampling  was  carried  out  in  two  stages, 

first,  a  random  sample  ol  260  colleges  was  selected 


from  the  605  colleges  in  the  data  base  Weights 
were  computed  from  all  Student  records  submitted 
by  th'ese  260  institutions  m  the  academic  years 
1972-73.  1973-74.  1974-75  and  1975-76  Observe 
that  not  every  institutiO'  supplied  data  in  every 
year.  The  number  of  colleges  by  year  in  the  data 
base  and  san1f}le  is  displayed  in  Table  l 
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TA8LH  t 

Summary  of  OtU  Umm  anH  Sampit  for  CroM-Vtll4atlon  Study 

Numtorof  Numtoorof  NumtMr  of  studont  Numbtr  of  1»7f-77 

colitfM  in  colttQM  rtcordt  for  student  r«cordt 

Vmt  data  bM«  In  Mmpt«  computfnf  wai^htt  for  croM^vaMtlton 


1972-73 

451 

187 

97.985 

13.732 

1973-74 

4«4 

203 

'  114.331 

15.589 

1974-75 

494 

207 

108J18 

15.412 

1975*76 

520 

211 

109.207 

15.384 

1976-77 

605 

260 

For  tach  colteg«  in  thii  samptt.  a  random 
MibMmpIt  of  the  1976-77  student  rtcords  ^  as  than 
>a>«ctad,  Tha  diffarances  batwean  actual  1976-77 
gradts  and  pradfctions  basad  on  1972*73  aqua- 
tions. 1973-74  aquations,  and  SO  on«  ware  sum- 
marized. Thus  a  cross-validation  was  made  ^prall  of 
the  eqiiaNorM  developed  from  data  tn  the  four  years 
preceding  1976-77 

•At  tha  time  the  study  was  done.  1 976-77 ^f"^' 
were  the  mostf*c«nt  available  for  cross-vai^ating 
prediction  equations  developed  from  earhar  years' 
data.  Computational  costs  prevented  replicating 
the  study  using  earlier  base  years  and  cross- 
validation  years. 

It  was  anticipated  that  the  validity  of  g^de 
pfedictioos  might  vary  according  to  differences  tn 
the  composition  and  affiliation  of  the  coliegtfs.  Qy 
taking  note  of  these  differences  when  desigmng  the 
sample,  it  was  hoped  that  greater  pracist^  in  the 
inferences  might  be  obtained.  In  ttys  study, 
separate  samples  were  selected  frorri  strata  of 
co!!e9t$  determined  by  their  control,  type,  and  size 
The  stratiftc«Uion  variables  wero 


•i  Tho  cofttiol  of  (1  coliogo.  public  or  private 


•  Tbe  /ypa  of  a  collage,  as  determined  by  the 
highest  degree  level  it  offer^^ 

Type  /  Two  vut  less  than  four  years  of  work 
beyond  Grade  l2'>includes  junioc  colleges, 
technical  institutes,  normal  schools 

Type  2:  Only  the  bachelor  s  or  first  professional 
degrae-7tncludes  those  institutions  offering 
courses  ol  study  leading  to  the  customary 
Bachelor  of  Arts  or  Bachelor  of  Science  degree 
and  all  those  degrees  which  entitle  the  possessor 
to  enter  the  profession  indicated. 

Type  3;  Masters  and/or  second  professional 
degree— includes  those  institutions  offering  the 
customary  first  graduate  degree  and  any  degree 
earned  in  the  same  field  after  the  bachelor's  or 
first  professional  degree  This  type  of  institution 
does  not  offer  the  Doctor  of  Philosophy  or 
equivalent  degrees. 

Type  4.  Doctor  of  Phildsophy  and  equivalent 
degraeS'-'fnctudes  those  institutions  which  are 
considered  universities 

•  Tf)e  SIZ9  stratum  for  a  collage,  as  determined  by 
tho  number  of  students  for  which  th^  college 
reported  1976-77  freshman  grades 
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Citvifor/     100  sludtnts  or  fewer 

dfgory  2:  101-200  students 

C«f«9ory  3/  201-500  students 

C»fgor/  4: 501-1000  students 

Cifgor/5'  lOOJ*  students 

Coiitges  do  have  the  optton  of  repomrig  griides  lor 
a  sample  of  their  freshman  class,  proyjded  the 
satppte  size  is  100  or  larger  Moreover,  colleges  can 
pool  data  from  previous  years  in  order  lo  attain  the 
required  minimum  sample  size  Therefore,  the  size 
measure  in  this  atudy  is  not  necessarily  the  same  es 
totai  fresnrnan  class  s»ze.  However,  for  about  70S 
of  the  institutions,  the  number  of  records  m  the  data 
base  IS  within  00%  of  the  estimated  freshman 
enrollment 

The  subiaropling  rates  for  1976'77  records  were  a 
function  of  the  size  strat'a  for  the  college  sample 


These  subsampling  rates  and  the  number  of 
colleges  selected  from  each  size  stratum  are 
iiisplayed  in  Table  2.  ^ 

>> 

these  sample  sizes -w^re  chosen  to  yield  a  95S 
Chance  that  the  mean  absolute  error  (defined 
below)  estimated  frofr>  the  sample  would  be  within 
tn©  lollovying  limits  of  the  mean  absolute  error 
computed  from  all  records  in  the  data  base 

•  tot  grade  units  of  the  mean  absolute  error  of  all 
students  in  ail  colleges. 

•  £  .03  grade  units  of  the  mean  absolute  error  for 
all  students  in  each  size  stratum 

'The  second  condition  was  imposed  to  permit  the 
use  of  the  sample  to  study  the  effects  of  college  size 
on  predictive  accuracy  (results  not  reported  here) 
Examination  of  the  sampling  variances  estimated 
Vrom  the  data  indicated  that  these  precisions  ware 
attami^''  . 


TABLE  2 

Strellflcation  and  Su^MmplInf  for  the  Crots-Vetldatlon  Study  Semple 
by  Si2e  Stretum 


sue 
alretum 


Number  of  co4lege« 
In  dete  bate 


Number  of  cdfefet 
In  sample 


Subtempilng  rate 
for  l97i-77  recj 


too  or  fewer 

47 

33 

101-200 

221 

76 

201-500 

202 

{63 

501-1000 

70 

44 

Over  1000 

65  . 

Total 

605 

260 

1/2 
1/4 
V4 
1/6 
1/16 
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Frtdktion  Ec|u«l)orM 


Prediction  equations  were  calculated  from  the 
1972-73.  1973-74:1974-75.  and  1975-76  data  us>ng 
a  standar<tktour>variable  multiptt  ^inear  regression 
of  college  ((tshm^n  grade  average'on  the  four  ACT 
test  idojes 

y  *  a*  \ 

tai  "  ACT  English  score 

♦Bj  •  ACT  Mathematics  score 

^aj  '  ACT  Social  Studies  score 

-^ii  '  ACT  Natural  Science  score 

where  ao.  a>.  aj.  and  a^  are  regression  weights 
calculated  from  the  Base  year"^JSta,  In  the  ACT 
Standard  Research  Service  this  prediction  is  called 
the  T.lndex. 

Fredicttoif  equations  were^also  calculated  usin^ 

«  tho  four  selt«reported  high  school  grades  only  ^n 
a  multiple  linear  regression  equation  (H  index). 

•  the  aveYage  o!  the  T  Index  and  H  Index  (the  TH 
Index)  t 


•  the  four  ACT  test  scores  and  the  four  high  school 
grades  in  ah  eight*variable  multiple  linear 
regression  equation. 

Past  research  has  shown  that  the  correlation 
between  the  TH  Index  and  freshman  college  grade 
average  I's  only  slightly  less  than  that  fdr  the 
traditional  eight* variable  multiple  linear  regression 
equation'(^ec^io/<ca^/?epor^  /or  r/ie  ACT  AS-t^ss- 
/nenf  Wopram.  1973), 


Prej^idus 'research  also  suggests  that  the  relation* 
ship  between  high  school  grades,  standardized  test 
score{,  and  freshman  grade  average  differs  ior 
males  land  females  (fechn/ca/  fleporf  /or  f/je  ^Cf 
Assessment  Prbgt%m.  1973).  Moreover,  colleges 
often  elect  to  receive  separate  predictions  by  sex 
For  tties^  reasons,  prediction  equation^  were 
calculated  separately  for  males  and  females  in  each 
college!  as  wejl  as  for  ail  students  in  %  college. 

Some  colleges  m  the  sample  submitted  student 
grade  (^ta  without  identifying  the  sex  of  their 
student^  Therefore,  the  sum  of  the  number  of 
males  and  females  from  which  the  separale-sex 
equations  were  computed  is  less  than  the  total- 
number  of  records  from  which  the  combined*sex 
equatioris  were  computed. 


Crots-Validation  Stetlttlct 


The  difference,  between  ihft  predicted  and  actual 
1976^77  grade  average  for  a  student  is  called  the 
error  of  prediction  The  magnitude  of  this  error, 
ignoring  the  direction,  is  called  the  absolute  error 
of  predicUon  If  the  absolute  error  of  prediction  is 
averagedlbver  a  group  of  students  (for  example,  all 
the  students  in  a. college),  the  resulting  number  is 
called  the  mean  absolute  error  (MAH)  of  prediction 
in  that  group  of  students  This  statistic  has  an 
immediate  relevance  to  the  quality ,  of  grade 
predictions.  For  example,  if  the  MAH  in  predicting 
grade  average  in  a  college  is  45.  then,  on  the^ 
average,  there  ^s  an  absolute  discrepancy  of  45 
grade  units  between  the  predicted  and  actual  grade 
averages  in  the  college  '  ^ 

A  related  measure  Of  prediction  quality  that  is 
sometimes  used  is  the  mean  squared  error>  wh>ch  is 
the  average  over  a  group  of  students  of  ihe  squared 


erro/  of  prediction  It  is  actually  this  quantity  that 
the  usual  teast'squares  regression  methodsrseek  to 
minimize.  Because  the  mea^n  squared  error  is  te>s 
directly  mterpretable  in  practical  terms  than  the 
MAH.  It  was  not  used  here. 

Another  useful  measure  of  the  quality  «( prediction 
for  a  group  of  students  is  the  proportion  whose 
predicted  ardde  is  within  a  certain  range  of  the 
actual  graau.  In  this  study  we  report  the  proportion 
ot  students  whose  predicted  grade  average^  is 
within  0  20  grade  units  of  actual  grade  average;  this 
proportion  wilt  be  denoted  by  the  abbreviati'or^P20 
An  absolute  error  of  0.20  grade  units  represents  a 
high  degr^of  accuracy  in  prediction.  The  statistic 
P20,  therefore,  measures  the  proportion  ot  students 

for  whom  extremely  accurate  grade- ptedictiool  ^ 

were  possible  Some  researchers  may  consider 
prediction  errors  lar{jer  than  0  20  to  be  quite 
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accWabTft  ^jrwiogous  pro poM ions  iiuch  a^  \t\e 
proQortion st^idents  wrjo$«  pfuoiqteU  grade 
av«rW  (S  withm  0  50  grade  units  o(  iho  actual 
gradepoint  average)  couid  be  compute,  for  them 

Probaotiy  the  ^no5t  commonly  used  measure  ol 
predicttye  efficiency  is  cross»vaiidatcd  r.  that  <$. 
the  Pearson  cor/e'auon  between  the  ►  predicted 
— itmi-tK^W-  grades  Generally  this  coefficient 
IS  compared  with  the  correlation  coeff»c*em- 
caicolatea  from  the  base  year-x^at-uo  gjvean  i/)di« 
cation  ol\  tho  accuracy  and  stability  of  the 
prediction  rauaKons  Because  it  \s  so  widely  used, 
this  staitstiAis  reoorted  m  addition  to  MAE  and  P20  . 

A  limitation \o(  this  statistic  is  illustrated  by  Ihe 
hypothetical  }^ata  m  Figures  la  and  lb.  These  plots 
suggest  that  \atse  conclusions  could  result  from 
using  croSs-vilidated  (  asU)e^saij-infa»tmj-of 
prediction  quahlyHln^Tf  c«se$7cKiss-vafic*at^  r 


IS  near  1  yet  in  both  cases  the  prediction  ts  not  very  ' 
good  Tn  the  f'-5l  instance,  the  predicted  grade5«;e  ' 
consistently  :po  low.  In  tjfje  second  tljey  ;<re 
systematically  (00  lOwTor  low-rankirtg  stude9('s  and 
too  bich-for-Kigh-rankmg  students.  Thus./ja  farge 
crosS'validated  t  d  es  not  guarantee  su^ccess  m 
prediction,  ^  low  value  of  cross-vaiidatedV  v»/iH  indi- 
cate poor  prediction,  hpwever^  because'  if  the 
predicted  and  actual  grades  have  httle  lineal 
relationship,  they  cannot  be  very  close  to  each 
other  '  '  , 

A  justification  sometimes  advanced.  JoV  the 
correlation  coefficient  is  that  f  measures  the, 
proportional  decrease  m  squared  error  from 
which,  would  result  <?  Ihe  mean  grade  were 
predicted  for  each  student  Similarly^  r  taKes  into 
iiccbunt  the  effect  on  prediction  duo  to  the  inherent 
variability  of  students  grades  ^  ^ 


/ 


/ 

/ 


V./N 


Y    Y  / 


Predicted  grade  ^^verage  7 
\ 


/ 


•  •  / 
. «  •  / 

/ 


Prodicted.grado  average  1 


Figure  1.  Two  situations  m^which^ross-validaiL-u  *  gives  a  false  mdication  of  prediction  qunlify 
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Cont^tation* 


Th*  prediction  equations  ,and  cross- validation 
/siatisttbs  tor  e^h  cotleQe  were  computed  by  a 
custom  program  using  liy  IMSL  sulproutme 
packaoe  (JMSU.  l977).  The  program  was  tested  on|^ 
data  from  three  colteges  over  a  three-year  period  11 
Every  tomputation  on  these  data  was  compared 
with  bne  obtained  from  the  SPSS  statistical 
package  (Nie««  HaiU  Jenkins.  Steinbrenner^  and 
BfenL  1975)  and.  where  feasible,  with  one 


computed  by  hand  In  att  cases,  t^ie  cross- 
validatidn  statistics  for  .each  college  were  within 
t  ,001  of  each  other,  and  in  a  majority  of  cases  they 
were  Within  t  0001 

Tne  cross-validation  statistics  fro'm^each  college^ 
were  sum  ma  rtzed^th  rough  SPSS  f  outvies.  The  dat^ 
were  w^'ghted  to  take  into  acco^unt  the  differentfaf 
sampling  rates  in  the  various  strata 


The  results  of  the  analyses  are  displayed  m  Tables 
3a-3d.  4a'4d.  5.  and  6  They  indicate  that  for 
students  as  a  whole  ((rrespective  of  their  college), 
the-  accuracy  of  ail  four  kinds  of  prediction 
^equations  was  quife  stable  oyer  ihe- tour^year 
period  studied  The  same  is  generally  true  of  the 
accuracy  of  the  prediction  equations  for  co//eges, 
although  a  few  individual  colleges  do  show  some 
lOsiatjility 

Tables  3a-dd  disptay.t he  cross- validation  statistics 
for  aii  students  in  the  sample.  Over  the  four  year 


I 

penod.  there  is  np  marked  increase  or  decrease  if) 
any  of  the  three  stati->cs  for  the  four  kirlds  of 
predictions  For  the  t  Index.  ME  for  the  total 
group  of  students  is  about  ^7.  P0)  is  22-  23.  ind  r 
^s  4S-  49.  For  the  H  Index,  there  is  slightly  more 
deterioration  over  time  MAE  ranges  frpm  ^7«  60^ 
ip20  from  .21  -  23.  and  /  from'  ,49-  51  The  TH  Index 
predictions  have  an  fy^AE  of  54-  55.  a  P20  of  *23-.24, 
'and  an  r  of  .55-.56.  The  eight -van able  regression 
equations  showed  virtually  the  same  results;  MAE 
from  53-.55.  P20  from  24-  25.  and  r  frpm  55-.56, 


TABljE^  ^  '  I 

Accuracy  of  Prediction  of  1t7»-77  tM^t  Ore^  Average 
from  Equations  Oevefopod  in  Years  1972-73  throuffh  1975-7« 

,  (T  Index— ACT, Test  Sfcoree  Only) 


Group 


Total  group 


Mates  1 


Formates  < 


C  roes*  validation 


Year  in  which  pftdiction  equation  wat  daveloM^ 


statistic 

1972-73, 

1973-74 

1974-75 

1975-76 

MAE 

57 

57  ^ 

.57 

.57 

'P20 

.23 

.22r  ' 

.23 

,23 

r 

.4S 

48 

,49 

.49 

MAE 

.61 

.61 

.60 

.61 

P20 

21 

.20 

21 

.21 

r 

.43 

.43 

.43 

,43 

MAE  i 

.56 

-55 

,55 

>55 

P20 

.24 

.25 

.23 

r 

53 

.50  . 

51  . 

.51 

752 


91-170   4« 


Total  ^roup 


Males 
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TABLE  Ob- 
Accuracy  o«  ^t^dlctkm  of  If 71-77  Studtnt  Grack  Avarag* 
from  E^Hm  Diftaloftd  Jo  Yaait  1t72.73  Ihroogh  1t75.7» 

(H  Indax— High  School  Gfdt  Only) 


Crott'^alWatkm 
'  $latbtic 


MAE 

P20 


MAE 

P20 


MAE 
P20 


YMr  In  which  prtdCctioh  aquation  w—  dwtlopaj 


1972-73 

/  ■  - 


1973-74 


1974-75 


,60 

59  _ 

.57 

21 

.23 

22 

.49 

.49 

.50 

.62 

.61 

.60 

,21 

.20  - 

.22 

46 

.46 

.46 

57 

55 

.24 

.23 

,  .24 

50 

.  ^3 

*  ,54 

197S.76 


57 

.b 

I" 
1.60 
.21 
.4S 

^4 


TABLE  3c 


GroMp 


Total  group 


Males 


Fttmfiles 


At^acy  of  Prtdlctlon  of  1971-77  Studant  Orada  Avarafa 
from  Equations  Dtvolof«l  In  Ytara  1172-73  throufh  1f75-7f 

(TH  Index) 


Crosa-valldatlon 
»latl$tic 


MAE 

P20 

r 

MAE 
P20 
r 

MAE 
P20 
f 


Ytaf  In  which  pra<llctl#n  aquation  Wat  dtvtloptd 

1972-73  1973-74 


1974-75 


1976-76 


55 

.55 

.54  1 

.54 

23 

.23 

.24  j 

55 

is 

.56  1 

-56 

.59 

,59 

.57 

.5« 

.22 

22 

23 

i 

50 

?50' 

50  s 

1  ,51 

.53 

.52 

.52 

u. 

,24 

24 

26 

|25 

St 

58 

.59 

1^59 

75.3 
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Accuracy  of  P  fjkMon  of  1t7i<77  StudMl  Grad*  Av#rt«« 
from  Equ<Howf.5<v»iop<d  in  YMrt  1172-73  throuf h  1^75-71 

(Eigf^'*Variab(e  Multiple  Linear  Regression)  ! 


Grouip 


CroM-vtlktotion 
ttitistic 


Yttr  irt  whteh  pfdicltori  »<|utlon  wt»  dtvefoped 

1972*73  t973'74    !      1974-75  1  975-Z6 


Toiaf  groop 


Males 


Females 


MAE 

P20 


MAE 

P20 


MAE 

P20 


55 

55 

59 
22 
SO 

53 
24 
57 


54 
.24 

.55 

59 

23  / 
.50  /' 

^52  / 

.25/ 

57/ 


.25 

is 

^.23 
50 

5t 

j;6. 

59 


.54 
24 

56 

,58 
23 
,51 

51 

25 
59 


The  T  tndex  predictions  were  somewhat  more 
stabtt  o\f)f  time  than  the  H  index  predictions  The 
reasons  'or  thts  cannot  be  easily  deterrnined.  but 
cou!d  be  related  to  changes  in  high  school 
curricutum  or  inflation  tn  high  school  grades. 

Although  the  H  index  r's  are  stightly  but  constantly 
r^er  than  the  1  index  r's,  the  statisli^  MAE  and 
irKiicate  that,  on  the  average,  the  T  Inde;^ 
resolted  in  slightly  better  predictions  than  did  the  H 
fndex  That  th^Htn^txr  is  larger  than  the  Tirwlexr 
IS  consistent  with  oarJier  published  research  {ACT 
UcfinjCQf  n9p0ft,  1973)  The  rosuUs  for  MAE  and 
P20.  however,  suggest  that  vomethirig  liXe  'the 
situation  Illustrated  in  f^igures  la  and  tb  occurred 
m  noany-of  lh«^colleges< 


Further  examina1it>}V*  of  the  prediction  errors 
revealed  that  the  H  index  predictions  based  on  the 
1972-73.  1973-74. 1974-75. and  I975«76data  under- 
estimated the  criterion  on  the  average  by  .14,  lO. 
04,  and  less  than  Ol.  respectively  The  T  index 
.predictions  based  on  data  from  these  four  y*^ars 
often  overestimated  the  criterion,  but  by  ah  average 
ofonty  05.  05.  OS.and  03<  respectively  Thus,th> 
index  tended  to  underestimate  the  cntorion,  and 


/  / 

'   •  / 

/ 

the  amount  ^f  underestimation  increased  with  the 
age  of  the  p/ediction  equation  The  T  index  tended 
to  overestimate  the  cnterion.  but  by  a  fairly 
constant  a/id  small  arnount  over  tinie 

Prediction  equations  developed  for  males  and 
females  separately  show  the  same  stability  m 
quality  as  the  total  group  equations  The 
predictions  for  females  Wore  somewhat  more 
accurate  (eight-variable  multiple  regression  MA& 
51-53,  P20  -  2V 26.  r  -  57-  59)  than  the  predic- 
tions lor  mates  (eight-variabte  multiple  regression 
^jsTe*  5^-59.  P20'  .22  23.'-  50-51f  This  result 
IS  consistent  with  earlier  analyses  ol  /^O^  grade 
predictions  {ACT  rech/r/ca/  Report  1973) 


It  should  be  noted  tha'  these  resutiS  pertain  to 
separate-sex  prediction  equations,  rather  than  to  a 
total  group  equation  The  cross-validation  results 
/or  predictions  madd  from  combmed  sex  equp- 
tions.  however,  are  virtually  identical  to  those 
for  predictions  made  from  the  separate-sex 
equation's  This  yvouid  indicate  that  there  is  tittle 
average  benefit  m  developing  separate-sex 
equations^ 
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Tabt«5  4a'4<}  display  th*  colftgv  m«dl«r>»  of  th« 

cross-validatjon  statistics.  The'  rfumbfc/s  m  this 
table  show  that  measures  of  pradtcttoft  quality  for 
studants  across  ail  cotlagas  are  also  typiqal  of  the 


maasurasl  of  prediction  quality  for  jndividu*' 
colleges.  jTha  same  stability  tn  prediction  qi.-<Iity 
over  the  four  years  is  evident 


Croea-vatklal{fn 
atatiatic  ' 


TABLEN^a 

IMMttan  Cottage  Croaa<Va)i;lalk>n  Statialica  for|Pr»d]cUon  Equations 
0#v^io9eid  from  Data  »n  Ye«:a\lt72-73  ihhMifh  1t7S-7t 
fndex-ACT  Test  Scores  On\yl^ 


redldton  equatton  was  de¥e<oped 


1974'75 


1975-76 


.55 
.22 
.48 

.60 
.20 
,44 

53" 
24 

.53 


.55 
,22 
At 

,60 
.20 
.42 


"54- 
.23, 
51 


TABLE  4b    -  I 

Median  College  Croaa-Validallon  Statistics  for  Predic|lon  Equations 
Developed  from'Oataln  Yaars-lf72-T3  tt>roug»f  1f75-7i 

(H  lndex*-H(gh  Schcwl  Grades  Only)  ^  _ 


Group 


Xrdss<  validation 
statistic 


Year  In  which  prediction  equation  was  developed 


1972-73 


1973-74 


1974-75 


,1975-76 


Total  group 


V.  Males 


Fomales 


MAE  . 

58 

60 

54 

P20 

•   -  .21 

f 

.23 

r 

48 

50 

.49 

50 

MAE 

.60 

^2 

.59 

.59 

P20 

.20 

.21 

.22 

r 

X  45 

47 

45 

48 

MAE 

57 

54 

53 

i\  53 

P20 

^  il 

,22 

24 

23 

7 

54 

53  ~  • 

54 

.55 

755 


\ 
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\  '        '  ^'  ■TABLe4c 

M«<«an  C6Mt9e  CroM-Vaildatlon  Sutlatict  for  Prtdlciloh  Equation* 
09v^lop*d  from  Oal*  {n  Y^art  1972-73  ihiouf  h  1975-76 

,  (TH  lodex) 


Group 

Crofs*  validation 
ttiiUstic 

Year  in  whkh  prediction  equation  was  developed 

1972-73 

1973-74 

1974-75 

1975-76 

Total  group 

MAE 

^3 

^4 

> 

52 

52 

P20 

24 

.23 

24 

24 

r 

^5 

^6 

56 

.56 

Males 

MAE  ^ 

56 

^  59 

w 

,56 

P20* 

P2 

21 

'^3 

23 

r 

S4 

54 

,55 

females 

MAE 

52 

51 

50 

50 

P20 

24 

.24 

25 

24 

f 

58 

60 

.60  

.59' - 

TABLE  4d 

Median  Cotlege  Croas-Validation  Statistics  for  Prediction  ^uadons 
Developed  from  Data  In  Ye»rs  1972-73  through  1975-76 

(£ighl'VariabIe  Multiple  Linear  Regression) 


Males 


Females 


Cross-validation 
atalislic 


Year  In  which  prediction  equation  ¥>fas  developed 

1972-73  1973-74  1974-75  1975-76 


MAE 

53 

53 

,52 

.51 

P2a 

24 

24 

25 

.25 

r 

54 

.55 

.  56 

56 

MAE 

57 

60 

56 

P20 

.21 

.21 

.21 

,23 

f 

.52 

51 

-  ,51 

>5l 

u  MAE 

52 

^1 

^  50 

.52 

P20 

.25 

25 

26 

,25 

r 

57 

57 

•59 

5« 
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Tab46  5  presents  a  fiequtncy  distii button  ol  MAE 
for  the  ♦Jght-vanaWe  regression  amof>3. colleges 
(or  the  four  years  stiKlied.  For  about  7Z^78'%  of  the 
colleges,  the  MAE  ts  0  60  or  less^  Thus,  the  MAE 
reported  m  Tabie  3d  for  students  c  u  a\\  colleges  ts 
tairly  typ(C«}  of  ihe.MAEs  m  most  coltegta  mdf 
vtduaily  for  a  small  proportion  (2V4%)  of 
coi!C9es<  MAEs  in  the  range  0  80- 1  JO  occurred 

The  relative  stability  of  the  quality  of  predictions 
over  alt  students  and  colleges  could  mask 
instability  tn  particular  colleges  Table  6<  which 
addresses  this  tfsue.  is  a  freouency  distribution  of 
the  differences  teiwcen  MAE  for  eight-variable 
rnulttpte  regress'jh  equations  developed  in  t975-76 
and  MAE  for  the  equations  developed  in  1974-75. 


f 

1973-  74,  and  1972-73  The  results  Indicate  that  for 
most  colleges.  MAE  is  quite  stable  ^rom  year  to 
/ear  The  number  of  colleges  with  a  larg^jr  MAE 
from  t974-75  prediction  equations  than  from  1975- 
76  prediction  equations  is  approximately  the  same 
as  the  number  c!  colleges  with  a  smaller  MAE  from 

1974-  /5  prediction  equations  than  from  1975*76 
equations.  Moreover^  about  99%  of  the  differences 
mMAE  are  in  the  range  -.10  to  *  10,  Slightly  more 
colleges  have  a  larger  MAE  from  equations 
developed  in  1974-75.  1973-74.  or  J  972-73  than 

1975-  76.  but  the  differences  in  MAE  are  concen- 
trated jn  the  range  of  10  to  GO.  In  summary,  the 
MAE  for  over  90%  of  the  colleges  remains  stable. 
Oven  over  a  period  of  four  years 


TABLE  5 

Proportion  of  Colleges  with  Various  B«nge»  ol  Mean  Absolute  Error 
In  Predicting  1976-77  Freshman  Grade  Point  Average 

(BiQht^variabte  Multiple  Linear  Regression) 


Year  in  which  prtdlc}|on  equation  was  developed 

Mange  In  MAE        '  ^972-73  1973-74  1974-75  1975-76 


00-01 
0  1-02 

02-  03  A 

03-  04 

04-  05 

05-  06 

06-  07 

07-  08 

08-  09 

09-  10 
10  -  n 


GO 

00 

00 

00 

GO 

00 

00 

.00 

00 

00 

00 

00 

07 

08 

J2 

09 

31 

31 

29 

36* 

34 

34 

,37 

33 

18 

2t 

:i$ 

13 

09 

05 

06 

05 

02 

02 

01 

02 

00 

00 

00 

01 

00 

CO 

00 

Ot 
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%•    ,  .  -       '    TABL&e-  ' 

SUbiiity  of  MMn  Abtolutt  Error  «cro«»  Four  Ytart: 
Proportion*  of  Coil«9et  with  Various  OifftrtnCM  in  MAE  from 
t975<7S  Equation*  and  MAE  from  Equation*  Dtvtloptd  In  Earlier  Ytars 

(Eight-Vanabid  Mutttple  Linear  Regression) 


Ranga  of  diffcftnca  ki  IMAE 
from  ISTS'ZS  aquation*  and 
MAE  from  oldar  aquation 


Earliar  yaajT  In  which  prediction  waa  davaiopad 


1972-73 


1973'74 


1974-75 


0  50  to  -0.40 

00 

.00 

.00 

040  to -030 

00 

.00 

.00 

030  to  -020 

00 

,00 

,00 

020  to -010 

06 

03 

01 

0  10  to  000 

63 

69 

.55 

000  to  010 

30 

>2« 

44 

0  10  to  0  20 

GO 

00 

00 

020  to  030 

01 

00 

;  •  01 

030  to  040 

00 

01 

00 

040  to  0  50 

00, 

00 

00 

050IO  oeo 

.00 

00 

.00 

Surnniary  and  ConclUalona 


The  »t<iDi>ity  K)\  ^nojict'oii  t't^uations  t>3$ed  on  ACT 
»gores  ^nd  high  s(,lwoi  grades  was  investigated  for 
4  Mtatiticd  fandum  5<impte  o\  ^60  couegf^s  that 
P^iftiupated  \x\  the  ACT  {Research  Services  dunng 
the  penod  ol  J972  73  to  1976-77  Separate 
prediction  equations  foi  each  cotlego  ware 
calculated  from  data  for  the  years  1972-73. 1973-74 
1974-75.  and  1975-76  and  applted  to  1976-77 
/reshmer»  Prediction  errors  for  1 976-77  grade 
averages wero  then  summanzed 

The  rosuUs  indicate  that  tor  most  students  and 
<,oJieges,  the  cjuahty  ^f  the  prodiotior  equations  is 
«)U)to  5tabte  over  the  four  >  ears  The  mean  absolute 
error  <ol  prediction  osmx^  iXi  ftght-vatjabte  multiple 
jegrossic^n  equation  ranged  trom  33  to  35.Uie  pro- 
yi.iiton  of  5twdOr»;^  wf  c^**.*  (predicted  grade  was 
within  20  or  theii  eanieU  9tade  ranged  iioin  ^4  <o 
<25.  and  the  cross-vahdated  correlation  ranged 
from  55  to  56  A  similar  stability  was  noted  in  the 
accuracy  of  predictions  for  males  and  females 
usmg  &cparatC'Se)(  prediction  equations 

uiddo  Mcdioliurw  based  on  lest  scures  unly  had  a 
sfightty  STialfer  mean  absolute  error  than  grade 


piedictions  basea  oahigh  school  grades  only  and 
showed  slightly  greater  stability  over  time.  The 
mean  absolute  error  of  predictions  based  on  fast 
6u;rcs  only  was  about  57  lor  the  whole  four  year 
penod  For  predictions  based  on  high  school 
grades  only,  it  ranged  from  ^7  to  60  over  the  four 
year  period 

One  can  conclude  from  this  study  that  although 
most  colleges  experience  sbme  change  m  their 
student'  academic  abilities,  their  curricula,  or 
grading  practices  over  a  period  of  time,  freshman 
grade  average  can  m  most  cases  be  accuiatciy 
predicted  using  equations  which  f>ave  been  m  use 
for  as  long  as  four  years.  It  is  ACTs  p^ltcy  that 
.  colleges  update  their  prediction  equations  at  least 
every  three  years  iK  they  are  to  receive  grade 
prcJicti-'f^  fur  'ot4.rc  app'iod.nts  { .n;  rtdta  from  ih's 
study  suogest  that  more  frequent  revision  is  not 
generally  necessary,  in  considering  whether 
revision  of  equations  is  necessary  before  the 
required  date,  college  resear^rs  should,  of 
course,  determine  whether  sdmo  change  has 
uccui  red  which  wuuid  necesbilata  an  early  revision 
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Mr,  Weiss.  What  kind  of  request  form  do  you  have  for  the  test 
takers  if  they  want  to  get  copies  of  the  answer  sheet  or  results  or 
the  test  questions? 

Dr.  Rever.  In  New  York,  we  provide  a  special  insert  to  our  ex- 
amination and  students  are  informed  about  the  procedures  for  ob- 
taining copies  of  the  examination.  We  have  recently  changed  the 
procedures  so  that  there  is  an  order  blank  on  that  special  insert 
that  can  be.com'pleted  and  returned  to  Iowa  City.  We  would  antici- 
pate as  a  result  of  that,  indeefd,  we  will  receive  increased  percent- 
age of  students  who  request  copies  of  the  ACT  assessment.  Howev- 
er, at  the  very,  very  low  rate  in  which  we  have  received'  rates,  that 
increase  would  have*to  be  magnified  many,  many  times  over  to  get 
a  rate  of  request  for  materials  comparable  to  that  of  the  college 
boards  or  the  one  that  its  

^Mf.  Weiss.  Can  that  order  form  be  simply  a  request  form—be  in- 
cluded with  the  test  when  the  test  taker  comjiletes  it  or.  does  it 
have  to  be  separately  taken  and  mailed  once  the  test  taker  leaves 
the  examination  room? 

Dr.  Rever.  I  believe  the  question  you're  asking  is,  is  that  a  part 
of  the  standard  registration  document  that  students  submit  to  tis  to 
register  for  the  examination.  No,  it  is  not.  It  is  separate  docu- 
ment that  would  be  submitted  separately.- 

Mr.  Weiss.  t*r  is  it  a  document  that  in  fact  is  part  of  the  exami* 
nation  packet  itself,  that  when   ♦ 

Dr.  Rever.  Right. 

Mr.  Weiss.  A  person  takes  the  examination  can  simply  fill  out 
the  form  and  send— and  hand  it  in  with  the  test  that  he  or  she  is 
taking?^ 

Dr.  Rever.  That's  possible  though  under  our  current  proce- 
dures—well, all  I'm  saying,  we  do  not  do  ^  that.  In  other  words, 
when  a  student  sits  for  the  examination,  we  do  not  provide  them 
the  opportunity  to  order  copies  of  the  test  materials.  They  are  pro- 
vided that  opportunity  when  they  receive  their  registration  materi- 
als or  they  can  do  it  independent  of  that,  whichever  they  ^prefer. 

Mr,  Weiss.  You  were  here,  I  believe,  during  the  testimony  of  Mr. 
Anrig  and  heard,  or  did  you,  his  challenge  and  proposal  urging  all 
profit  and  nonprofit  testing  corporations  and  those  agencies  gov- 
erning which  test  to  join  with  ETS  voluntarily  in  an  industrywide 
code  of  fair  testing  for  educational  testing  nationwide,  and  there 
are  some  other  elements?  What's  your  response  to  that  invitation? 

Dr..  Rever.  Indeed,  Mr.  Chairman,  we  will  review  that  invitation 
and  that  challenge  with  great  interest.  We  will  respond  to  that  in 
due  course  as  we've  had  an  opportunity  to  review  it.  1  think  you 
and  the  concerns  you've  expressed  in  these  hearings  are  cognizant 
of  the  fear  of  test  agencies,  not  ACT  but  of  other,  of  being  dominat- 
ed by  the  values  and  goals  of  ETS.  ACT  haj  maintained  a  degree  of 
separateness  from  that  as  part  of  our  competitive  enviroment.  I 
think  we  would  be  somewhat  skeptical  in  looking  at  th^it  though 
the  spirit  in  which  it's  offered,  I  believe,  is  one  in  which  we  would  ; 
find  very  comfortable  and  would  in  fact  reward  or  we  find  a  great 
deal  of  comfort  in  the  work  of  the  throe  associations  Mr.  Anrig 
identified  in  establishing  standards  for  tests.  We  find  that,  in  the 
past,  thev've  been  conscientious,  that  the  advantage  to  that  is  they 
are  third  parties  to  the  process  of  testing.  They  are  not  test  devel- 
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opers  and  they  are  not  students,  but  they  are  scholars  arid  psycho- 
metricians,  and  we  find  that  may  be  the  best  arena  or  process  by 
which  such  standards  and  guidelines  may  be  developed.  I  dont 
think  Mr.  Anrig  intended  to  say  that  ETS  will  dommate  this  proc- 
''ess.  I  think  he^  cognizant  of  qoncerns  of  other  test  agencies  and 
their  relationship  with  ETS.  So  I  can  promise  you  that  we  will  ear- 
nestly study  that,  that  we  will  work  with  Mr.  Anrig  to  bring  that 
to  fruition  if  that  seems  to  be  in  students'  interests  and  in  the  in- 
terests of  education  and  ACT, 

Mr  Weiss.  And  finally,  I  am  correct  in  listening  to  your  testimo- 
ny that  you  make  the  test  Questions,  answers,  and  scoring  sheets 
available  only  to  students  who  take  the  test  in  the  State  of  New 
York.  Is  that  correct?  .  ^  • 

Dr.  Rever.  That's  not  correct;.  If  Til  restate.  Maybe  it  is  correct 
but  I  just  misunderstood  your  question.  At  the  current  time,  stu- 
dents can  obtain'  hand  scoring  services  at  virtually  any  location 
throughout  this  Nation.  Students  in  New  York  are  the  only  stu- 
dents that  can  obtain  copies  of  the  ACT  assessment  shortly  after 
it's  administered.  Students  throughout  the  Nation  can  obtain  re- 
tired forms  of  the  ACT  assessment,  forms  that  were  retired  last 
year  We  intend  to  follow  this  pattern  as  we  observe  developments 
and  our  judgment  so  indicates  that  that  pattern  may  welj  be  ex- 
panded and  in.  fact  we  continue  to  look  at  that  with  great  deal  of 
interest 

Our  concern  has  been,  quite  frankly,  that  the  very  low  interest 
that  we've  exj^erienced  among  New  York  students  probablv  is  an 
accurate  estimate  of  what  we  would  experience  nationwide.  One 
must  understand,  and  we  have  repeatedly  emphasized  this,  our  ex- 
amination is  quite  different  from  other  examinations.  The  kinds  of 
students  that  we  test  are  somewhat  different  from  others— from 
other  test  agencies.  The  use  to  which  the  instrument  is  placed  is 
quite  different  from  other  instruments.  Not  saying  that  the  uses  ol 
other  instruments  are  bad.  In  fact,  they  are  indeed  appropviate.  its 
just  that  our  instrument  is  used  in.  different  ways  We  believe  stu- 
dents see  that.  We  believe  students  understand  that,  apd  the  low 
request  rate  which  is  related  to  the  very  low  rate  at  which  we  find 
students  taking  the  examination  on  more  than  one  occasion^  sug- 
gests that  we  wbuld  be  better  off,  for  exair  \  by  letting  students 
see  a  copy  of  the  examination  before  they,  you  know,  the  likelihood 
is  they're  not  going  to  take  the  examination  more  than  once,  bo  we 
have  chosen  'to  provide  access  to  examinations  beiore  they  take  it 
and  made  that  freely  available  so  that  if  there  are  benefits  to  be 
derived,  they  wouldJbe  derived  before  the  student  sits  for  exAmina- 

*^^^Mr  Weiss.  Not  the  examination  that  they're  going  to  be  taking? 
vDr.  Rever.  No,  no.  This  would  be  a  retired  form. 
Mr.  Weiss.  Right.  ETS  does  the  same  thing,  and^has  been  doing 
so  f^rvvears.  ^  ^ 

Dr.  Rever.  Indeed.  Indeed.  Riflfht. 

Mr.  Weiss.  Do  you  know  if  there  are  coaching  courses  that  are 
directed  tdward  the  ACT  teste?     \  xm    v  ^ 

Dr  Rever.  I've  seen  and  I  don't  mean  to  pick  on  Mr.  Kaplan, 
I've  seen  an  adverteiwMnt  of  Mr.  Kaplah^s  recently  that  indicated 
thatjthey  are  now^fi^red  to  help  students  prepare  for  the  ACT 
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assessment.  I  recently  identified  an  organization,  I  believe,  in  the.i 
State  of  "Connecticut  that  does  a  mail  order  home  study  course  that 
they  plaim  will  help  student^  prepare  for  the  ACT  assessment 
There  are  some  but  I  cannot  really  say  the  number  of  them.  Our 
guess  is  they  are  relatively  few. 
Mr.  Weiss.  Thank  you  very  much.  Mr.  Williams? 
Mr.  Williams.  Mr.  Rever,  my  concern— our  concern,  I  think,  on 
the  committee  is  the  same  as  yours,  and  that  is  No,  1,  tiie  tests  be 
useful,  and  No.  2,  that  their  application  not  create  a  negative  in 
education,  In  trying  to  make  that  determination,  one  tends  to  xely 
-some  on  studies  that  ar^  dori«  of  tests  and  their  ramification,  I 
guess,  those  who— those  of  us  who  have  some  doubt  about  tests  rely 
on  the  tests  of  tests  to  determine  whether  or  not  they're— they're, 
valuable.  Let  me— let  me  cite  to  you  one  study  which  was  conduct- 
•  ed  by  the  Ur^iversity  of  Missouri's  Columbia  School  of  Medicine 
concerning  admissions. 

Quoting  now\from  the  study,'  "Neither  of  the  cognitive  measures, 
college  CPA's  or  MCAT's,  correlated  significantly  with  letter  rat- 
ings after  4  years  of  medical  school." 
AnotHer  study  fium  tfie  University  of  California  at  Berkeley., 
i  stated,  quoting,  "It  must  be  concluded  that  ratings  of  internship  , 
rformance  for  those  students  were  not  related  to  and  could  not 
predicted  by  MCAT  scores,"  and  an  additional  study  which  was 
conducted  by  the  American  Medical  Colleges  Association  said, 
'   quote:  "An  admissions  polic}^  based  exclusively  on  GPA'g  and/^r 
MCAT  scores /would  proportionately  exclude  minority  applicants 
I — fiwiMnedicalreducation." 

I'm  qiioting  now  from  a  study  that  was  done  SQme  time  ago,  in— 
that  last  quote,  some  time  ago  in  1977.  I  think  test  have  been  im- 
\  proved  dramatically  since  then,  and  I  want  to— I  want  to  empha- 
)  size  that  fact.  I  think  tests  have  been  improved  dramatically.,  but  I 
place  those  quotes  in  the  record  because  my  interest  in  the 
chairman's  bill  goes  to  (a)  the  usefulness  of  the  test,  (b)  their  dem-  • 
onstrated  relationship  to  the  student's  eventual  performance  as  a 
physician  or  a  dentist  or  a  lawyer,  and  finally^  that  we  be  absolute- 
ly certaiq  in  this  society  through  whatever  means  we  have  to  take 
that^those  tests  for  admissions  to  America's  colleges,  which  means 
admission  to  a  piece  of  American  pie,  not  exclude  minorities.  You 

m  jy  want  to  comment  on  my  

Dr.  Rever.  0h,  indeed,  and  I  may  have  trouble  recalling  all  of 
the  points  you  made,  but  let  me  try  and  address  myself  to  some, 
very  specific  ones  and  you  may  want  to  call  others  to  my  attention. ' 
Mr.  Williams.  Sure. 

Dr.  Rever.  The  issue  of  the  usefulness  of  examinations  cannot  be 
determined  by  correlation  coefficients.  We  have  and  we  encourage, 
in  fact,  institutions  to  do  everything  within  their  power  to  destroy 
the  predictive  validity  of  the  ACT  assessment.  Now  you  may  find 
that  strange;  The, reason  we  encourage  institutions,  to  do  that  is  be- 
cause they  have,  by  destroying  the  predictive  validit>;  of  the  AtST 
assessment,  perhaps  used  examinations  appropriately  in  helping  to 
guide  students  or  design  their  curriculum  program  and  provides 
whatever  services  they  may  need  in  improving  their  study  skills  or 
improving  their  study  development  or  whatever  it  may  be  so  that 
they  can  beat  thie  predictions. 
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T!.e  object  of  a  prediction* is  not  to  guarantee  what  the  future  of 
the  student*s  going  to  lookJik.e  it  is  to  indicate  to  the  student  and 
to  the  institution  wh.at  kinds  oT  assistance  or  difficulties  the  stu- 
dents may  indeed  encounter.  ,  ^  ^ 

Consequently,  zero  correlation>coefficients  are  often  more  greatly 
valued  by  ACT  and  other  test  organizations  than  correlation  coeffi- 
cients in  a  rang^  of  .70  to  1.0  because  depending  upon  th^  institu- 
tions .purposes,  correlation  coefficient  that  high— predictive,  validity 
that  high— may  be  indicating  to  the  institution  they  are  doing  a 
disservice  .to  students  arid  not  fulfilling  their  societal  obligations  to 
educating  students  that  deserve  .to  be  educated,  and  with  regard  to 
test  bias  and  the  selective  admissions  selections  of— the  admission 
of  minorities  or  let's  just  say  the  disadvantaged,  I  would  like  to  call 
the  subcommittee's  attention  to  a  recent,  and  this  came  across  my 
desk  yesterday,  issue  of  the  American  Psychologist.  This  is  my  per- 
sonal copy.  I  refuse  to  give  it  to  you,  and  in  it  let  me— let  me  give, 
you  the  title.  Just  a  minute.  It  is  Testing:  Concepts,  Policy,  Practice 
ancl  Research. 

/  In  this  document  you  will  find  a  contribution  by  one  pf  the  fore- 
/ttiost  authority  on  bias  and  selection  and  indeed  we  are  talking 
about  bias  in  selection  when  \ye*re  talking  about  excluding  the  dis- 
advantaged from,  selective  educational  programs  such  as  law 
schools  and  medical  schools. 

Nancy  Cole  (phonetic),  the  University  of  Pittsburgh,  one  of  the 
leading  observers  and  scholarsnn  the^ield  of  the  theory  of  selection 
and  in  psychbmetrics  concluded  that  indeed  no  matter  what  kinds 
of  theoretical  or  mathematical  scheme  one  employs  in  selecting 
students  to  introduce  fairness  into  the  test  process  that  ultimately 
it  is  a  value  judgment  thai  will  dictate  the  results  one  achieves.  In 
other  words,  there  are  no  answers  to  the  question  of  are  tests 
simply  biased  and  u^ed  against  disadvantaged  students.  Tests  are 
not  biased  according  to  some  definitions.  According  to  the  most 
simple-minded  they  are,  but  that's  a  hardly  useful  definition.  What 
we've  observed,  I  think,  in  education,  particularly  in  selective  insti- 
tutions over  the  past  few  years,  is  that  indeed  minorities  and 
indeed  the  disadvantaged  have  been  represented  to  a  greater 
degree  in  entering  classes  than  they  were  . years  before.  Tests  have 
remained  the  same.  Their,  performance  on  tests  has  been  roughly 
the  same  although  minbrity  students'  test  scores  have  been  tending 
to  go  up  certainly  not  6nough  to  account  for  the  increased  propoiV 
tion  of  their  representation  in  entering  classes  among  selected  in- 
siitutionS.  ^         ,*  " 

I,  as  an  obserVor  and  some  time  follower  of  these  phenomena, 
h^ye  not  identified  any  conclusive  empirical  evidence  that  would 
suggest  .that  tests  have  kept  minority  and  disadvantaged  students 
out  of  institutions,  and  in  fact  the  evidence  is  in  the  opiwsite  direc- 
tion. We  know,  for  example,  that  using  standard  prediction  te'ch- 
iiiques,  it  works  to  the  advantage  of  minorities  and  disadvantaged 
to  have  taken  an  examination  as  part  of  ' the  admissions  process  be- 
cause we  tend  to  overpredict  their  performance  in  college. 

That  has  many  implications  and  I  don't  mean  to  try  to  make  this 
into  an  admission  psychometrics  decision  theory  statement,  but  I 
think  one  needs  to  be  very  careful  about  the  kinds  of  statements 
that  are  made  about  how  tests  have  affected  students  when,  in  fact, 
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there,  is  a  wealth  of  information  sayin|  that  tests  have  been  help-  , 
ful,  they  continue  to  fcfe  helpful,  and  our  intent,  and  we  share  this 
intent  with  Mr.  Williams  to  mak^^  sure  they  are  useful. 

I  think  the  evidence  to  date  has  tended  to  support  our  view  tliat 
indeed  they  have  been  useful  and  indeed  are  helpful  and  valid  for 
their  purposes. 

Mr.  WiLUAMS.  What— what  efforts  in  the  preparation  of  tests  is 
made  by  testing  community  to  assure  that  tests  are  not  biased 
against  significant'groups  of  American  citizens? 

Dr.  Rever.  Thais  a  very  good  question,  Mr.  Williams.  I  think 
test  agencies,  in  my  short  experience — I've  been  with  the  American 
college  testing  pro<*ram  for  12  years  aiidrwas  in  their  research  and 
development  division  for  7  before  moving  to  Washington,  D.C. 
During  mj^  experience  in  our  research  and  development  division, 
which  develops  .the  ACT  assessment  and  other  tests,  we  go  to  great 
pains  to  see  to  it  that  certain  kinds  of  bias  are  excluded  from  the 
examination.  We  have  every  test  item  reviewed  by  a  panel  of  rep- 
resentatives of  minorities  and  other  disadvantaqged  students  to 
identify  and  to  ferret  out  objectionable  or  \^hat  might  be^seen.on  » 
ite  face  as  culturaily  biaie3  languajge  and.cohcepts  and  the' like.  In  ^ 
addition  to  that,  when  the  examination  items  are  submitted  or  ' 
taken -bjr  a  representative  sample  of  students  for  standardization 
purpo^^  we  identify  students  according  to  their  race  and  look  at 
the  pattern  of#  responses  that  they  provide  to  particular  items  and 
to  the  entire^ examination  and  compare  that  patterns  of  responses  \  I 
to  the  majority,  white  students.  By  doing  so,  we  intend  to  identify 
emerging  patterns  that  may  be  entirely  unrelated  to  the  education- 
al background  of  students,  but  again  may  give~us  som^  clues  to 
items  that  may  disadvantage  particular  kinds  of  student^  for  rea- 
sons beyond  their  control.  * 

There  are  other  kinds  of  bias  that  are  present  but  in  essense 
what  weVe  done  is  we've  tried  to  eliminate  what  we  call  facial  bias 
or  Jtem  bias  by  having  the  examination  items  extensively  reviewed 
by  panels  of  persons  and  by  looking  at  the  statistical  characteris- 
tic*?; of  the  itenfi  according  to  the  race  of  students  who've  taken  it 
under  experimental  conditions. 

Mr.  Williams.  Thank  you.^  Thank  you.  Mi .  Chairman. 

Mr.  Weiss.  Dr.  Rever,  thank  you  very  n*ich  for  your  testimony 
and  for  your  patience  in  getting  through  the  morning  with  us.  You  * 
will  forward  some  of  those  materials  that  we  discussed? 

Dr.  Rever.  Indeed  I  will. 
'  Mr.  Weiss.  If  you^ll  do  it  within  10  days,  it  will  be  appreciated.-  — — 

Dr.  Rever.  Will  do  it  tomorrow.  ^.         ^  " 

Mr.  Weiss.  Good.  Thank  you  so  much. 

Our  next  witness  will  be  Mary  Ann  Austen,  legal  counsel,  repre- 
sentating  State -Senator  Kenneth  Lavalle  of  New  York,  who  I 
might  note  belongs  to  t  e  other  party^ 

Also,  the  last  time  you  appeared  before  was  just  about  1  year 

Mrs.  Austen.  Yes.        ,  / 

Mr.  Weiss.  I  guess  we  ihtVoduced.you'as  Miss  Mary  Ann  McLean, 
ril  extend  the  comitiittee!s  congratulations  and  best  wishes  to  you. 
'  Mrs.  AuiTTEN.  Thank  you  very  much. 
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STATEMENT  OF  MARY  ANN  AUSTEN,  COUNSEL  Tp  STA^E 
C     SENA^J^toNCTil  P/MVALLE  OF  NEW  YO 

Mrs.  AusTBN.  Mr.  Chairman,  my  name  is  Mary  Anh  Austenp^nd 
I  serve  as  cbunsel  to  Senator  Kenneth  P.  Lav^le,  the  sponsor  of 
New  York?s  truth-in-lending  law.  ' 

iet  m^  extend  his  apologies  for  i>ot  apj)earing  before  this  com- 
mittee/today; however,  he  had  picviously  scheduled  legislative 
hearkigs  which  could  not  be  rearranged. 

I  appreciate  the  opportunity  to  be*  here  in  his  place,  and  I  hope  to 
provide  you  with  information  which  should  assist  in  your  decision 
to  report  H.R.  1662  favorable  out  of  committee. 

It  has  been  almost  2%  years  since  truth-in-testing  legislation  was 
signed  into  law  in  New  York.  THe|dire  predictions  of  the  opposition 
have  not  become  a  reality.  The  tests  are  still  offered,  the  students 
still  take  them,  and  the  colleges  still  use  them.  All  of  the  players, 
that  is  the  test  agencies,  the  colleges  and  niostv  importantly  the  stu- 
dents have  accommodated  the  changes  and  haye  gone  about  their* 
business.  all  reports,  the  atmosphere  is  auite^  calm.  It  is  impor- 
tant to  emphasize  this  fact  to  you,  expecially  to  those  of  you  who 
remember  the  early  hearing  back  in  the  summer  of  1979  when  the 
testimony  threatened  certain  chaos  from  the  demise  of  a  time  hon- 
ored system.  ^You  might  say  that  we  who  have  always  supiwrted 
test  disclosure  had  more  faith  in  the  resilience  ^of  the  testing 
system,  than  those  who  ran  it.  We  believed  the  process  could  sus- 
tain the  necessary  changed  and  we,  as  you  now  know,  were  right. 

Our  first  consideration  has  always  been  /the  students,  and  we 
would  not  have  persisted  along  a  course^hat  would  impede  their 
ability  to  jjursue  higher  education.  If  the  tests  were  an  essential 
part  of  the  admissions  process,  then  they  ,would  adapt,  and  they 
did.  Our  goal  has  always  been  to  improve  the  product  arid  the  proc- 
ess by  which  crucial  determinations  of  selection  are  made*  4We-be- 
lieved  both  aspects  of  our  goial,  that  is  improved  product  and  proc- 
ess, would  be  achieved  through  simple  disclosure.  We  -ha^  never 
stated  nor  even  implied  that  Government  should  play  a  role  in  the 
development  or  analysis  of  the  content  of  any  of  these  exams. 
Rather  through  disclosure  we  would  permit  the  experts  to  debate 
this  issue  among,  themselves  and  allow  the  industrj^to  improve 

■  itself  *  t      r  1. 

We  were  told  originally  that  there  was  a  finite  number  of  qualitv 
questions  for  these  tests.  Then  later  we  were  told  that  althoagh 
there  were  many  possible  questions  it  took  time  to  ,constr;Uct  them 
and  we  werfe  .warned  that  haste  makes  waste.  Our  position^  howev- 
er, was  that  scrutiny  produces  the  best  product.  JLet  me  simply/ 
quote  E.  Belvin  Williams,  the  senior  vice  president  for  testing  at 
Ere.  ETS,  incidentally,  as  vou  recall,  was  one  of  our  leading  oppo- 
nents. Mr.  Williams  stated  in  a  Times  article  that  diclcsure  pro- 
duced a  "health  reexamination"  of  the  organization's  intefnal  pro- 
cedures for  developing  and  administering  exams.  On  the  issue  of 
test  quality,  he  added,  "I  can  say  with  absolute  Certainty  that  the 
quality  did  not  go  down  on  any  of  our  tests.  To  the  contrary,  it  is 
better  than  ever."  ;  -.'^ 

Again,  our  only  concern  is  for  the  primary  consumer  of  this  prod-  ^ 
uct,  that  is  the  students.  As  stated  in  New  York  Times  editorial  in 


March  of  this  year,  althoirj^h  the  ejimphasis  ofn  college  entrahce  exr 
aminations  is.  declining  in(colleges  across  the  Nation,  Ihey  still  play 
an  importanTrole  in  the  futures  of  more  than  1' million  students  a 
year.  College  admissions  may  become  betteV  ibr  this  change.  Most 
important,  the  students,  who  take  the  tests  will  feel  they're  fairer* 

.  I  am  here  today  to  state  that  test  disclosure  is  working  well  In^* 
New  York  and  that  enactment  of  a  Federal  law,  that  i^  H.R.  1662, 
would  at  least  finalize  the  issue  of  disclosure  which  now  appears  to 
have  few  real  enemies.  It  is  impor^nt  that  there  lie  a  single  stand- 
ard' throughout  the  ^country  to  which -the  test  agencies  must 
adhere.  It  is  important  to  pass  this  bill  to  put  ah  end  to  the  lobby- 
ing that  is  otherwise  forced  to  go  on  in  every  State  that  considers 
similar  legislation.  Such  lobbying,  of  course,  is  paid  for  with  stu- 
dent  fees ^and  that— and  the  fact  that  better  use^ould  be  made  of 


;  this  money  is  indeed  obvious.  f 

I  said  that  there  weref?V/  real  enemies  to  the  issue  of  disclosure. 
Now  I  say  this  in  light  of  the  industry  changes  that  have  occurred 
since  thfe  enactment  of  our  bill  in.  1979.  Within  the  first  Yew 
months,  the  boards  which  administer  the  law  school  admissions 
test,  the  graduate  management  Admissions  test,  and  the  ^aduate — , 
record  exam  decided  to  apply  New  York's  disclosure  requirements 
nationally.  They  believe<L  that  stjidentis  deservefd  this  service  re- 
gardless of  their  address,]^hd  t&v  realized  that  spreading  the  cost 
among  all  th^^students  would  r^Jflice  the  price  increase  they  felt  - 
was^j^cp^^ary  todmpose.  Therefore,  this  change  has  been  in  effect 
for  ,fwo  years  now.  College  Board'  who  administers  the  PSAT  and  » 
-  S^T,  made  a  similar  deciSrEJIfaBopt  six  months  ago.  Coincidentally, 
their  action  came  very  shbrtly  a^ter  the  discovery  by  a  few  high 
.  school  student^  of  errors  on  the  IfSAT  and  SAT,  errors  I  might  add 
that  when  correfcted  made  new  ^'students  eligible  for  scholarships 
ranging  from  totals  of  $1,000  tp  $8,X)0(). , The  importance  df  that  dis- 
covery to  Ihose  students  is  alsoj  ohyious.—  _ 
"  These  tesis,  the  SAT,  ORE,  GMAT,  and  LS  AT  Comprise  the  vast 
majority  of  this  market  and  the^  have  ali  moved  to 'disclosure^  na-  , 
tionally.  It  has  ho^i  become  an  accept-ed  practice  and  it  should  be 
codified  with  this  legislatiorj.  If  ^11  people  and  industries  were  per- 
mitled^.to'  act  voluntarily,  as  the!  test  agencies  appear  to  be  asking 
you"  now  to  allow  them  to  do,  then  therfe  would  be  no  laws.  Pre- 
serve thjs.practice  of  disclosure' I  ask  that  you  enact  H.R.  1662. 

I  would  now  like  to  focus  my  specffic  remarks  on  1661  to  bill  sec- 
tion 7,  ehtitled  testing  costs  arid  fees  to  students.  Most  importantly, 
this  section  requires-the  test  agehcies  to  annually  disclose  informa- 
tion regarding  the  volume  of  tesp  given  and  the  fees  collected  for 
those  tests  as  well  as  Uie  expenses  inqurred  for  the  development  of 
these  tests.  An  analyms  of  this  information  is  vital  to  determining 
what  students  are  adtually  payiAg  for  when  they-  register  to  take 
these  exams.  That  is,  we  believe  that  the  fees  exceed  the  cost  of  the 
service.  *  " 

T^st  agencies  do  not  appear  to  be  concerned  with  the  price  of 
their  prcSuct.  After  all,  most  students  are  compelled  to  take  these  ^ 
exams  for  admissions  to  programs  in  liigher  educatio;i,  and  in  most 
cases,  there  is  only  one/test  avaiflable._jVithout  competition  where 
is  the  incentive  to  economize?  / 
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We  ^ve  never  received  data  to  refute  our  contention,  for  exam- 
ple, tjhat  ^only  5  percent  of  the  students'  test  fees  used  to  develop 
the  SAT  question.  Now,  this  morning^  we  were  told  that  it  was  9 
percent.  Even  9  percent  is  something  'that  does  not  bear  out  their 
resi)onses  as  was  being  brought  out  by  the  chairman.  We  are^ 
therefore,  distressed  by  the  excessive  fee  increases  as  a  result  of 
discioaure  legislation.  Disclosure  of  the  information  requir*ed  in 
^.R;  ijg62  would  explain  all  of  this» 

.  I  would  also  like  to  add  at  this  point  that  we  are  delighted  to 
learn  that  only  inflation  is  causing  the  increase  in  these  costs  and 
i..    these  fees^since  up  to  now  we've  been  blamed  by  passing  this  legis- 
/  ^    lation  for  these  increases,  and  this,  morning  we-  were  told  that  by 
.  /  ^  Arirtue  of  the  inflation  rate  they  should  l?e  higher  than  they  are 
/      now.  This  is  the  first  ,  that  Tve  heard  of  this,  and  aj  I  s^y,  we're 
/       delighted  to  learn  of  it.  I  would  like  to  add.  that  when-they  were-~ 
/        including— when  they  were  statirig  the  different  factors  that  go 
into  the  9  percent  that  was  used  for  test  development  when  they 
were  trying  to  analyze  those  pieces  or  those  activitieV  of  the  test 
agencies  that  are  relevant  to  disclosure  legislation,  I  don't  believe 
they  included  their  lobb\^ng  costs  which  in  New  York  exceeded, 
$20,000.  I  think  that's  laM^      piece  of  information  that  ought  To 
^be  included  when  they  -gife  you  the  list  of  activities  relevant  to  the 
'  .<iisclosure  legislation.  ,  \fi 

.  As  legislators,  your/CAj^tituents  will  ask  you  why  th  ose  fees  are 
increasing.  Before  i^pti  Mept  the  industry's  explanation,  you  have 
~a  right  to  see  the  facts. 

In  closing,  let  me  again  state  that  Federal  legislation  is  neces- 
sary for  the  continuation  of  test  disclosure.  Voluntary  disclosure 
#  for  the  Nation  was  done  only  after  disclosure  wab  required  in  New 
York  State;  and  furtHermore,.as  you  all  know,  what  is  given  volun- 
tarily can  easily  be  tak^n  away.     '  L  ^         '  . 
^^JOvafik  you  for  the  o|)portunity  to  appear  today,  and  again  let  me 
-^.-^'^''"SSctend  Senator  Lavalle's  apologies  for  his  unavoidable  absence^  ^ 
\       '     [prepared  statement  of  Mary  Ann  Austen  follovys:] 
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Prepared  Statkment  ok  Mary  Ann  M.  Austen  Counsel  to  Nbw  York  State 
Sknatou  Kenneth  P.  LaVaixe 

MR.  aiAItWN,'M^  NAME  IS  hmi  «iN  AUSTi:^        i  SJI^VH  A3  CCOXSIIIL  TO  S^'AJaR 

KE:©iEni  P.  iAmi£,  tie  sposor  of  nek  yopa's  ^^.^i.*?.:-!:  -ra-ziNC        xrr  rc  rxT^o 

HIS  i^POLpGIES  FOR  NOT  APPEARING  BErO:<i:  TiZS  CC^^-T*;**,  .^.O'S:^,       liAD  PIOnCOoLV 
SQEDULBD  ^EE^^X;S  WHICH  flE  COULD  tiOO*  RSA:-u"^V:a;. 

I  APPRECIATE  TIE  OPPORIVTaiV  TO  BD  lli:.w  -A  >u  I  ,.C?L  'K)  PXVIDJ 

YOU  mTll  INTORMATION  WllXai  SiKXHi)  ASSIST  :;^C^3aU^  iXi  *i,U,iu02 

FAVORABLY  OUT  OF  CaWlTTCE. 

rr  IIAS  BEEN  ALMOST  IVX)  AND  A  HALF  VUUw  v>a..C«  ':."CTi*-IN-V*S'7I>.«>  LD':ij?i*vri:c>:  'v^S 
SIGJCT)  i:W>  V\W  IN  NEW  Y0I«<.    ITE  DIRE  PRLDAC7Ia^^  0?  Tiu.  OPPCS^rXW  iiAVH  NOT 
BSCOKS  A  REALriY;  TIE  TESTS  ARE  S11LL  OFFSrCD,  Tti;  STuDUvVS  3Tr^  TA.C  TiKl  A.X'D 
TIE  pOLLBGES  STJLL  USE  T^l&i.    ALL  IHS  PU\rt:^^->,  V^^AT       r..^;  "IC-i^T  AOix-CZCS,  TJ^a 
C0LLBC2S  AND  MOST  iMPORTATTLY  HE  SWDE^TS  */>VL  ACCCi>'^\r:i)  ^.^^  CA^^^ri^  A'O  iiAV'E 
OCXS  CN  ABOUT  THEIR  BUSINESS.    BY  ALL  RETORTS,  Viw  AT^XiSP.IiKJ  1$  QUITE  CALX.  IT 
IS  LMPORTANT  TO  EXPHAglZE  nilS  FACT  TO  VCv,  ^i^UZlAu.^  X  Ti.OGr.  O."'  YOO  KIO  I^C^S^^ 
•HE  EARLY  fEARINGS  IN  TIE  SU>WER  OF  79  UliT^  TIC  1X5TI?«NY  r*J<^Ti:NLO  CEiCAIN  GiACS 
TKH  "HE  DE>USE  OF  A  TIME  HC»JORED  SYffrEM.    YOj  iHiGhT  i>AV  'HAT  l'^.  :-.r*0  Iy\V2  AL'W/S 
SUPPORTED  TEST  DISCLOSURE  JIAD  MORE  FATHl  IN  THE  iCSIi.iiJNCL  OP  TliL  TTSl^INC  S^STif^ 
TON  'HJOSE  WHO  RAN  IT.    WE  BELIEVED  TIE  PKXI^  COoLO  SLJT*\ZN  TilT  ICXESSARY  ai/0.'Gi:S 
AND  WE,  AS  YOU  Na7  KNOtV,  WERE  RIQIT. 

CUR  FIRST  CONSIDERATION  IU3  AU1AYS  Bm        bTJD^TS  WOOXO  NC^  .H/^VE 

PERSISTED  AIA\G  A  COURSE  THAT  VKAJlD  imPLA  **»a,*4<  ABJui^V  70  ?v;<SoL  niQICR  CDuCATION. 
IF  TIE  TECnS  WERE  AN  I>nK>.m  PART  0?  TJiE  Aa^UShX^SS  P.W:^3  TIEA*  WWLD  ^D/^PT— 

AND  TJ2CY  DID.    OUR  (XVVL  HAS  ALWAYS  BE224  TO  ^.V^CVL  V.u)  ^.  >  :  ^^^^  ^^-^^        *^'<CiT3  BY 
WllIQi  CRlX;iAL  DETER^UNATI0^3  OF  SELECTION  /uc.  <u.  i..^I..V.^  .O.ll  ASPECTS  OF 

-xuR-OiALujijeKii^^  i^:^  ">»-^^^m  s^^^li^  d:scu)Surt:. 

WE  HAVE  NEVER  STATED  NOR  EVEN  MLIED  TJiA^  OCVi.'-Cvu:^T  o,.Ok.'LO  TLAY  A  t^CLT  IN  THE 

dbvelop:^t  or  analysis  o?  tie  ocntot'  or  a\y  o.'  Zi^z  tt-svs.  .-wt.it^r  Tiiroooii 

OISaUOSURE  WE  VKXilD  PERMIT  THE  EXPERTS  TO  uJ^iAH^  Tnl^  I^b-jE  A^NG  TJiE>SCLVES  AND 

Ajjcw  tse  industry  to^mprove  itself^ 
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IIESE  123:5.    IliE^i  1<Z  V.sIIC  I^OIO  TSVvT  X.Tl.'CUCH  TiIE2<E  MAf^Y  POSSIBLE  QUESTIOrS  ^ 

IT  loox  Tus  lo  ooNSrrccr  Tifrrt  a*o     s^rr%  siARNSO  TiiAT  "liAS^  makes  waste."  cur 

POSITION  ISD^SVER  5^AS  ■HiA.T  SC^TI^nf  TIWXHS  'HIE  IIC^T  PimXH".    LET  MS  SIMPLY  COOTS 
S.  BCLVIN  WlLLIAXi:  "HS  StMQR  VIC:  ?:CSlDI•^T  PO.'l  HB^TIKC  AT  CTS,  (INCIDENTLY  AT 
V.B  aJTSST  ETS  i%TRi:  ':5iE  JTV^rCG  OP-WXTS  ON  IHIS  ISSUER.    MK.  WILLIAMS  STATH)  IN  "A 
N'.Y.  Ti^SS  A!?riCL£  T1L^T  !?I?CjQ>V'<:;  '^rC'XCIiU  "A  IIEAL-niY  F^:-E?W4I^:^TI0N"  OF  TIE 
OaSAKI^ATION-S  IN1T:,^\^  '-'^r^v  <:^>  :'0<  :)C^.'nL0PL*X5  and  ADMI^^I5raRI^JG  EXAVS,    ON  HE-  ^ 
ISSCE  0?  "lit^ST  7-^^17  P;  "t  OW        VvTOl  ABSOUHE  CRErr7U^^Y  THAT  TWE  WALITY 

010        GO  DC?aM  on  m       Cv'l  TFS^.    'X'  TiU:  COTTRARY,  IT  IS  BETTER  Tim  EVER, 
(N*.Y.  TZ>2S  NOVD'SSR  23,  19^0) .  •  * 

AGMX  a*R  WLY  covcn*^  IS  :m  he  primary  ccnsump^r  of  this  product,  'hiat  is 

T?c:  slt:o'^TS.  as  srAtts     a  to  yu^c<  times  editorial  i^^APai,  mu 

Aittea^  the  ci^asis  on  college  entrance  examinations-is 
docljj^ar.^  :in  coV.^o^  ocross  the  natxon,  they  still  play  an 
I'^yort'irt  role  m  t^.o  futures,  of  nore  than  a  nvlllion  students 
,    a  yi^ar.   Col  loco  od-ntsslorj?  rray  become  better  for  this  change, 
f-fost  .^'^rton.,  the  sfjdents  who  take  the  tests  will  feel 
thoy're"  ^-i^tr  {KS.'^iryya,  v^rch  20,  1981), 

I  AM  t£2IC  TCAY       STa:::  TliAT  TES^T  OISCLOSURE  IS  TORKBJG  V.m  IN  NR-/  YORK  AND 

ryvr  ri>cr^T  or  a  rED-rvvu  ^Jit,  n:<.  1662  vmi)  at  la^t  finali7X  the  issue  of 
Discixsuss  v.i'iai  NOV  Ar*>i.v?.s  to  iiave      reaiv  endues,  it  is  I^!P0R^;^^^T•  tijat  there 

m  A  F>I^.CLE  STAKDAPD  rr^J'.T^JT  Tir,  CCATRY  TO  vmOi  TIE  TEST  AGOJCIES  MUST  ADHERE. 
IT  IS  IVPOOTANT  TO  PASS  TTIIS  BILL  TO  PUT  AN  END  TO  THE  LOBBYING  THAT  IS  OHEFWISE 
rX)?CED  TO  GO  CX'i  IN  E^/ERY  S^ATL  THAT  CXXiSIDEPS  SIMILAR  LEGISLATION.    SUQl  LOBBYING  IS 

o'"  oof'^s  '^AiD  ^O'l       s^jo^n*  hees  >to  tiiat  better  use  oould  be  made  oe  this  money 

I  SAID  lliAT  TICrsL  r^c,  r7W  BI'/^  ENT^ilES  TO  TIE  ISSUE  OF  DISCLOSURE.    LSAY  THIS 
IN'  LICirr  or  TJIT.  Dr>JSTRV  changes  TJAT  I'AVS  OOCURED  since  tie  ENACIWEirr  OF  OUR  BILL 

^  '.979. — NTTT  j\.  -^jr  -^rycr^  ttm  vvt.'^^'::  ■     r.  nQARDSJ^maLArKINISTER  THE  LSAT,  GWAT   

A.N'D  GFE  DECIDED  TO  yV'PLY  NTZV  yOHK'S  DISCLOSURE  RBQUIRHJ^JJS  NATIONALLY.  TIEY  JBELIEVp 
eZVOr^TS  DES:;-'?^  TtHS  SL'^ICZ;  .rxiARDlit'S  of  TIEIR  address  and  they  realised  THAT 
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t   SPRSADE^Q  THE  COST  ATOG  ALL  TIE  SU'DS:>?rS  WOUU)  REDUCE  THE  PRICE  J!«;REASE  IWEy  fELT 
!«?\S  NSCESSARX^  TO  I>!P0SF:,    rHSRSTOI^S,  ^[JLS  QIANGE  HAS  BEEN  m  EFFECT  FOR  "^-W^ 
/  >JOW.    CDxXEGS  DCWSD,  t>HO  iUKINISnSS  THE  PSAT  ^ND  SAT,  MADS  A  SI>rXAR  DECISION,,  ^ 

TOEIR  ACnCN  CAME  VBSY  SIJORTLY  ATTBa  X^E  DISCOVERY  BY  A  FEW  HIGH  SCHOOL  SlUCCNrS  OF 
ERRORS  CN  THE  PSAT  A.ND  SAT.    ERRORS  I  MIGIfT  ADD,  THAT  WHEf^  CORRECTED  MADE  NEW  STLDETTS 
EUGIBLB  FOR.SajOLARSHIPS  ^NKJT^'G         TOTlLS  OF  $1000  to  $8000*^   IKE  I^RTANCE 
07  n!AT  DISCOVERY  TO  TiJOSE  SUDSTIS  IS  OBVIOUS. 

TIES^TESTS,  THE  SAT,  ORE.  4\OT^'^ OOt^KCi,^  TIE'VA^' MAJORITY  THIS  ^ 

.MARKET  iW^ISY  HAVE  'ALL  r-WED  TO  OZSClXySWB  NATIONALLY.    IT  HAS  m-i  BROOKE  AN 
♦      .  ACCEPTED  PRACTICE  AND  IT  Si^ZD  BE  OOOIflED  V/ITH  THIS  LEGISLATION.    IP  ALL  PEOPLE 

*  AND  rSTC^RIES  WERE  PERMtTTED  TO  ACr  VDLCNTARILY       AS  T5EY  APPEAR  TO  BE  ASKING  YOU  TO 

DO  —  ^TIO  THSRU  IxXXTLD  BE  >J0  LA'.s'S.    VRESEKVE  -HIIS  PRACTICE  OF  DISCLOSURE;  I  ASK 

'T?y<r  vcu  ENAcr  h.r.  igg2.  ' 

I  tflXTD  ^"CW  UKC  TO  KXX'S  flY  SPECIFIC  COJKENTS  CN^H.R,  1662  TO  Bllli, SECTION' 
SrVCT  ENTITXED,  •'tCSTINC  COSTS  AND  HXS  TO  STODEfilS."  ' 
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Mr.  Weiss.  Ms.  Austen,  thank  you  very  much  for  your  testimony 
and  for  coming  down  to  testify  on  behalf  of  Senator  Lavalle. 

Had  New  York  considered  including  the  equivalent  of  section  7 
in  its  legislation?  ^»  '  '  ,  u 

Ms.  AySTSN.  At  the  time  we  were  doing  this,  that  seemed  to  be, 
although  it  was  one  aspect  of  the  total  amount  of  information  we 
"were  trying  to  obtain,  wfe  felt  that  it  was  such  a  new  issue  that  we 
did  not  want  to  cloud  the'  issue  with  so  many  aspects,  and  in  fact 
our  goal  at  the  time,  which  as  it  was,  was  improved  testing  infor- 
mation to  students  about  the  questions  themselves  and  the  reports 
and  the  statistics  done  on  them,  we  didn't  want  to,  as  I  say,  cl<)ud 
that  with  this  other  information  which  they  would'have  used,  they 
meaning  the  test  agencies,  in  their  16bl)yinfe  efforts.  We  felt,  per- 
haps the  detriment  of  our  main  goal  so  we  excluded  it.  It  s  some- 
thing that  Senator  Lavalle  is  extremely  concerned  with  now  be- 
cause of  the  increasing  test  fees.  With  everything  else  increasing, 
this  is  one  additional  thing  that  his  constituents  and  everyone  else 
would  like  the  burden  reduced  on,  ahd  it's  something  that  he  s  seri- 
ously looking  at  now  in  New  York. 

Mr.  Weiss.  Well,  it  must  be  gratifying  to  you  to  find  that  a  piece 
of  legislation  which  originally  was  objected  to  so  violently  now  is 
being  cited  as  being  so  effective  as  to  preclude  any  further  legisla- 
tion in  the  field  here  or  any  place  else. 

Ms.  Austen.  Wonderful.  Irs  quite  a  different  tune. 

Mr.  Weiss.  I  gather  that  there  are  still  some  tests  which  are  not 
being  offered  or  to  whidi  the  legislatioa  does  not  apply  because  of 
legal  action. 

AIs  Austen.  Yes 

Mr.  Weiss.  Could  you  touch  on  that  briefly?  . 
Ms.  Austen.  Yes;  there  are,  I  believe,  six  exams.  There  was  a  list 
compiled  by  the  State  Education  Department  upon  the  passage  of 
this  legislation  of  tests  offered  in  New  York  that  fell  under  the 
definition  in  our  bill  of  tests  for  admission  to  postsecondary  institu- 
tions, and  the  list  was  approximately  26  tests  in  length;  Originally, 
the  State  Education  Department^announced  that  20  of  them  were 
leaving,  leaving  only  6,  the  6  which  most  of  us  think  of,  as  a  matter 
of  fact  they  are  the.  ETS  tests  but  in  any  case  with  the  passage  of 
some  l^islation— we  were  unaware  of  some  of  these  tests  exist- 
ence. They're  very,  very  small  tests.  Sometimes  one  test  is  made  up 
by  an  individual,  for  instance  one  is  offered  to  some  nursing  stu- 
dents that  other  larger  tests— tests  that  are  available  take  ^are  of 
in  other  parts  of.the  State.  They  were  a  regional  and  much  more 

nfbrmal-aetivity,  ^  :  .  _^  — —  r-^u 

We  passed  legislation  when  we  found  out  about  some  Ot^neseTn 


their  size.  We  included  which  was  a  portion  of  your  first  Dili  that 
was  an^^emption  for  small  tests.  We  included  an  exemption  for 
'small  tests,  however,  requiring  them  every  3  years  to  put  one  of 
their  tests  on  file  so  that  there  was  something  for  some  sort  of  dis- 
closure of  their  tests,  however  recognizing  the  burden  of  a  500,  for 
example,  person  program  as  opposed  to  the  200,000  SAT  program 
most  of  them  have  come  back.  There  are  a  few  that  have  not  come 
back  for  one  reason  or  another.  It's  not  within  my  knowledge  at 
this  point  to  know  if^  in  fact,  they're  given  anywl>ere  else  anymore. 
They  may  just  not  exist  anymore.  In  any  case,  the  slack  has  been 


picked  up  by^other  tests.  Apparently  we  have  not  had  any  com?, 
plaints  about  students  wanting  a  program  hjxt  not  being  able  to 
take  an  exam  and  having  ;to  go  to  another  State.  The  one  exam 
that  is  not— that  is- given,,  however,  not  subjected  to  the  law  in  any 
respect  is  the  MCAT  which  is  the  test  for  admission  to  medical 
school,  and  that  is  as  a  result  of  an  injunction-that  was  obtained  by 
the  American  Association  of  Medical  Colleges  in  January  of  1980,. 
and  that  is  still— has  still  not  been  determined  on  the  merits.  li 
was  an  injunction.  The  issue  is  copyright,  and,  as  I  stated  in  my 
testimony  last  year,  the  test  for  injunctions  in  copyright  matters  is 
much  less  demanding  than  it  is  in  many  other  areas  because  of  the 
nature  of  copyrights  so  the  issue  of  whether  or  not  there  is  a  copy- 
right violation  here  has  not  yet  been  determined,  and  we  submit 
continuously  and  especially  in  light  of  the  time  that  has  gone  by 
and  the  fact  that  everyone  has  adjusted  so  well  evidenced  by  the 
testimony  today.  This  is  right  up  there  with  motherhood  and  apple 
pie  at  this  point  seemingly.  They  still  contend  that,  assuming  that 
they  haven  t  dropped  the  suit,  that  they  cannot  comply,  that  they 
are  still  burdenea  by  the  finite  number  of  quality  questions  that 
they  always  stated  which  was  an  argument  that  ETS  p<feed  origi- 
nally in  spite  of  What  they're  saying  now,  and  also  it's  interesting 
to  note  that  the  dental  admissions  tests  which  is  a  similar  test  in 
the  sense  that  it  is  composed  primarily  of  mathematics  and  science 
has  been  disclosed  in  New  York.  They  don't  have  a  problem,  in 
fact,  .they  are  exempt  by  virtue  oiF  how  many  students  take  the  test, 
but  in  spite  of  that,  they're  disclosing  anyway.  They  seem  to  be 
able  to  construct  a  test  of  that  nature  which  seems  to  ^uit  their 
purposes  in  terms  of  all  testimony  that  came  out  when  they  origi- 
nally testified  about  wanting  to  curtail  the  kind  of  student  that 
couldh't.  make  it  all  the  way  through.  Their  test  accomplishes  that 
goal  which  is  apparently  also  a  goal  of  the  medical  schools;  They 
can  disclose,  but  the  medical  schools  contend  they  still  cannot.  I 
just  wanted  to  point,  that  out.  It's  still  pending. 

Mr.  Weiss.  Thank  you  very  much  and  again  our  appreciation  too. 
Mr.  Williams:^ 

Mr.  Williams.  Thank  you,  Mr.  Chairman.  Ms.  Austen,  we  under- 
stand that  the  New  York  Act  has  been  amended  since  it  was  first 
adopted.  Can  you  tell  us  generally  the  nature  of  thos^  amend- 
ments? 

Ms.  Austen.  Well,  one  of  them  was.  the  exemption  for  sm^ll 
volume  tests  which;'^as^r  say,  was  a  portion  of  the  section  rather  of 
the  original  bill. 

Mr.  Williams.  Is  that  a  major  amendment? 
^  Ms.  Austen.  Y<3Sy  it  was.  It  permitted  testing  to  continue  that  we 
-^y tr-as JLsay.,jKaaj^^  by_this  regulation.  The  precedent 

exists  for  exclusion  exemptionsTor  small  businesses  in  many^her 
kinds  of  regulations.  It's.something  that  occurs  all  the  time.  We're 
often  asked  i£  it's  good  for  one,  why  isn't  it  good  for  all.  Well,  the 
fact  is,  its  smallness  sometimes  counts  *for  something.  It  was  that 
exemption. 

There  was  also  a  clarification  that  the  bill  only— or  the  law 
would  only  apply  to  tests  given  in  New  York  rather  than* used  in 
New  York.  There  was  some  question  th^  College  Board  brought 
suit— that  if  a  test  was  given  to  a  student  in  Idaho,  for  example. 
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<  who  applied  to  Columbia  in  New  York,  that  if  Columbia  used  that'  . 
exam  because  college  board  was  jiving'a  different  test  different 
States— they  were  giving  one  SAT  test  in  Nfew  York  and  a  different 
one  in  the  rest  of  the  country— the  test  that  was  used  by  the  admis- 
sions, officer  in  New  York  would  come  under  the  purview  of  the  leg- 
islation and  therefore  would  have  to  be  disclosed  and  would  spoil 
their— thejr  action  to  give  a  different  test  in  other  States. 

There  was  flexibility  given  in  the  law  for  the  special  tests  that 
are  given  for  handicapped  students,  walk-in  students,  makeups, 
and  Sabbath  observers  that  created  some  flexibility  to  allow  the 
•  test  agencies  to  run  a  particular  exam  a  few  times  because  of  the 
low  volume  of  the  £akers  to  use  that  for  a  couple  of  years  and  then 
disclose  it.  I  believe  that  was  the- —  ,  , 

Mr  WiLUAMS.  As  you  know,  there  are  those  of  us  who  are  con-, 
cerned  that  ^testing,  and-  by  the  way  professional  licensing  proce- 
dures also,  are  hurdles  that  may  be  overly  high  and  prevent  signifi- 
cant segments  of  the  population  from  achieving  their  educational 
and  professional  goals.  Many  of  us;  and  the  testing  community,  I 
think,  is  among  them  are  concerned  that  economic  advantage  leads 
to  socioeconomic  advantage,  leads  to  scholarship  advantage,  leads 
ib  college,  which  leads  to  economic  advant^e  and  the  tests  may 
not  reflect  that  cycle.  They  may  speed  it  up.  How  does  the  Truth  in 
Testing  Act  in  New  York  assist  in  slowing  down  that  cycle  and  low- 
lering  those  hurdles?  ,  .  ,     tu  *      i  * 

Ms  Austen.  Well,  I  think  it  did  nothing  to  accomplish  that  goal 
immediately.  It  began  a  process  which  over  the  years  we  hope  will 
begin  to  address  itself  to  that  problem.  There  were  a  couple  of 
things.  First,  we  felt  that  by  exposing  the  exams  to  all  students 
rather  than  the  students  who  take  these  coaching  cours^  that  in 
effect  had  the  exams  for  $300-in  I^ng  Island  n^ow  ^ejiaye-stu. 
dents  taking  the  coaching  courses  for  the  PSAT  at  $250.  It  has 
gotten  tdtalto  out  of  hand  but  we  felt  that  by  putting  them  on  file 
and  now  w^t  ETS  is  doing  you  don't  have  to  go— our  bill  permit- 
ted you  to  g6  to  the  Commissioner  of  Education  to  get  the  exam  it 
you  hadn't  taken  the  exam  yourself— the  retired  exam.  ETb  has,  to 
my  knowledge,  has  opened  their  files.  If  they  have  disclosed  it  any- 
where, it's  available  to  anyone  or  simply  writing  m.  So  by  Mvmg 
that,  by  making  available  other  tests  without-having  to  pay  admis- • 
.  sion  to  a  course,  we  felt  that  students  who  could^take  advantage  of 
just  preparing  themselves  by  not  learning^  new  things,  just  looking 
at  the  exams  themselves  and^perhaps  having  someone  do  on  an  in- 
formal basis  the  coaching— a  teacher  perhaps  or  a  parent  or  whom- 
ever—we  felt  that  that  would  begin  to  close  that  gap,  that  we 
would  not  have  the  economic  barrier  to  a  coaching  setting  that  ex- 

There  was  also,  it  came  to  our  attention,  a  geographit  barrier  If 

 ^5iraian'rlrai^Trto-live-near-a-c^nteiLima-me.t^^^ 

offered  these  courses,  you  couldn't  take  them  no  matt^  how  much 
you  had  so  there  were  those  two  barriers.  We  felt  we  ve  begun  to 

Second,  we  felt  that  all  this  information  that  was  coming  out 
about  the  test  that  was  .again  pointed  out  earlier  this  morning,  the 
coachability  of  the  tests  and  some  of  these  otner  things  that  they 
are  so  willing  to  give  out  now  were  not  available  a  couple  ot  years 
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ago.  People  that  assisted  in  these  studies'' were  unable  to  get  some 
of  the  information  so  we  felt  fhat  reports  that  would  come  out  as  a 
result  of  this  new  openness  would  show  admissions  people,  we  can't 
change  how  admissions  occur  legislatively,  we  felt.  There  has  to  be 
so  much  flexibility  that  that  v(asD't  something  that  we  felt  could  be 
regujated,  but  we  did  feel  that  admissions  officers  were  blindly 
using  these  tests  because  they  felt  that  they  did  so  much.  They 
could  determine  who  was  a  qualified  student  and  who  wasn't. 

At  our  hearing  we  had  admissions  officers  parrot  exactly  testimo- 
ny that  had  been  given  to  them  by  testing  agencies.  The  relation- 
ship had  occurred  over  the  years  and  they  were  blind  believers, 
and  I  want  to  tell  you  that  they  are  somewhat  embarrassed  at-this 
.point  and  there  are  quotes  that  I  have  that  have  been  reported  in 
major  newspapers  and  so  forth.  When  these  errors  came  out  in  the 
exams,  these  people  were  astonished.  They  were  supposed  to  be  in- 
fallible, not  only  as  to  the  correct  answers  but  also  ias  to  what  they 
predicted,  and  they're  not  and  the  admissions  people  are  now— 
they  have  to  in  good  conscience  think  back  what  am  I  really  using 
this  tool  for  and  how'  am  I  going  to  use  it  in  the  future,  and  we  feel 
that  that  again  change  over  the  years  will  change  the  process  but 
it's  not  an  immediate  change. 

Mr.  Weiss.  Ms.  Austen,  you  might  be— I'm  sure  that  you  re 
aware  of  a  group  whose  executive  director  testified  before  us  in 
July,  the  East  Harlem  College  and  Career  Guidance  Center.  They 
operate  in  East  Harlem  and  because  of  the  availability  of  the  tests 
now,  they're  able  at  no  cost  .at  all  to  set  up  a  program  for  kids  in 
the  East  Harlem  community  who  before  wouldn  t  have  thought 
about  taking  the  SAT  because  they  were  just  convinced  that  they 
could-never  pass  those  examinations  so  that,  in  fact,  jiist  sheer  dis- 
closure .is  having,  I  think,  some  very  profound  societal  effects,  and  I 
think  that  your  analysis  is  quite  accurate. 

Again,  thank  you  very,  very  much  arid  we  hope  that  the  next 
time  we  invite  you  down  we'll  be  a  little  closer  to  having  Federal 
legislation  on  the  books. 

Ms.  Austen.  That  could  be.the  bill  signing  ceremony. 
,Mr.  Weiss.  Right.  Well,  I  suspect  you're  going  to  have  to  testify 
before  the  Senate  before  that  happens.  ^ 

,  Ms.  Austen.  OK.'  ,  "  .  \,    t  i 

Mr.  Weiss.  Our  next  and  last  witness  for  the  day  is  Mr.  John 
Cooper,  president;  Association  of  Medical  Colleges.  Mr.  Cooper. 

STATEMENT  OF  JOHN  COOPER,  PRESIDENT,  ASSOCIATION  OF 

»  MEDICAL  COLLEGES 

-'Mr.  Cooper.  Thank  you  very  much  Mr.  Weiss.  The  association 
appreciates  this  opportunity  to  report  on  its  continuing  experience 
with  legislation  and  legislative  proposals  relating,  to  standardize 

testing.  ^        A      .   .  /. 

I  am  Dr.  John  A.  D.  Cooper,  president  of  the  Association  of 
American  Medical  Colleges.  It  was  felt  so  important  for  me  to  be 
here  today  that  I  left  our  association's  annual  meeting  of  some 
3^900  medical  educators  to  do  so.  We  hope  our  testimony  helps,  the 
subcommittee  to  determine  that  the  purposes  of  these  hearings 
have  been  accomplished  and  that  further  consideration  of  this  bill 
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is  not  warranted.  We  strongly  believe  this  to  be  a  rational  conclu- 
sion from  the  information  presented  at  these  hearings  and  from 
the  accumulated  natiqnwide  experience  during  the  interval  since 
this  legislation  was  first  introduced.  u  xi.  x 

We  WouldJike  to  review  briefly  the  reasons  why  we^are  told  that 
this  legislation  is  Tiecessary.  .  . 

First,  there  is  widespread  concern  in  the  States  about  this 

matter.  ^ «      ,     ,  j.  i 

Second,  we  can  expect  a  ''proliferation  of  State-level  disclosure 

laws  that  will  create  a  complex  regulatory  web  of  for  test  givers. 
Third,  test  sponsors  are  not  sufficiently  accountable; 
^  Fourth,  test  disclosure  is  necessary  to  detect  and  prevent  scoring 

errors.  ^     o  ^ 

Fifth,  test  disclosure  is  necessary  to  equalize  access  to  coaching 

courses.  "  r    i  • 

We  believe  that  none  of  these  reasons  are  valid  reasons  for  legis- 
lation either  at  the  Federal  or  State  level. 

Part  of  the  response  to  the  question  of  widespread  concern  was 
offered  by  Barbara  Leaner  in  her  article  in  the  March  1981  issue  of 
American  Psychologist.  She 'reviewed  the  data  from  10  different 
public  opiniop  surveys.  In  none  of  the  10  was  she  able  to  find  evi- 
dence of  any  widespread  concern  that  proponents  would  have  us 
believe  exists.  ^  ,    ^  i  • 

But  what  has  been  happening  at  the  State  level?  Mri^  Perkins 
began  these  hearings  over  2  years  by  cautioning  those  present  that 
the  issues  under  consideration  were  traditionally  the  orovince  of 
the  States.  Directly  related  to  the  issues  raised  by  Mr.  Perkins, 
testing  legislation  has  been  studied  quite  explicitly  in  .almost  one- 
third  of  the  State  legislatures  during  the  past  2  years.  The  r^ult  to 
date  has  been  most  instructive.  Not  a  single  State  has  passed  legis- 
lation in  this  area  since  hearings  on  this  subject  were  begun  by  the 
U  S.  Congress.  The  message  from^  this  accumulated  experience 
should  be  unmistakable.  It  should  at  least  signal  very  clearly  that 
there  is  a  great  amoUnt  of  doubt  in  a  great  many  States  about  the 
.  wisdom  of  such  legislation.  «      ,     ,     x-  i 

There  is  overwhelming  evidence  from  State-level  activity  also 
easily  disposes  of  another  phantom— the  second  reason  for  legisla- 
^  tion,  that  is  the  "proliferation  of  State-level  di«;lo6ure  lavg  that 
will  create  a  complex  regulatory  web  Tor  test  givers.  Recent 
amendmiSits  to  existing  New  York  and  California  law  do  not  alter 
this  conclusion*  L       .      .  \ 

A  very  important  finding  of  these  State  inquines  has  been  the 
repeated  recognition  of  the  diversity  and  complexity  of  the  issu^ 
being  addressed.  It  was,  recognized  that  one  test  is  hot  pretty  much 
like  another  and  that  the  purposes  of  tests  vary  widely.  We  have 
attempted  over  a  nurtiber  of  years  to  brin§  this  point,  to  the  atten- 
tion of  those  who  would  have  such  legislation  including;Dr.  Sunder 
Lavale  and  Ms.  Austin.  "  xx      /. /.  i 

Our  test  does  differ  from  the  other  test  and  as  a  matter  of  fact 
that  was. recognized  by  Representative  Marks  in  California  in  his 
amendment  and  we  were  exempt  from  that  amendment  on  the 
;b«sis  that  it  is  different.  We  do  use  a  different  procedure  than  are 
used  by  the  other  test  designers  for  the  construction  and  the  vali- 
dation of  the  t^t.  /      *  ,  ** 
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We  spent  a  lot  of  money  to  develop  what  we  thought  was  a  niuch 
more  effective  test,  tests  wliich  gave  much  better  information  to 
those  who  took  it  and  those  who  were  using  the  test  results  m 
anyway.  We  think  that  has  l^en  accomplished  and  we  want  to  con- 
tinue to  malce  the  point  that  we  are  different. 

The,  circumstances  under  which  the  tests^  are  administered  and^ 
the  .wkys  in  which  test  scores  are  used  were  found  to  be  variable. 
InJhoH  what  may  have  appeared  appropriate  and  equitable  to  ne- 
quire  6ne  program  was  seen  to  be  inappropriate  and  destructive  for 
another.  Our  medical  college  admission  test  is  the_case  in  point. 
We  have  argued  that  the  MCAT  is  a  highly  specialized  achieve- 
mettt  examination  with  specifications  drawn  very  tightly  to  insure 
mafximum  relevance  to  medical  education  and  to  provide  .maximum 
Guidance,  to  the  candidate  for  his  or  her  preparation  for  the  test, 
we  did  disclose  the  nature  of  those  restrictions  for  any  legislation 
that  was  introduced  in  either  California,  New  York,  or  proposed  in 
the  national  Congress. 

The  MCAT  manual  which  the  students  can  obtain  at  a  low 
cost  provides  them  with  very  explicit  instructions  on  the  are&s- in^ 
which  the  test  items  are  drawn.  And,  second,  it  provides  Ihem  with 
a  test  which  permits  them  to  and  how  the  individual  types  of  ques- 
tions are  developed.  It  also  provides  them  with  a  test  which  they 
can  use  themselves  in  trying  to  determine  their  preparation,  their 
readiness  to  take  a  test  of  this  kind.  Data  were  collected  from  a 
cross-section  in  developing  the  questions.  Data  were  collected  from 
a  cross-section  of  approximately  150  medical  faculty  to  determine 
what  they  considers  as  relevant  to  the  study  and  practice  of  inedi- 
cine.  Testimony  was  heard  last  summer  from  an  MCAT  examinee, 
Ms.  Carolyn  Bennett,  that  she  and  her  colleague?  considered  the 
MCAT  a  fair  representation  of  what  studentG  should  know  to  get^ 
into  medical  school. 

All  of  this  is  now  irjL  serious  jeopardy  as  a  result  of  this  bill.  Dis- 
closure of  test  questions  and  answers  as  required  by  the  New  York 
law  and  by  H.R.  1662  would  destroy  the  MCAT  since  under  these 
conditions  there  simply  is  not  a  sumcient  supply  of  questions  that 
would  meet  the  specifications  of  the  test.  Disclosure  is  also  incom- 
patible with  the  conditions  under  which  the  MCAT  must  be  admin- 
istered with  the  result  that  our  ability  to  write  and  test*  new  ques- 
tions and  equate  new  forms  would  be  seriously  compromised. 

These  kinds  of  considerations  wer^^  apparently  persuasive  in  sev- 
eral States  since  we  were  advised  a  number  of  times  that  should 
legislation  prove  feasible,  the  MCAT  would  be  excluded.  The  same 
issues,  by  the  way,  were  fundamental  in  our  pleadings  before  the 
Federal  court  in  the  northern  district  of  New  York  that  led^  to  our 
being  awarded  a  preliminary  injunction  preventing  New  York  from 
enforcing  the  disclosure  provisions  of  its  law  against  the  MCAT. 

The  third  issue  raised  dealt  with  .the  accouhtability  of  test  spon- 
sors. I  have  explained  in  previous  testimony  how  the  MCAT  pro- 
gram is  directly  accountable  to  the  126  medical  schools  of  the 
-  United  States,  their  faculty,  students,  and  administration  and  how 
we  provide  tor  the  continuing  counsel  of  the  candidate's  premedical 
faculty..  Proponents  direct  the  issue  pf  accountability  not  only  to 
test  contents  but  also  propose  extending  disclosure  to  all  studies, 
'  data  analyses,  reports,  and  so  forth  as  though  test  sponsors  control 
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all  research  and  evaluation  associated  with  the  test  and  have  no 
,  reason  to'  feel  accountable  to  the  public  which  it  serves;  On  the  oc- 
casion of  our  last  appearance  in  th\s  forum,  we  submitted  three 
early  studies  conducted  independently  of  the  AAMC  is  a  demon- 
stration that  the  test  sponsor  is  not  the  sole  source  of  information- 
about  a  test.  We  haye^  now  counted  ^21-  independently  prepared 
studies  relating  to  the  interpretation  and  use  of  the  new  MCAT 
that  n^ve^  appeared  in^he  literature>  Appendix  A  includes  21  of 
these  citations  for  your  perusal  The  list  cites  studies  conducted  at 
15  different  schools.  In  addition,  the  AAMC  has  developed  a  cooper- 
ative arrangement  with  othfer  schools  *to  stimulate  their  interest  in 
conducting  local  studie^  thak  will  contribute  at  the  same  time  to 
nationally .  aggregated  infornmation.  The  result  is  that  over  40 
schools  arp  actively  engaged  ik  studying  the  effectiveness  of  the 
MCAT  and  will  be  preparing  amcles  for  publication  that  the  test 
sponsor  has  no  opportunity  to  control.  Contrary  to  the  claims  of 
the  bill's  proponents,  it  seems  thatV  high  degree  of  accountability 
exists  in  this  situation  where  approximately  one-third  of  the  insti- 
tutional Users  of  a  test  are  actively  inwlved  in  the  evaluation  ofjts 
effectiveness.  ^  \ 

The  fourth  reason  cited  suggested  thkt  the  test  disclosure  was 
necessary  to  detect  and  prevent  scoring  errors.  The  term  "scoring  ^ 
errors"  as  we  have  understood  it  have  beten  used  in  at  least  two 
ways:  One,  to  refer  to  an  incorrectly  calculated  score,  and  two,  to 
refer  to  a  question  that  has  ambiguities  in  thk  correct  solution  that 
*  has  been  identified.  It  is  our  contention  thatxhe  exposure  of  test 
questions  and  answers  as  required  by  H.R.  1662\is  a  classic  case,  of  . 
killing  fleas  with  a  sledge  hammer.  If  a  serious\pf>blem  exists  in 
this  regard,  other  review  mechanisms  preserving  the  security  of 
the  examination  materials  are  certainly  available  to  provide  the 
necessary  assurances.  In  the  MCAT  program  we  haye  institutcid  a 
series  of  checks  and  balances  both  before  and  after  the  administra- 
tion of  every  test,  in  order  to  achieve  the  highest  probability  of  de- 
tection of  an  error  of  either  kind.  We  have  detailed  in  preyious  tes- 
timony all  of  the  steps  taken  in  the  development  and  testing  of 
each  mdividual  Question.  In  addition  16  these  safeguards  common 
to  the  industry  as  a  whole,  we  have  special  field  tryouts  before  a 
question  is  ever  used  where  samples  comparable  tc^  our  examinee 
"population  are  engaged  in  a  dialog  seeking  a  variety  of  reactions  to 
questions  under  development.  And  that  sample  does  iljclude  minor- 
ities among  others.  In  addition,  after  each  administration  we  have 
an  elaborate  formal  score  verification  process  that  is  deigned  to  be 
a  final  .che^k  on  po^ible  problems  in  the  scoring  of^  an  answer 
.sheet,  questions  with  potential  ambiguities  in  the  keying  of  the  cor- 
rect answer,  and  the  potential  errors  in  the  determination  of  scaled 
scores  and  their  equivalency  with  previous  forms.  These  checks 
employ  visual  inspection  of  answer  sheets,  comments  from'^examin- 
ees  who  haye  taken  the  test  and  those  comments -are  imniediately 
forwarded  to  the  test  developers  and  are  acted  upon,  a  review  of 
item  characteristics,  and  sophisticated  statistical  techniques. 
Though  we  are  confident  that  we  have  instituted  every  reasonable 
precaution  against  errors,  we  continue  to  evaluate  our  svstem 
through  the  ongoing  use  of  teams  of  external  consultants  who  are 
recognized  as  leaders  in  their  fi^ld.  \ 
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And  with  voUr  permission  I  would  just  like  to  give  their  qualifi- 
cations so  tW  you  can  evaluate  the  kind  of  people  that  we're 
using.  Dr.  Robert  Lynn,  professor  6f  education,  University  of  Illi- 
nois,, who  is  president  of  the  National  Council  on  Measurement  in 
Education.  Dr.  Laurie  Shepherd,  professor  of  education.  University  i 
of  Colorado,  president-elect  of  the  National  Council  on  Measure- 
ment in  Education^  .former  editor  of  the  Journal  of  Educational 
Measurement.  Richard.  Jaggar,  professor  of  education,  the  Univer- 
sity of  North  Carolina  in  Greensboro,  former  editor  of  the  Journal 
of  Educational  Measurement.      *  *      '  - 

The  question  then  js  what  would,  the  exposure  o£  all  test  ques- 
tions and  answers  contribute?  The  ahsvsrir  is  that  it  would  ^not  only 
destroy  the  current  .test  specifications  at  least  for  ttxe  MCAT,  but 
would  result  in  the  need  to' produce  greater  quantities  of  material 
with  a  corresponding  loss  in  avsiilable  resources  to  maintain  the 
current  checks  on  question  quality.  In  short,  the  proponents  of  this 
legislation' are  in  one  sense  in  an  envious  position.  For  test  spon- 
sors, on  the  other  hand,  it  is  a.  Catcti-22.  If  disclosure  is  mandated, 
more  poorer  .Questions  will  result  and  more  scoring  errors  will  be 
identified,  ju^ifying,  of  cour&e,.the  imposition  of  the  law, to  begin 
with  and  the  intrusion  of  the  Federal  Government  into  th^  educa- 
tional matters  that  are  by  long  tradition*  the  responsibility  of  the 
private  sector. '  •    •         -      .     i    •  i 

'  A  fifth  reason  we- have  heard  cited  in  support  of  testing  legisla- 
tion is  the  lieed  to  equalize-access  to  coaching  courses.  This  seems 
to  be  a  iftajor  justificatioi\  since  considerable  attention  is  planned 
'  for  the  subject  tomorrow  at  hearings  Jhere.  Several  subquestions 
•  have  been  raised  or  implied  in  the  discussion  of  coaching  cours^. 
First,  can  th^JFaffeet-test  performance,  how  much,  and  is  that  bad? 
Second,  if  some  can  increase  performancfe,  should  the  U.S.  Congress 
attempt  to  equalize  access  to  them?  Third,  how  does  H.R.  1662  ad- 
dress the  issue?  ,  , 

Concerning  the  impact  of  test  preparation  courses  that  they  can 
have  on  test  performance,  we  have  been  trying  *iW)llect  some  eni- 
pirical  data  about  participation  in  such  experiences  and  their  asso- 
ciation with  changes  and  performance  on  the  MCAT.  The  deeper 
^  we  probe  the  area,  the  more  complex,  the  more  contaminated  with 
uncontrollable  factors  the  question  becomes,  and  the  more  .hazard- 
ous any  usf»ful  generalizations  seem.  For  example,  our  data  is  vol- 
unteered by  the  candidates.  We  do  not  have  access  to  the  list  of 
people  that  are  taking  .th^ -coaching  courses.  It  reflects  a  wide  c*s- 
parity  of  review-experiences,  the  participants  have  differing  levels 
of  motivation)  they  start  with  different  'backgrounds,  et  cetera. 
With  these  caveats,  we  are  tentatively  concluding  that  though  on 
the  average  examinees  acknowledging  participation  in  commercial 
review  courses  exhibit  gains  iri  performance  on  a  second  adminis- 
tration of  the  MCAT,  the  gain  is  only  slightly  greater  than  that  ob- 
served for  those  repeating  the  test  after  the  same  interval,  but  not 
reporting  participation  in  a  formal  coulrse.  The  magnitude  of  the 
average  incremental  gain  is  on  the  order  of  one-tenth  to  one-half  of 
^a  scaled  score  point.  The  mapiitude  of  the  change  associated  with 
the  group  is  not  reporting  participation  in  a  commercial  review 
course  is  on  the  order  of  one-fourth  to  one  scaled  point.  To^  report 
more  specific  figures  at  this  time  we  think  would  imply  a  atability 
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*  and  the  confidence  for  these  results  that  we  have  not  yet  been  able  " 

•  to  establish.  We  did  find  consistently  that  the  higher  gains  were  for 
the  content  specific  sections  of  the  test,  that  is  biold^,  chemistry, 
and  physics-and  that  the  gains  observed  at  the  loyrer  ends  of  the 
ranges  were  associated  with  skills  analysis,  reading,  and  quantita- 
tive tests.  As  related  initially  at  the  lower  levels  on  the  Sills  Analy^ 
-isis:  Reading  and  quantitative  subtests  gained  least  from  the  typical 
review  coui*  experience.  Since  these  test  preparation  experiences  - 

-   tend  to' -be  Heavily  content  oriented  rather  than  emphasizing  the 
K    development  of  basic  thinking  skills,  such  a  test  preparation  expe- 
rience is  likely  to  have  relatively  little  payoff  for  examinees  with 
.  •  less  well  developed^ thinking  skills. 

If  as  it  now  appears  there  may  be  an  effect  on  MCAT  scores  asso- 
"Ciated  with  participation  in  a  review  course,  is  that  bad?  Changes 
.  ^  in  performance  oq  the  MCAT  as  a  result  of  a  test  preparation 
'   course  are  not  a  threat  to  the  validity  of  our  test.  In  fact,  tO:  the 
extent  that  a  test  preparation  course  or  any  other  effort  that  the 
student  uses  to  increase  and  gain  knowledge  enhances  the 
.-s  ^candidate's  knpwledge  or  skills  measured  by  the  t^t,  the  MCAT 
would.be  invalid  if  it  did  not  reflect  that  improvement.  In  this 
_regard,4t  should  be  understood  that  we  regularly  monitor  the  Teak- 
,    age  of  t<j8t  materials  frcto  the  program  to  assure  ourselves  that.ma- 
terials  reUsed  oncsubsequent  forms  have  hot  been  ^compromised. 

In  suimnfilry,  none  of  these  data  have  caused  us  to.  harbor  con- 
cerns aliout  the  .validity  of  the  test.  The  magnitude  df  ^e  changes 
within  ireasonable  b6unds,  and  the  type  of  change  and  interaction 
among 'types  of  performance  even  oner  evidence  for  theXconstruct  • 
validit3(  of  the  test,  that  is  the  diagnostic  value  of  the  sidlls  sub- 
tests. We  are  continuing  our  research  and  will  report  specific  find- 
ings asi  we  establish  the  stability  qf  our  earlier  indications. 

Theisecond  issue  related  to  coaching  was  whether  the  U.S.  Con- 
gress should  try  to  equalize  access  1»  test  preparation  courses  or  for 
that  riiatter  to  any  resource  that  might  be  effective  in  improving 
performance.  Proponents  simply— proponents  imply  that  it 
shoukf— but  the  issue  has  not  been  directly  confronted  Should  the 
answer  be  yes,  theri^new  le^slation  will  be*  required. 

This  brings  us  to  the  last  issue  wliich  iJs  whether  H.R.  1662  ad- 
dresdjs  the  concern  about  equalizing  access.  Presumably  the  link  is 
in  the  increased  availability  of  test  questions  and  answers  resulting 
from  mandatory  disclosure.  In  the  comments  accompanying  the  in- , 
troduction  of  H.R:  1662,  this  statement  is  made  and  r  quote: 

And  it  (the  t««ting  legislation)  would  leiwen  inequitieji  among  itudenU  create  by 
expensive  coaching  achooli  by  giving  evtJryone  equal  acceai  to  information  about  the 
teat  and  the  qu^ions  themielvet— not  widen  the  gap  between  stude nt«.  ^ 

At  best,  Jthis.  is  an  unproven  assei:tjon*  At  woi:8t,  testing  legisla- 
tion will  exacerbate  the  problem  ifi  the  sense  of  the  above  quote  in 
that  it  will  widen  the  gap^.  xr  i 

'  Tin^t^  from  the  experience  of  the  college  boards  m  New  York,  we 
know  that  the  small  numbers  requesting  their  questions  and  an- 
swers—fewer than  S  percent— disproportionately  m6re  are  from 
the  higher  socio-economic  groups  and  from  thoie  already  achieving 
high  Sores  on  the  test.  If  there  ,  is  ^  benefit  to  having  access  to 
questions  and  answers,  whom  then  will  it  benefit  most?  Clearly,  , 
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not  the.  disadvantaged.  If  the  test  preparation  experiences  continue 
to  be  expensive  and  therefore  access  for  the  disadvantaged,  contin- 
ues to  be  limited,  we  see  nothing  iu  H.R.  1662  that  will  change 
that  And  if  there  is  any  value  to  such  experiences,  advantaged 
groups  in  the  population  will  continue  to  be  the  primary^benefici- 
aries.  It  also  seems  quite,  reasonable  that  putting  more  information 
into  the  hands  of  the^  operators  of  such  courses  will  only  enhance 
their  potential  to  offer  effective  programs  of  preparation.  It  is  pre^ 
dictable  also  that  test  preparation^  courses  may  be  made  more  at- 
tractive by  their  being  perceived  as  the  collector  and  organizer  of 
the  flood  of  questions  and  answers  that  are  suddenly  available.  Un- 
explained, uninterpreted,  unorganized  bursts  of  questions  and  an- 
swers will  only  succeed  in  increasing  dependence  on  external  sup- 
port while  satisfying  the  resource  requirements  of  the  operators  in 
the  test>preparation  business  to  make  money. 

We  fail-  to  see  how  these  arguments  advance  the  support  of  H.R. 
1662  suiyive  the  caireful  scrutiny  6f  evidence  or  logic.  This  inter- 
vention would  be  contrary  to  the  clearly  expressed  views  of  the 
people  that  Federal  presence  should  be  reduced.  With  the  severe 
restriction  in  available  resources  it  does  not  seem  logical  to  spend 
the  public  purse  on  unnecessary  regulatory,  initiatives.  In  our  view 
these  hearings  have  amply  demonstrated  all  the  fundamental  flaws 
of  H.R.  1662  and  we  urpe  that  the  si:bcommittee  not  report  this 
measure  to  the  full  committee.  Thank  you  very  much  for  your  kind 
attention. 

[Prepared  statement  of  John  Cooper  follows*] 


780 


776 

Pre  PARED  Statement  or  John  Coopex,  President,  Association  or  American 
Medical  Colleges  - 

Qiaixneh  Perkins  and  Sinon,  and  Mestfcers  of.the  Subcotitdttees  on  Elementary, 
Secondary,  and  Vocational  Educaaon,  and  on  Postseoondary  Education: 

The  Associaaon  of  Airerican  Medical  Colleges  (AAMC)  appreciates  this 
opportunity  to  report  on  its  continuing  experience  with  legislaaon  and 
legislative  proposals  relating  to  standardized  testing.  I  am  Dr.  John  A.  D. 
Cooper,  the  President  of  the  AAMC.  I  felt  it  was  so  iirportant  to  be  here 
today,  that  I  left  our  Association's  Annual  Meeting  to  do  so.  We  hope  our 
testiiTony  helps  the  svibcomnittees  determine  that  the  purposes  of  these 
hearings  have  been  acoonplished  and  that  further  oorisideration  of  this 
bill  is  not. warranted.  We  strongly  beUeve  this  to  be  a  rational  conclusion 
fran  the  information  presented  at  these  hearings  and  from  the  accumulated 
natiomiade  experieno^  during  the  interval  since  this  legislation  was  first 
introduced. 

Vfe  would  like  to  review  briefly  the  reasons  why  we  are  told  that  this 

legislation  ^s  necessary.  _  _\  

/I.  y 'ihere  is  widespread  concern  in  the  states  about  this  natter. 

2.  We  can  expect  a  "proliferation  of  state-level  disclosure  laws 
that  will  create  a  corpl^x  regulator^  web  for  test  givers." 

3.  Itest  sponsors  are  not  sufficiently  acoountable,  . 

4.  Otest  disclosiure  is  necessary  to  detect  and  prevent  scoring  errors. 

5.  Otest  disclosure  is  necessary  to  equalize  access,  to  coaching  courses. 


Presented  by  Dr.  John  A.  D.  Cooper,  President,  Association  of  American 
Medical  Colleges/  before  the  House  Suboomrdttees  on  Elementary,  Secondary, 
and  Vocauonal  Education  and  Postseoondary  Education,  Comnittee  on  Education 
and  Labor,  Noivenber  4,  1981. 


781 


777 


Part  of  the  response  to  the  qiiestion  of  widespread  concern  was  offered^ 
by  Barbata  Lemer  in  her  article  in  the  March  1981  issue  of  the  American 
■Psvcholcqist.  She  reviewed  the  data  frcrrv  10  different  public  opinion  surveys. 
In  none  of  the  10  was  she  able  to  find  evidexice  of  the  widespread  concern 
proponents  \Jould  have  us  believe. 

But  what  has  been  happening  at  the  state  level?  Mr.  Perkins  began  these 
hearings  over  two  years  ago  by  cautioning  those  present  that  the  issues  under 
consideration  were  traditionally  the  province  of  the  states.  Directly  related 
to  the  issue  raised  by  Mr.  Perkins,  testing  legislation  has  been  stuiied 
quite  e^^Ucitly  in  ainost  one-third  of  the  state  legislatures  during  the 
past  two  years.  The  result  to  date  has  been  irost  instructive.  Not  a  single 
state  has  passed  legislation  in  this  area  since  hearings  on  this  subject 
were  begun  in  the  U.S.  Congress.  Ihe  message  frcm  this  accumulated  experience 
should  be  unmistakable.  It  should  at  least  signal  very  clearly  that  there 
is  a  great  arrount  of  doubt  in  a  great  many  states  about  the  wisdom  of  such 
XegislationiT 

This  overwhclmuvg  evidence  fron  state- level  activity  also  easily  disposes 
of  another  phantom  —  the  second  reason  for  legislation,  i.e.  the  "proliferation 
of  state-level  disclosure  laws  that  will  create  a  oonplex  regulatory  web  for 
test  givers."  Recent  arwsndments  to  existing  IJew  York  and  California  law  do 
not  alter  this  conclusion. 

A  very  ijrportant  finding  of  these  state  inquiries  has  been  the  repeated 
recognition  of  the  diversity  and  complexity  of  the  issues  being  addressed. 
It  was  recognized  that  one  test  is  not  pretty  much  like  another  and  that  the 
purposes  of  tests  vary  widely.  The  circunstances  under  viiich  they  are 
administered  and  the  ways  in  which  test  scores  are  used  were  found  to  be 
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quite  variable.  In  short  what  may- have  appeared  appropriate  and  equitable 
to  require  of  one  program  was  seen  to  be  inappropriate  and  destructive  for 
another.  Our  Itedical  College  Admission  Otest  (MOlT)  is  a  case  in  point.  We  ^ 
have  argued  that  the  .lCAT  is  a  highly  specialized  achieventmt  examination 
with  specifications  drawn  very  tightly  to  insure  roaxiirm  relevance  to 
nedical  education  and  to  provide  maxiitun  guidance  to  the  candidate  for 
his  or  her  preparation  for  the  test.  Data  were  collected  fran  a  cross- 
section  of  approxunately  150  nedj.cal  faculty  to  determine  viiat  is  relevant 
to  the  study  and  practice  of  medicine.  Testinony  was,  heard  last  sunnar  fron  . 
an  fCAT  exaninee,  fte.  Carolyn  Dennett,  that  she  and  her  colleagues 
considered  the  MCAT  a  fair  representation -of  y^t  students  should  know  to 
get  into  medical  school.  .  , 

All  of  this  is  now  in  serious  jeopardy  as'a  result  of  this  bill.  Dis- 
.closure  of  test  questions  and  answers  as  required  by  the  Ifew  York  law  and 
by  h:r.  1662  would  destroy  the  MM*  since  under  those  conditions  there  sinply 
is  not  a  sufficient  supply  of  questions  that  would  meet  the  specifications 
of  Jthe  test.  Disclosure  is  also  inoonpatible  with  the  oondiUons  under  which 
the  VCKV  niust  be  a^knlnistered  with  the-result  that  our  .ahility  to  write^^ 
test  he-y  questions  and  equate  new  forms  would  be  seriously  cotprcmised. 

Itiese  kinds  of  considerations  were  apparently  persuasive  in  several 
states  since  we/were  advised  a  nutter  of  times  that  should  legislation  prove 
feasible,  the^MM  would  be  excluded.  The  same-issues,  by  the  way,  were 
fundamental  in  our  pleadings  before  the  federal  court  in  the  Northern 
Disttrict  of  New  York  that  led  to  our  being  awarded  a  pieliitdnary  injunction 
preventing  Hew  York  from  enforcing  the  disclosure  provisions  of  it  law 
against  the  >CAT. 
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The  third  issue  raised  dealt  with  the  accountability  of  test  ^nsprs^ 
X  have  explaired  in  previous  testimony  how  the  MCAT  program  is  directly 
accowtable  to  the  126  nedical,  schools  of  the  United  States,  their  facult^r, 
students,  and  adn:unistration  and  how  we  provide  for  the  continuing  counsel 
of  the  candidates*  prernedical  faculty.  Proponents  direct  the  issue  of 
accountability  not-  only  to  test  contents  but  also  propose  extending  dis- 
closure (to  all  studies,  data  analyses,  reports,  etc.  as  though  test 
sponsors  ocxitrol  all  reseeuxh  and  evaluation  associated  wi^th  the  test 
and  have  no  reason  to  feel  accountable  to  the  public  it  serves.  On  the 
occasion  of  our  last  appearance  in  this  forum,  we  suhnatted  three  early 
studies  cxjndocted  independently  of  the  AAtC  as  a  denonstration  that  the 
test  sponsor  is  not  the  sole  source  of  information  about  a  test.  We  have 
now  counted  21  independently  .pr^>ared  studies  relating  to  the  interpretation 
and  use  of  the  rJSw  MOT  that  have  appeared  in  the  literature.  Appendix. A 
inclu3es  21  of  these  citations  for  you  perusal.  The  list  cites  studies 
ccndoctod  at  15  different  schools.  In  addition,  the  AAMC  has  also  developed 
a  cooperative  arrangement  witn  other  schools  to  stimulate  their  interest  in 
conducting  local  studies  that  will  contribute  at  the  same  time  to  nationally 
aggregated  information.  The  result  is  that  over  40  schools  are  actively  ~~ 
engaged  in  stuiying  the  effectiveness  of  the  MCAT  and  will  be  preparing 
articles  for  publication  that  the  test  sponsor  has  no  opportunity  to  control. 
Contrary  to  the  claims  of  the  bill's  proponents,  it  seems  that  a  high  degree 
of  acoovntability  exists  in  this  situation  where  approximately  one-third  of 
the  institutional  users  of  a  tost  are  actively  involved  ih  the  evaluation 
of  its  effectiveness.  .  « 
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Th^  fourth  reason  we  cited  suggested  that  test  disclosure  was  necessary 
to  detect  and  prevent  scoring  errors.  The  tem  '^scoring  errors"  as  we  have 
inderstood  it  has  been  used  in  at  least  two  ways:  1)  to  refer  to  an  incorrectly 
calculated  score  and  2)  to  refer  to  a  question  that  has  arrbiguiaes  in  the 
correct  solution  that  has  been  idenUfied.  It  is  our  oontenaon  that  the 
e>?»sure  of  test  quesUons  and  answers  as  required  by  H.R.  1662  is  a  classic 
case  of  killiDq  fleas  with  a  sledge  haimer.  If  a  seriQus  p^oblen  exists  in 
this  regard  other  review  irechanisms  presen/ing  the  security  of  the  examinaaon 
inajterials  are  certainly  available  to  provide  the  necessary  assuraices.  In 
the  JCAT  program  we  have  instituted  a  series  of  checks  and  balances  both 
befdre  and  after  the  administration  of  every  test  in  order  to  achieve  the 
hi^est  probabiUty  of  detectioA  of  an  error  of  either  kind.  Vfe  have  detailed 
in  previous  testiirony  all  the  steps  taken  in  the  developnent  and  testing  of 
each  individual  question.  In  addi^on  to  these  safeguards  comron  to  the 
industry  as  a  whole,  we  have  special  field  ^t?ryouts  before  a  quesaon  is  ever 
used  where  sairples  corparable  to  our  ex^nee  populaaon  are  engaged  in  a 
dialogue  seeking  a  variety  of  reac^ons  to  questions  under  developicnt.  In 
addition,  after  each  administration  we  have  an  elaborate  formal  score 
-^^^i'ficatlon  process  that  is  designed  to  be  a  final  check-on  possible  problens 


in  the  scoring  of  an  answer  sheet,  quesaons  with  poten^al  ambiguiaes  in 
the  keying  of  the  correct  answer,  ^and  the  potfentlal  errors  in  the  determinaUon 
of  scaled  scores  and  their  ^valency  with  previous  forms.  These  checks  atploy 
visual  inspecaon  of  answer  sheets,  catirents  fran  examinees  who  have  taken  the 
test,  a  review  of  itan  characterisacs,  and  soj^isticatod  staasacal  techniques. 
Ihough  we  are  confident  that  we  have  insatuted  every  reasonable  precauaon 
against  errors,  we  continue  to  evaluate  our  system  tJirough  the  ongoing  use 
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of  a  team  of  external  oonsultants  who  are  recognized  as  leaders  in  their 
field,  ihe  question,  then  is  what  would  the  exposure  of  all  test  questions 
and  answers  contribute?  The  ana^er  is  that  it  would  not  only  destroy  the 
cutr«5t^test  specifications  but  would  result  in  the  need  to  produce  greater 
quantities  of  2naterial  with  a  corresponding  loss  in  available  resources  to 
reintain  the  current  checlcs  <a3^question  quality.  In  short,  the  proponents 

-Of  this  legislation  are  in  one  sense  in- an  envious  position.  For  test 
sponsors  on^the  other  hand,  it  is  a  Catch- 22.  If  disclosure  is  mandated, 
wore  poor^  qi^stions  will  result  and  nore  scoring  errors  will  be  it^entified, 
justi^ing,  of  course,  the  iji|3osition  of  the  law  to  begin  with  and  the 
intrusion  of  the  federal  govemient  into  the  educational  matters  that  are 
b^/(ong  tradition  the  responsibility* of  the  private  sector. 

^      The  fifth  reason  we  have  heard  cited  in  support  of  testing  legislation 
is  the  need  to  equalize  access  to  "coaching"  courses.  This  seerns  to'i>e  a  c 
major  justification  since  considerable  attention  is  planned  for  the  subject 
torrorrow.  Several  subquestions  have  been  raised  or  aitplied  in  discussion  of 
"coaching"  courses.  First,  can  they  affect  test  performance,  how  much,  and 
is  that  bad?  Second,  ^if  some  can  increase  perfontance,  should  the  U.S.  Congress 
attenyt  to  equalize- access  to  thap?JIhird,  howdoes  H.R.  1662  address  the  * 


issue?  *  >        ,  ,  I 

Concerning  the  irrpact  test  preparation  courses  can  have  on  test  perfor 
we  have  been  trying  to  collect  some  enpirical  data  about  participation  in  jwch 
ej^perienoes  and  their  association  with  changes  in  performance  on  the  MCAT. 
Ohe  deeper  we  probe  the  area,  the  .more  cdrplex,  the  more  qpntaminated  yith 
mcontrollable  factors  the  question  becomes,  and  the  more  hazardous  any  useful 
generalizations  seem.  For  example  our  data  is  volunteered  by  the  candidates. 
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it  relfects  a  wide  disparity  of  reviev;  experiences,  the  participants  have 
differing  levels  of  rotivation,  they  start  vith  diff^ent  backgrounds,  etc. 
With  these  caveats,  we  are  tentaUvely  concluding  that  though  on  the  averag^ 
examinees  acknowledging  participation  in  comercial  review  courses  e^dUbit 
gains  in  performance  orva  second  aehOnistration  of  the  MCAT,  the  gain  is 
only  slighay  greater  t^^  that  observed  for  those  xqpeating  the  test  after 
the  sane  interval  but  not  reporting  participation  in  a  formal  course.  The 
magnitude  of  the  average  incremental  gain^is  on  the  order  of  one-tenth  to 
one-half  of  a  scaled  score  point.  Ohe  ragnitude  6f  change  associated  with 
the  giaDtp  not.reporting  participation  in  a  connerciaX  review  course  is  on 
the^  order  of  one-fourth  to  one  scaled  point.  To.  report  more  specific  figures 
at' this  tiite  would  iirply  a  stability  for  these  results  that  we  have  not  - 
yet  beeii  able  to  establish.  Vfe  did  Jfind  consistenUy  that  the  higher  gains 
vere  for  content  specific  sections  of  the  test,  i.e.  Biology,  Chesrdstry, 
•and  Physics  and  that  the  gains  observed  at  the  lower  ends  of  the  ranges 

tre  associated  with  the  SkiUs  Analysis:  Reading  ancJ  Quantitative  tests. 
A  rel^ted-but  very  interesting  observation  suggested  that  those  scaring 
iniaally  at  thTlovter^evels  on  the  Skills  Analysis;  Reading  and 
QuantitaUve  sii^tcsts  gained  least^feirt  the  ty^iical  review  course  e5<perience 
Since  these  test  preparation  experien^Ttfenf^ote  heavily  content  oriented 
rather  than  eni^hasizing  the  development  of;i>asic  thinitlng~,§kills,  such  a 
test  preparation  experience  is  likely  to  have  relatively  litUe  ^5^f-fot._ 
examinees  with  less  well  developed  thinking  skills. 

^    If  as  it  appears  there  may  b^  an/ effect  cn.WZAT  scores  associated  with 
participation  in  a  review  course,  is  that  bad?  Changes  in  performance  on 
'  the  MCAT  as  a  result  of  a  test  preparation  course  are  not  a  threat  to  the 
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validity  of  our  test.  In  fact,  to  the  extent  that  a  test  preparation  course 
or  any  other  effort  enhances  the  candidate 's.Ja>owledge  or  skills  neasUred 
fcy  the  test,  the  MCAT  would  be  invalid  if  it  did  not  reflect  that  inprovonent. 
In,  tJiis  regard  it  should  tje  urvJerstood  that  we  regularly  monitor  the  leakage 
of  test  materials  from  the  program  to  assure  ourselves  that' materials  reused 
on  subsequent  forms  have  not  been"  cxiii^ciiii'sed. 

In  sumary,  none  of  these  data  have  caused  us  to  harbor  oonoems  about 
the  validity  of  the  test.  Ihe  magnitude  of  the  change- is  within  reasonable 
bounds,  and  the  type  of  change  and  interaction  among  types  of  performance 
even  offer  evidence  for  the  construct  validity  6f  the  test,  i.e.  the 
.diagnostic  value  of  the  skills  subtests.  Vfe  are  continuing,  our  research  and 
will  report  specific  findings  as  we  establish  the  stability  of  our  early 
indications. 

Ohe  second  issue  related  to  coaching  was  "whether  the  U.S..  Congress  should 
try  to  equalize  access  to  test  preparation  courses  or  for  that  matter  to  any  ^ 
resource  that  might  be  effective  in  improving  performance.  Proponents  iiiply  I 
that  it  should,  but  the,  issue  has  not  been  directly  confrontec'.  Should  the  ' 
answer  be  yes,  then  new  legislation  will  be  required.  ' 

This  brings  us  to  the  last  issue  which  is  whether  H.R.  1662  addresses  ^ 
the  ^concern  about  equalizing  access.  Presunably  the  link  is  in  the  increased 
availability  of  test  questi<»^  and  answer^  resulting  frcrn  mandatory  disclosure. 
In  the  oorments  acccqpanying  the  introduction  of  H.R,  1662,  this  statement 
is  made,'' ."and  it  (testing  legislaticxi]  vould  lessen  inequities  among  students 
created  by  expensive  coaching  schools  by  giving  everyone  equal  access  to 
information  about  the  test  and  the  questions  themselves  —  not  widen  th^  gap 
between  students."  At  best,  tfds  is  an  unproveh  assertion.  At  worst,  testing 
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legislation  will/exacerba^  tho  problem  in  the  sense  of  the  above  qvx)te 
in  that  it  wil3/ widen  the  gap.  First,  frxxn  the  experience  of  the  College 
Boards  in  Newark,  we  know  that  of  the  smaU  numbers  requesting  their 
questions  anc/ answers  (fewer  thai<5t) ,  disproportionately  more  are  frm 
the  higher  jfccio-econcmic  groups  and  frcm  those  alreac^  achieving  high 
scores  on  the  test.  If  there  is  a  benefit  to  having  access  to  quesaons 
and  answers,  whoa  then  will  it  benefit  nost?  aearly,  not  the  disadvantaged. 
If  test  preparaaon  experiences  continue  to  be  expensive  and  therefore 
access  for  the  disadvantaged  continues  to  be  limited  —  we  see  nothing  in  ^ 
H.R.  1662  that  will  change  that  —  and  if  there  is  any  value  to  such  .  ^ 
experiences,  advantaged  groins  in  tl)e  population  will  continue  to  be  the 
primary  teneficiariesT  It  also  seems  quite  reasonable  that  putting  more  . 
information  into  the  hands  of  the  operators  of  such  courses  will  only 
enhance  their  potential  to  offer  effective  programs  of  preparaaon.  It 
is  predict^le  also  that  test  preparaaon  courses  may  be  made  more 
attracUve  by  their  being  perceived  as  the  collector  and  organiser  of  the 
flood  of  quesaons  and  answers  that  are  suddenly  available.  Une5q)lained, 
uninterpreted,  unorganized  bursts  of  quesaon  and  answers  will  only  succeed 
ijj  increasing  dependence  on  external  support  ^ile  saasfying  the  resource  ■ 
requirements  of  the  operators  in  the^test  preparation  business  to  make  money. 

We  fail  to  ^,how  any  of  these  argivitents  advanced  to  suppo^  H.R.  1662 
survive  the  careful  scrutiny  of  evidence  or  logic.  This  intervenaon  vould 
be  contrary  to  the  clearl/  expressed  views -of  the  people  that  federal-  presence 
should  bo  reduced.  With  the  severe  restriction  iri  available  resources  it 
does  not  seem  logical  to  spend  th^  public  purse  on  unnecessary  regulatory 
iniaaaves.  In  our  view  these  hearings  have  anply  demonstratcjd  all  the  fundamental 
flaws  of  H.R.  1662  and  we  urge  you  not  to  report  this  measure  fron  the  subcotmittees. 

Thank  you  for  your  kind  attenadn.  * 
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Mr  Weiss.  Thank  you  very  much  Dr.  Cooper.  AVe  appreciate  you. 
'taking  time  away  fr(Jfn  the  national  meeting  and  commg  to  testilv 
befori  our  subcomittees.  I  think  I'll  reverse  the  process.  Mr.  Wil- 

'  Mr'  Cooper.  With  your  permission  I,  of  course,  don't  have  the  ad- 
vantage  of  the  .fiearing  record  here  with  me.  I  did  call  and  hav^ 
someone  leave  ihe  national  meeting  and  go  to  our  offices  and  try  . 
and  review  the  hearing  records  becai^  I  wondered  if  I  d  had  /eave 
of  my  senses  in  making  the  statements  that  Congressman  Williams 
said  I  had  We  could  not  find  it  in  the  hearing  records.  And  I  can 
•  assure  you  that  we  do  have  the  lowest  attrition^ate  in  any  profes-. 
sional  school  in  the  medical  *:hool.  That  is  due  not  to  the  MCAT 
.tests  alone.  It  is  due  to  the  very  detailed  and  extensive  work  that 
admissions  committees  do  in  evaluating  the  grade-pthe  past  per- 
formance, the  MCAT  examination,  the  activities  of  the  studente, 
the  interviews,  and  letters^  of  recommendations.  And  the  m.Al  ex- 
amination in  some  of  these  preliminary  tests  which  have  been  pre- 
liminary examinations  which  have  been  repdrted  do  indicate  that 
it  does  add  to  the  selection,  but  in  no.  way  do  I  think  I  have. ever 
said  that  the  MCAT  was  responsible  for  the  lowering  in  the  attri- 
tion rate.Taidn't  mean  to  say  it  anyway.  *  <^  oo 

Mr.  WeJss.  You  and  Mr.  Williams  will  explore  that  further  as 
you  both  deem  appropriate.  Mr.  Williams,  ,. 

Mr  WilITams.  Thank  you,  Mr.  Chairman.  Mr.  Cooper,.my  earlier 
reference  las  to  a  person  I  said  at  the  time,  I  jouldn  t  call  his 
if6me^r  what  association  he  was  with  and  referred  to  the  tact  that 
he' was  repfeenting  some  element  within  the  medical-community. 
I've  since  fS^nd  the  hearing  recoYcJ  fend  for  the  record  let  me  de- 
scribe in  moie  detail  what  took  plafce.  .       .  ^ 

Mr.  JamesVGraham,  assistant  secretary.  Council  on  Dental  Edu- 
cation of  the  American  Dental  Association  appeared  before  the  suIh 
committee  in\  August  1979.  And  spoke  at  length  abo^^^^^ 
association's'siipport  for  admission  testing.  And  .'"^icated  that  the 
attrition  rate  WaT perhaps  three  times  as  great  oefore  the  institu- 
tion of  a  testing  program  then  after.  Otir^^^^^t 
'  As  I -recall  heiJtated  that  their  attrition  rate  was  20  to  25  percent 
■  befbre  the  dentalWmissions  testing  program- was  inaugurated  and 
now  wds-or  thenW  down  tp.approximately  a  7-percent  [ate. 

My  point  to  hiri^  was  this,  the  association  obviously  had  kept 
goo?  records  through  the  years  about  the  """pbe"^.  of ^^1° 
dropped  out  of  dental  schools  and  I  asked  them  n  they  had  kep^ 
eauafiy  good  records  on  why  the  students  were  dropping  out  or  who 
the  studeHts  were  that  were  dropping  out  and  his  answer  was- 
"J^o,  it  has  not."  I  then  wsnt  on  to  explore--now,  let  comiient 
about  that:  I  think  that  that  says  a  great  deal  m  iteelf.  I  think  that 
says  reams  about  a  lack  of  a  pursuit  concerning  who  s  dropping  out 
S  why  and  then  thaAlack  of  pui«uit,  in  turn,  says  a  great  deal 
abouU^e  la?k-of  an  eff^  to  prevent  that  attritition^hrough  some 
means  other  than  simply  not  allowing  that  student  into  that 
school  Perhaps  you'd  care  to  comment  at  this  point. 

Mr  CooPEiTl  am  sorry^Ir.  Williams  you'll  have  to  address  those 
questions  and  comment^  to  the  dental  schools  because  that  does 
'  ZTapZ  to.the  medical  sckools.  ^e  do  know  how  many  drop  out 
We  dfo  know  the  names  of\he  students.  As  a  matter  of  fact  we 
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have  extensive  records  going  back  many  years  with  regard  to  the 
reasons  for  the  dropouts,  because  some  medical  students  interrupt 
their  prc^am  to  do  a  year  of  research.  We  kftow  whether  it's  on 
the  basis  of  academic.performance,  on  the  basis  of  family  problems, 
and  with  the  reducing  support  of  medical  students  financial  sup- 
port by  the  Federal  Government  we're  finding  more  students' 
<  having  more  difficulty  in  going  through  a  regular  series  of  the  reg- 
ular course  of  study.  They  have  to  get  out  and  work.  But  we  do 

*  have  information.  We  do  know  how  many  drop  out  and  for  what  ^ 
reasons.  There  are  some  that  are  emotional  reasons.  And  ;we  have 
all  of  that.  So,  the  statement  that  you  made  and  attributed,  to  the  ' 

•  medical  school  does  not  apply  to  the  medical  schools. 

Mr.  WiLtiAMS.  Well,  let  me  correct  you  again.  I  didn't  attribute 
it  to  medical  schools,  I  attributed  it  to  a  gentleman  who  represent- 
ed an  association  of  some  element  of  the  medical  community  and  I 
was  accurate  with  regard  to  that  statement.  ^. 

I  appreciate  the  fact  that  your  association  takes  every  opportuni- 
ty to  maximize  opportunity  for  minorities  and  disadvantaged 
Americans.  I'm  from  Montana.  Our  disadvantaged  Americans  are 
the  original  Americans.  Very  little  is  done  by  anyone  to  maximize 
their  opportunity  in  medical .  schools  or  any  other  professional 
schools  in  this  country.  Very  little  is  done  for  those  people.  It's 
not — there  is  no  intentional  grounding  of  the  American  Indian,  it's 
just'that— I  think,  as  we'd  all  agree,  enough  isn't— isn't  being  done 
and  marty  of  us  live  with  the  American  Indian  or  near  the  reserva- 
tions or  in  States  where  the  American  Indians  are  very  sensitive  to 
the  fact  that  .that'^s  a  group— along:  with  some  others— Hispanics 
and  blacks  and  others  who  really  aren't  being  brought  into  the  pro- 
V .  fessional  mainstream  the  way  we  might  have  done  it  in  the  past 
half  century  or  century.  *       '     .  " 

Mr.  Cooper.  Mr,  Williams  I  couldn't  agree  with  you  more.  I  am  ^ 
native  New  Mexican  and  I  think  we  have  more  Indians  than  you 
do  and  Lam  very  sympathetic  and  have  worked  with  the  Indians 
and  th^  university  which  has  done  a  great  deal  in  New  Mexico. 
,  And  New  Mexico,  as  you  know,  the  majority  of  people  in  New 
■  Mexico  are  of  Spanish  origin.  And  I  have  an  office  of  minority  af- 
fairs. .  We  have  active  programs  in  recruitment  not  only  at  the 
medical  school  but  interesting  these  people  in  undergraduate  prep- 
aration for  medicine  and  as  a  selection,  of  medicine  as  a  career.  I 
can  say^that  Andy  Young  address-^we-rl  just-yesterday  after- 
noon and. we  have  a  minority  program  every  year.  And  in  our 
annual  meeting»to  discuss  what  ways  people  have  found  to  increase 
the  interest  of  these  students.  How  they  have  been  able  to  retain 
them.  Let  me  tell  you  again,  sir,  that  the  reduction Jn  Federal  sup- 
port has  played  an  unprecedented  role  in  reducing  their  interest 
because  the  minority  students  simply:  One,  do  riot  have  the  fund- 
'  jng  and  second,  they  are  not  accustomed  to  the  level  of  loans  ^and 
with  the  interest  rates  of  the  loan  which  are  SVz  points  above  the 
Treasury  91-day  bill.  They  just  can't  consider  that  kind  of  funding. 
We  have*  fought  very  hard  to  keep  that  exceptional  need  scholor- 
ship  program  in  and  it  is  completely  inadequate. 

That's  how  we  can  help  get  these  people  in  medical  schools  and 
keep  them  there.  In  addition  to  that,  we  have  developed  a  similar 
^     minority  application- minority  exercise  for  admissions  committees. 
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Those— we  have  taken  actual  case  records  and  s](iowed  these  and 
tiiese  have  been  given  without  cost  in  most  of  the  medical  schools 
now  in  the  United  States  and  we're  repeating  them.  We  work  with- 
admissions  committee  members  to  show  them  that  you  have  to  use 
nontraditional  criteria  in  admitting  these  students.  And  I'm  very 
proud  of  the  fact  that  inr  mediqal  schools  we  have  students  with 
very  high  MCAT  records  and  very  high  GPA  records  that  are  not 
admitted  to  any  .medical  school  because  they  are  found  lacking  in 
the  other  aspects  of  th*^  admission  process.  And  we  have  whites 
with  low  MCATs  and  low  GPA^s  and  we  have  minority  students 
with  low  MCAT's  and  low  GPA's  admitted. 

The  admission  committees  of  these  countries  in  the  medical 
schools  work  very  hard  and  have  not  been  slavish  to  the  use  of 
CPA's  or  MCAT's  or  any  other  single  criteria  as  has  been  clamed, 
at  least,  in  the  discussions  we  had  in  New  York  that  law  schools 
do.  We  have  not  done  that.  And  I  think  the  evidence  shows  that  we 
don't.  I  am  as  concerned  and  I  am  bilingual  in  Spanish.  I  learned 
to  speak  Spanish  before  I  did  English.  I  am  as  concerned  as  you  are 
about  the  inadequacy  of  it.  But  Andy  Young  stood  up  in  our  minor- 
ity meeting  and  said  I'm  not  going  to  lay  it  on  you.  I  was  just  put 
at  Stanford  in  the  graduation  exercises  for  the  MBA  class  and  the 
number  of  blacks  in  that.was  really  enormous.  He  said  you're  in  a 
hell  of  a  competition  because  we  used  to  be  able  to  only  increase 
our  social  status  through  law  or  through  medicine  or  through  reli- 
gion. Now,  we  have  many  other  opportunities.  And  you're  going  to 
have  a  tougher  and  tougher  time  increasing  the  number  of  stu- 
dents interested  in  medicine.  We  are  working  on  it  though,  very 
hard. 

Mn  Williams.  I  applaud  your  efforts.  Nay  I  ask  you  a  question 
about  one  statement  in  your  testimony.  When  you  wer^  referring 
to  equalizing  access  to  tests,  you  said  that  the  legislation  before  us 
would  exacerbate  the  problem  and  you  used  as  a  point  of  demon- 
stration the  fact  that  in  New  York  only  a  small  number  are  re- 
questing test  questions  and  answers.  Fewer  than  5  percent.  And 
said  that  disproportionally  more  of  those  are  from  the  higher  socio- 
economic groups  and  from  those  already  achieving  high  scores  on 
the  test.  That's  saying  that  equalizing  access  will  not  benefit  the 
disadvantaged.  ,         .      .  , 

I  guess^that  raises  two  questions.  First,  do  we  deny  access  simply 
because  the  wrong  people  are  taking  advantage  of  it  and  second 
isn't  this  further  demonstration  that  disadvantaged  students-^eco- 
nomically  or  socioeconomically  disadvantaged  students  are  because 
Of  the— because  of  their  history  less  likely  to  vigorously  pursue 
these  tests?  Isn't  that  further  proof  of  ^e  chilling  effect  that  tests 
have  on  those  who  are  already  some  fnghtehed  of  testing  authori- 
ty? 

Mr.  Cooper.  A .  responsible  test  agency  would  never  use  those 
same  questions  on  subsequent  tests.  The  only  advantage  of  having 
the  test  before  you,  would  be  to  show  what  questions  you  didn  t 
want  to  study.  That  may  be  an  advantage.  But  you -would  not 
repeat  those  questions.  ^     ^         i    ...  ,  r  xi. 

We  provide  in  an  MCAT  manual  that  has  been  submitted  for  the 
record,  to  Mr.  Weiss,  and  to  members  of- the  committee  and  I'll  be 
happy  to  submit  it  again,  extensive  information  to  the  students.  I 
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think  it's  $4.  That  gives  how  the  test  questions  were  derived.  What 
are  the  criteria  and  we  do  have  very  narrow  criteria.  They  have  to 
^  be  questions  that  a  student  taking  a  first  year-course  in  chemistry 
hot  at  Harvard,  but  across  the  country  would  have  expected  to 
have  had  knowledge  about  and  be  able  to  answer. 

Second,  it  has  it,  relevance,  as  we  have  seen  through  the  groups 
that  the  questions  to  what  they  think  they  should  know  to  get  into 
meOiCal  school.  We  tell  them  that.  We  tell  them  what,  areas  we're 
going  to  examine  in.  We  tell  them  the  types  of  questiqns  and  show 
them  examples  of  how  those  questions  are  developed,  and  How  they 
go  about  thinking  about  thoseiquestions.  And  then  we  give  them  ah 
^  ^actual  test.  That  test  is  the  same  test  that  they  would  have  gotten 
.  by  having  one  revealed  except  that  it  was  one  that  we  developed 
arid  used  experimentally  at  the  beginning  which  is  exactly  like  the 
test  we're  ^using  riow.  That  test  is  as  good  as  gettin&the  one  that 
you  have.  We  will  not  use  those  questions  either.  But  it  gives  you 
all  of  the  information  that's  valid  and  useful  fronf  a  test  that  is  re- 
vealed. 

By  the  way  we  have  proyided  long  before  legislation  was  intro- 
duced in  ,the  State  or  here,  we  have  provided  opportunities  for 
hand  scoring  of  tests  when  students  ask  about  them,  say  there  are 
-  problems.  We  have  provided  that  long  before  legislation  is  intro- 
duced. We  have  no  problem  complying  with  most  of  the  interests 
which  we  agree  with,  that  you  had.  We  agree  with  them  because 
we  have  instituted,  we  think,  measures  to  think  it.  The  only  pne 
that  we  disagree  with  is  the  main  pne.  Now,  there  may  be  some 
others,  but  the  main  one  is,/evealing  the  test. 

We  do  comply  with  California.  We  have  no  problem  in  the  finan- 
cial information  it's  all  available  out  there,  out  in  revealing  the 
test  questions  we  can  not  do  and  maintain  the  kind  of  tests  that  w6 
develop. 

Mr.  Williams.  Thank  you,  sir,  I  appreciate  the— appreciate  the 
dialog  here  this  afternoon. 

Mr.  Weiss.  Dr.  Cooper,  picking  up  right  there  I  must  tell  you 
that  you  have  me  confused,  and  that  may  not  be  your  problem,  it 
may  be  my  problem.  If  I  heard  you  correctly,  you've  just  said  that 
no  responsible  testing  group  would  ever  repeat  the  same  questions. 

Dr.  Cooper.  If  it  was  revealed. 

Mr.  Weiss.  OhrGK. 

Dr.  CcfOPER.  You  have  a  responsibility  to  the  other  test  takers, 
you  know,  that  no  one  has  an  advantage. 
Mr.  Weiss.  Then  I  did  mis-hear  you.  - 

Dr.  Cooper.  If  you  reveal  the  questions  you  certainly  would  not 
,   incorporate  thfem.  We  are  re-cycling  questions. 
Mr.  Weiss.  OK.  Now,  what  percentage? 
Dr.  Cooper.  We  have  to.  . 

Mr.  Weiss.  What  percentage  of  your  questions  do  you  re-cycle? 

Dr.  Cooper.  That,  I'm  sorry.  We  can  provide  it.  It^s  just  begin- 
ning because  what  we  have  done  is  over  the  years  developed  a 
series  of  test  forms.  We  are  now  reach— and  we  would  like  to, con- 
tinue to  develop  new  test  forms.  Now,  we  are  running  into  the 
problems  I  have  identified  of  the  availability  of  additional  ques- 
tions which  fit  our  criteria.  I  can't  tell  you  the  percentage,  it  is 
'  small  so  far,  but  I  think  will  increase  with  time. 


796 


792 


\ 


Now,  rm  sorry  that  I  don't  have  any  of  my  staff  here  because  I 
left  them  up  ther^.  .i.  x     *  > 

Mr.  Weiss.  Right.  OK.  Again  to  just  review  matters  that  you  ve 
testified  to  previously.  The  test  areas  that  vou  advise  your  test 
takers  that  you'll  be  testing  them  on  are,  at  least  in  the  heart  sci- 
ences: Chemistry,  physics,  biolo^^,  in  the  first  year  of  the  average 
college  course;  is  that  right?  ^  .  .  .i.  r»  ^ 

Dr.  C!ooPER.  Well,Uhe  first  course.  It  mav  not  be  in  the  first  year. 
"M^^Eiss.  First  course,  ri^ht.  OK.  And  what  you've  testified  to 
is  thatlS^^TMSon  that  you  think  that  it  would  be  inappropriate, 
wrong  to  discloSHhQse  questions  and  the  tests  is  because  there  is  a 
limited  number  of  qifeitiaiisttiat  you  can  ask  within  those  subject 
areas,  is  that  correct^i      ^^^^^^--.^^^  . 

Dr.  Cooper.  It  woiild  be  impossible-for  us  and  to  maintain  the 
tests.  Let  me  say  that  the  old  MCAT  testT^ch  we  felt  was  inad- 
equate, the  questions  there  we  could  have  reveafed^<lSoj)roblem  be- 
cause those  questions  ban  be  developed  in  huge  numbers^^We^w 
dissatisfied  with  that  approach.  That's  why  we  spent  $ly2  million 
to  change  the  test.  The  present  questions  are  very  restricted  to, 
one— the  criteria  that  you  just  said,  and  number  two,  to  the  exami- 
nation by  groups  of  medical  faculty  and  so  on  that  these  kinds  of 
questions  are  indeed,  they  believe,  relevant  to  what  a  student 
should  know  in  coming  to  medical  school. 

You  know,  what  are  the  dynamics  of  the  Space  Shuttle.  Those 
are  good  physics  questions.  They  are  not  related  to  medicine.  < 
That  s\why**^^  test  is  the  one  in  which  we  have  the  trouble,  If 
we  had  not  changed  our  MCAT  test  and  had  the  same  kind  of  gen- 
eral question,  we  >«ould  have  less  problem  and,  I  don  t  know,  we 
may  haW  had  no  problem  in  revealing  the  question  because  you 
caix>KeMrdte4ho6e-que8tioWs  by  the  thousands. 

Wwss.  So,  what  you're  saying  is  that  you  limit  the  area 
which  is  tested  within  the  particular  hard  sciences? 
Dr  Cooper.  Yes.  \  ^ 

Mr.  Weiss.  Such  a  narrow  focus— such  a  narrow  scope  that  in 
fact  you  have  iust  a  very  limited  number  of  questions  that  can  pos- 
sibly be  asked?  \  1.    .X  J 

Dr.  Cooper.  -They  certainly  are  much  niore  limited  than  they  , 
were  before.  There's  one  other  problem. 
Mr.  Weiss.  But  your  ansWer  is  yes? 

Drt  Cooper.  Yes.  One  other  \problem  and  that  is  we  have  a  more 
elaborate  evaluation  systein  of  the  questions,  I  think,  than  most 
other  test  groups  have.  We're  hot  a  testing  agency.  This  is  a  small 
part  of  the  overall  activity.  \ 

Mr.  Weiss.  Right.  i     \  ,     ^  «,  u      .  . 

Dr.  Cooper.  Let  me  just  go  thbugh  what  happens.  We  have  tests 
written  by  faculty  member  j.  W^  have  editors,  AIR  does  under  con- 
tract They're  reviewed  by  I  them.  Then  thfjy're  reviewed  by  mem- 
bers of  a  test  committee.  Then  there's  a  field  try  out  administra- 
tion on  a  selective  basis  to  examining  populations.  We  get  a  group 
of  college  students  that  mimic— r 

Mr  Weiss.  Doctor,  I  don  t  want  to  shortcut  you  but  arer  vou  fa- 
miliar at  all  with  the  process  that  the  Educational  Testing  Service 

Dr.  Cooper.  Yes,  sir.  I'm  not  personally,  no.  Our  people  are. 
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Mr  Weiss.  Your  people  are.  Because  I  must  tell  you  as  one  who 
was  part  of  a  congressional  delegation  of  this  committee  that  went 
down  to  Princeton  and  went  through  the  process  with  them,  I  was 
impressed.  They  do  exactly  the  kind  of  thing  that  you're  talking 
about.  They  take  people  in  the  field,  the  topmost  experts  in  the 
area,  and  they  toss  the  questions  around.  They  field  test,  they  use 
them  on  an  experimental  basis.  If  they  don't  meet  the  criteria  that 
they  set  up,  they  toss  them  out  because  they  feel  that  in  some  way 
the  way  the  question  was-phrased,  perhaps,  is  wrong.  Yet  in  spite; 
of  all  pf  that  tj.ievVe  ha(d  the  recent  experience  within. this  single 
calendar  year  of  having  two  questions  disclosed  by  high  school-stu- 
dents who  took  in  one  instance  the  SAT  and  the  other  the  PSAT 
that  having  gone  through  all^the  experts— hard  scientific  or  math- 
ematical questions— — 

Dr.  Cooper.  This  doesn't  go  only  through  experts,  Mr.  Weiss,  ^Ve  , 
have  students  take  the  test  and  the  students  tell  us  whether  they 
are  

Mr.  Weiss.  Students  too. 

Dr.  Cooper.  Well,  I  don't  know  what— 

Mr.  Weiss.  You're  not  suggesting  that  the  students  are*  likely  to 
be  more  expert  than  the  

Dr.  CooPEit.  No,  but  if  there's  ambiguity  in  the  tests,  students  are 
bright.  And  if  there's  ambiguity  in  the  question  that  . makes  the 
question  change.  If  the  student  says  you  can't  tell  which  is  the 
right  answer  here  for  the  following  reason,  that  question  is  thrown 
out.  That  was  the  problem  in  the  test.  There  was  no  correct 
answer. 

Mr.  Weiss.  Are  you  sayifig— because  again  I—as  I  listen  to  your 
testimony  are  you  saying  that  what  our  legislation  seeks  to  achieve 
and  what  New  York  has  done  is  appropriate  for  the  ether  disci- 
plines in  other  areas  but  that  your  test  is  so  unique  that  it  should 
not  be  applied  to  your  area?  Is  that  what  you're  telling  us? 

Dr.  Cooper.  We  don't  know  about  what  happens  in  the  other 
areas.  That's  for  them  to  answer.  We  know  that  this  legislation  we 
can  not  live  with. 

Mr.  Weiss.  OK.  Now  let  me  see  if  I  can  ask  you  just  a  few  other 
,  questions.  Most  of  the  colleges— most  of  the  professional  schools 
are  going  into  an  area  of  scarcity  as  far  as  student  supply  is  con- 
cerned. L  assume-that  that's  not  true  as  far  as  medical  schools  are 
concerned? 

Dr.jCooPER.  No,  sir  we  have  had  a  traditional  ratio  of  about  two 
applicants  per  position.  We  are  concerned,  as  I  said  before,  about 
two  things.  One  about  applicants— in  the  applicant  pool.  And  we 
have  every  applicant  that  applies  we  have  biographical  data  on 
them  so  we  can  study  the  changes.  We  are  concerned  about  the  ap- 
plicant pool  coming  from  more  affluent  families.  The  family  aver- 
age income— average  family  income  of  those  applicants  is  going^iip. 
And  they  are  not — they  are  coming,  more  and  more— we  nave 
about  a  13  to  15  percent  physicians'  children  go  to  medical  school. 
That's  been  constant  for  year^. 

But  now  other  professionals— students— children  of  other  profes- 
sionals are  going  up  and  the  manufacture,  you  know,  the  upper 
level  and  the  ones  from  clerks,  from  agriculture,  and  from  the 
lower  middle  class  are  not  going.  We  are  concerned  about  that  and 
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are  going  to  work  on  it.  One  of  the  problems  for  ithat  is  the  finan-/ 
cial  support.  It's  very  difficult  now  for  a  middle^lass  family— par-f 
ticularly  lower  middle  class  that  has  accumulated  debts  hrough  un- 
dergraduate college  and  then  additional  debts  that  they  will  accu- 
mulate through  medical  school.  r  ^  .    u  r  tu 

We  have  students  with  $75,000  to  $80,000  of  debt  before  they 
leave 'medical  school.  So  we  are  concerned  about  the  nature  of  the 
applicant  pool  and  we  work..on  that  and  we  are  terribly  disturbed 
and  we  have  had  two  task  forces.  We  led  the  way  in  1971  and  ap- 
pointed a  task  force  to  say  what  is  it  we  can  do  to  get  the  under 
•represented  minorities  in.  We  didn't  achieve  our  goals,  and  in  137b 
we  appointed  another  task  force  to  say  why  .didn  t  we  achieye  our 
goals.  And  now  we're  working  on  further  input.  We^Wave  an  exten- 
sive progranf.  '  u  •* 

We  are  not  happy  with  that  component  but  as  far  as  number  it 
remains  about  2  to  1.  OK,  .        ^     ,  ^ 

Mr  Weiss  Would  you— do  you  have  information  as  to  what  per- 
centage of  your  applicants,  in  fact,  attend  the  preparatory  courses, 
the  coaching  schools?  ,        "   .        ^,  ^.     ,   . , 

Dr  Cooper.  As  I  said,  we  ask  a  question  on  the  application  to  the 
MCAT  application,  you  know,  the  form  that  a  student  fills  out.  We 
ask  them  to  tell  us  if  they  did.  We  have  no  other  way  to  get  that 
information.  <■  „  ^       ,    .   . 

Mr.  Weiss.  What  do  they  tell  you?  What  percentage  do  you  get 

back? 

Dr!  Cooper.  I  can't  give  you  the  percent.  I  can  get  that  for  you 
and  send  it  to  you.  But  we  did  compare,  as  I  pointed  out  in  my  tes- 
timony—oh,  we  took  those  that  took  the  coaching  course  and  took 
the  MCAT  more  than  once  after  the  coaching  course, 

Mr.  Weiss.  RigHt,  Right.  , 

Dr.  Cooper.  And  we  studied  that.  But  you  know,  that  s  very  un- 
reliable information.  In  spite  of  the  fact  we  try  and  make  sure  that 
they  understand  we're  not  going  to  tell  anybody  about  that  coach- 
ing  but  

Mr.  Weiss.  Right, >  ,        ,  , 

Dr.  Cooper,  But  we  can  not,  we  do  not  have  access  to  Mr.  ivap- 
lahs',  you  know,  list  of  students  and  so  forth.     ,    ^    ^  . 

Mr  Weiss.  Wouldn't  you  assume  that  the  student  who  is  compet- 
ing to  get  into  a  more  restricted  area— medical  school  and  who 
comes  from  the  higher  economic  strata  is  more  likely  to  attend— to 
take  the  coaching  course  than  the  student  who  comes  to  be  ad- 
mitted to  college  where  in  fact  the  colleges  are  looking  for  custom- 
ers at  this  point  rather  than  the  other  way  around?  And  where 
there's  a  larger  percentage  of  low-income  applicants? 

Dr  Cooper.  I  can  speculate  with  you  on  it.  I  assume  the  more 
money  you  have,  you  know,  the  easier  it  would  be.  But  our  study 
shows  it  doesn't  do  much  for  you.  .,.  ,  -         ^     i.  ^i. 

Mr.  Weiss.  No,  no  but  I'm  trying  to  establish  first  as  to  whether 
in  fact,  there  is  a  high  percentage  or  if  you  know  whether  there  is 
a  high  percentage  of  the. people  who  take  your  test  who  m  fact 
attend  the  coaching  school.  And  you're  telling  me  that  there  is  no 
way  of  knowing  iKough  you.  assume  that  if  they  got  money 
they're  more  HkelyTb  attend  those  courses?     
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Dr.  Cooper.  On  the  other  hand,  you  might  expect  that  the  whole 
educational  process  of  those  from  more  affluent  families  would  be 
considered  to  be'  more  adequate.  And  they  might  feel  less  need  to 
have  a  coaching'  course  than  those  who  come  from  a  disadvantaged 
educational  background.  Whether  those  latter  can  afford  the 
course,  I  don't  ;know.  But,  you  know,  we're  just  speculating  here, 
Mr.  Weiss,  but,  maybe  there  would  be  fewer  Harvard  graduates- 
fewer  Harvard  graduates  of  whatever  economic  level  take  the 
course,  than  from  East  Branch  State  Teachers  College  take  the 
course,  if  they  could  afford  it.  I  think  the  Harvard  students  feel 
that  theyf  may  be  better  prepared.  You  know,  L.don't  know.  We're 
just  speculating. 

Mr.  Weiss.  Well,  I  can  only  give  you  my  experience  with  the 
cram  courses  for  taking  the  bar.  And  my  experience  was  that 
'  everybody  took  the  cram  course  no  matter  what  law  school  they 
went  to.  No  matter  how  good  their  grades  were.  They  wanted  that 
extra  little  bit  of  insurance  and  if  they  could  afford,  they  took  it. 

Dr.  Cooper.  I  don't  like  to  comment  on  one  of  our  sister  profes- 
sions but  it  is— we  do  not  :have,  you  know,  the  cram  course  idea  in 
law  school— some  of  my  lawyer  friends  that  have  gone  through  it 
say  the  law  school  ydu  go  to  for  3  vears  and  then  you  learn  what 
you  have  to  pass  on  the  exam  in  the  cram  course.  It  has  no  rela- 
tionship to  what  we  learned  in  law  school.  I  don't  know  what  the 
situation  is,  but  that  is  a  tradition,  I  think,  with  law  schools  and 
law  students.  •        j  . 

Mr.  Weiss.  You  are  in  a  profession  where  youngsters  graduating 
from  college  know  that  the  scarcity  of  seats  is  such  that  they  may 
be  lucky  if  they  ^et  admitted  to  a  foreign  school,  never  mind  to  an 
American  medical  college,  .  Iv? 

Dr.  Cooper;  I  think^the  latter  is  not  so.difficult. 

Mr.  Weiss.  Well,  given  that  kind  of  scarcity  it  would  not  surprise 
me  at  all  if  you  had  percentages  running  into  the  1980's  or  , 1990s 
of  medical  College  applicants  who  took  the  cram  course. 

Dr.  Cooper.  I  would  seriously  doubt  that,  Mr.  Weiss.  Seriously 
doubt  it.   ^  _  ^ 

Mr.  Weiss.  Maybe  we'll  get  some  insight  into  that  tomorrow.  Let 
me  touch  on  another  area  with  you.  You've  indicated  that  in  a 
sense  this— and  you  correct  me  if  Fm  misstating  or  missummariz- 
ing  your  testimony.  You've  indicated  that  the  legislation  in  a  sense 
is  a  waste  of  time  and  you  cite  the  ETS  figure  that  only  5  percent 
of  the  people  who  took  the  test  requested  the  answers:  What  you 
didn^t  cite  was  the  60-percent  figure  from  the  law  school.  Now,  if 
you  were-  able— if  you  were  to  make  available  to  your  medical  col- 
lege te^t  takers  the  test  dpon  requests  or  tipbn  even  the  payment  of 
"  a  nominal  fee  to  covefHhe  expenses,  would  you  speculate  as  to 
what  percentage  of  the  people  who  take  the  MCAT  would  in  fact 
request  their  answers  and  the  tests  sheet,  questions  and  answer 
back?  •  .  ^ 

Dr.  Cooper.  I  have  no  speculation  about  that,  Mr.  Weiss. 

Mr.  Weiss.  Would  you  not  guess  that  it  would  be  extremely  high? 

Dr.  Cooper.  I  really  could  not  speculate.  I  don^t  know. 

Mr.  Weiss.  Would  you  not  like  to  find  out? 

Dr.  Cooper.  We  can't  fmd  out  because  it^s  impossible  for  us. 

Mr.  Weiss.  Well,  you  could  run— you  could  run  a  test.  
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I       /df.  Cooper,  We  do  have  the  MCAT  manual  which  has /a  test  in 

I      if-  •        !      '  i  '  . 

,         Mr.  Weiss.  No,  I  know,ii  ki^bw. 

(       1  Dr.  Cooper.  And  which  is  no  different  from  the  test  they  would 

I       receive.  I  *  i  .  ,  r 

^  Mr.  Weiss.  You  could  run  a  test.  You  could  run  this  kind  of  test; 
You  could  put  on  top  of  th^  test  packet  a  sheet  which  said  if  we 
"  jWere  to  tell  you  that  w6  would  make  available  to  you  for  $5  to  $7, 
]$10  the  test— the  scoring  sh^et  with  the  keys  and  the. questions  and. 
.  (answers,  would  y<iu  requests-would  you  be  willing  to  pay ^  for— 
I  would  you  be  willing  to  request  it?  Why  can't  you  run  a  test  ^like 
Uhat?       •  '  / 

Dr.  Cooper.  The  reason  is  that  we,  no  matter  what  the  answer 
w^  an^  you  may  be  right  or  I  may  be  right  in  saying  I  don't  know, 
I      we  pould  not  ever  fulfill  that  and  maintain  the  MCAT  exam, 
j         Mr.  WEISS.  Well,  the  reason  I  asked  you  is  because  it  seems  to  me 
I       that's  unfair  of  you  to  come  in  here  and  say  that  the  response  to. 
I       the  SAT  of  KTS  of  5  percent  proves  that  on  top  of  all  the  other 
I       problems  with  this  legislation,  it's  unnecessary.  You  don't  know 
f        whether  in  fact,  in  your  area,  it's  unnecessary  or  not  and  I'm  will- 
ing to  bet  you  that  you  would  get  in  excess  of  50  percent.  How  is 

that?  Probably  closer  to  95  percent,  but  in  excess  

Dr.  Cooper.  We  could  both  speculate,  but  you  know  

Mr.  Weiss.  But  you  know,  it  seems  to  me  that  you  could  meet  my 

challange  very  easily.  You  don't  have  to  

Dr.  Cooper.  I  don't  think  it  would  be  fair  to  the  students,  Mr. 

Weiss,  because  we  could  never  fulfill  

Mr.  Weiss.  Yoii  would  tell  them— you  could  tell  them  listen  we 
/can!t  give  it  to  you  but  supposing  wj^^made  it  available,  would  you 
be  interested  in  ordering  it.  Be  right  up  front  with  them. 

Dr.  Cooper.  I  frankly  don't  see  the  value  of  that  kind  of  

Mr.  Weiss.  Well,  it  would  allow  you^to  come  in  here  after  you  got 
your  response  back  with  something  a  little  bit  more  than  you  are 
drawing  conclusiohs  which  don't  applyix)  your  area. 

Dr.  Cooper.  I  don't  think  that  one  answer  would  change  our 
opinion.  Whether  it  was  100  percent  or  5  percent.  The  fundamen- 
tals of  this  legislation  with  regard  to  this  specific  test  are  simply 
that  we  cannot— we  cannot  comply  and  maintain  the  same  test. 

Mr.  Weiss.  Well,  you  know,  the  one  thing  I  don't  want  to  get 
into— with  you  is  an  argument  that  says  yes  it  is  )pna  yoU  say  no  it 
isn't.  And  so  I'm  not  going  to  get  into»a  discussion  with  you  other 
than  to  comment  in  passing  that  your  view  of  the  finiteness  of  fac- 
tual information  to  be  tested  is  so  strange  coming  from  an  educa- 
tor—just is  so  stfange.  I  mean  it  seems  to  me  thai  people  with 
imagination  and  with  ^knowledge  and  with  love  of  the  subject  area 
that  they're  testing  ought  to  be  able  to  find  reams  and  reams  of 
questions.  You  know,  when  I  think  of  material  that  has  been  dis- 
closed to  the  lay  public  over  the  course  of  this  past  year  on  public 
television  alone,  it  seems  to  me  that  there  are  tremendous  areas 
that  you  could  test. 

Dr.  Cooper.  Is  that  included  in  average  4-year  courses  in  chemis- 
try, physics  and  biology  in  the  colleges? 

♦ 
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Mr.  Weiss.  It's  like  saying  well  it's  not  in  my  catacism  and  there- 
fore—I mean  I  don't  know  how  to  argue  with  that.  It's  a  very  diffi- 
cult argument  to. pick  up  on. 

Dr.  Cooper.  The  other  problem  we  have  is  we've  tried  to  point 
out  before,  the  number  of  tests  we  give  and  I  must  again  repeat  the 
elaborate  validity  and  equating  w6/  use  with---we  h^d  to  put 
sample — we  had  to  put  questions  in  qixx  tests  which  are  hot  graded 
for  the  test  but  graded  to  evaluate  ^ne  of  the  questions  and  No.  2 
to  equate  with  different  tests.  We  haye  a  limited— unless  we  make 
up  and  make  the  students  sit  for  Z  days  for  an  MCAT  test,  we 
simply  .with  the  other  test  components  we  have,  cannot  incorporate 
enough  of  these  questions  to  permit  us  to  validate  and  equate  tests. 
So,  it  is-  not  only  the  development  of  the  tests,  it's  the  elaborate 
scheme  we  have  used  to  evaluate— validate  and  equate  tests. 

Mr.  Weiss.  How  long  did  you— for  hpw  many  years  did  you  use 
the  tests  that  was  displaced  by  the  current  test? 

Dr.  Cooper.  Dr.  Moss,  who  by  the  way  was  a  member  of  the  fac- 
ulty here  at  George  Washington  University  first  gave  a  test,  it  was 
called  the  Jlios^  test.  And  then  Dr.  Moss  came  to  the  association— 
this  was  I  must  say  before  my  time,  in  the  1930's.  And  we  began 
giving  the  Moss  test  then,  the  medical  college  admissions  test  and 
that,  test  went  until  we— it  was  modified.  But  there  has  been  a  lot 
of  change  in  th^  science. and  so  on  of  measurement.  And  we  were 
concerned  and  began— it  took  us  about  4  years  to  complete  our 
studies  and  to  get  the  input  from  ^  the  broadest  group  of  people 
before  we  changed  our  test.  So,  we  started  in  the  early  1970^  So,  it 
was  ^between— let's  say  1940  and  1970. 

Mr.  Weiss.  Thirty  years. 

Dr.  Cooper,  Thirty  years,  yes,  sir^'"^ 

Mr.  Weiss.  And  I  bet  you  thought  it  was  a  pretty^  good  test  while 
you  were  giving  it.  ' 

Dr.  Cooper.  Yes,  but  must  tell  you  that  there  has  been  really  sig- 
nificant improvement  in  our  knowledge  of  evaluation  and  testing 
and  wavs  that  the  knowledge  has  improved  in  all  area^  and  we 
have  taken  that  into  account. 

Mr.  Weiss.  The  reason  I  asked  the  question  is  here  you  are  now 
thinking  that  this  is  a  pretty  good  test  and  I  suspect  that  in  about 
10  years  you'll  come  along  and  say  we  ought  to  throw  that  test  out 
because  it— we  now  have  a  really  good  test.  You  know,  there  are  a 
lot  of  people  in  the  psychometric  field,  I  mean  people  who  have  de- 
voted their  lives  to  it,  who  come  with  some  very  serious  and'  pro- 
found questions  about  the  whole  realm  of  testing.  And  I'm  not  sure 
that  in  fact  it's  accurate  to  say  thgt  we  kno^y  so  much  more  and 
therefore  the  test  we're  giving  today  are  so  much  better.  Indeed,  I 
think  you  can  spell  out  an  argument  for  saying  that  there  is  so 
much  doubt  about  the  whole  field  of  psychometrics  that  people  who 
spent  their  careers  have  expressed  , grave  doubts  as  to  whether  in 
fact  there  is  inherent  work  or  value  of  not — if  more  harm  than 
good  is  not  a(4ileved  by  those  tests.  You  know  that  I'm  sure  be^ 


Dr.  Cooper.  You  mean  you're  tidvocating  abolition  of  standard- 
ized tc!»ting? 

Mr.  Weiss.  I'm  not  because  Fm  not  at  that  point  at  this  stage, 
but  what  I'm  saying  to  you  is  that  I  think  it's— when  you  commit 
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yourself,  as  you  have,  body  and  soul— heart  and  soul  if  you  will  to 
this  specific  test  that  youVe  giving  currently,  you  may  be  lettijQg^ 
yourself  in  for— for  a  big  downer  when,  in  fact,  you  realize  that 
maybe  it  isn't  what  it's  cracked  up  to  be. 

Dr.  Cooper.  We  are  anxiously  awaiting  the  information  that  is 
coming  from  these  independent  studies  outside  on  the  value  of  this 
test  in  making  decisions.  That's  for  them  to  decide.  Not  for  us.  And 
we  are  awaiting  it  and  We  want  to  look  at  it  along  with  you  and 
.  anybody  else  with  regard  to  what  we've  done.  The  preliminary  in- 
dication is  that  the  new  MCAT  is  substantially  better  than  the  old 
MCAt  for  their  purposes.  Now,  wjhether  it  is  or  not  we'll  have  to 
wait  the  kind  of  studies  that  are  being  done. 

Mr  Weiss.  Why  aren't  you  fellows  pulling  that  suit  together  so 
that  you  have  a  deposition  in  New  York  as  to  what  your  rights 
are*^ 

Dr.  Cooper.  I  would  never  try  and  take  the  place  of  our  legal 
\     firm.  And  I— that  is  for  them  to  work  out. 
,      \     Mr.  Weiss.  That's^he  best  answer  you've  given  all  day.  Does 

(council  for  the  minority  have  any  questions?  No.  Dr.  Cooper  

Mr  Williams.  Mr,  Chairman  will  you  yield? 
Mr.  Weiss.  Of  course,  Mr.  Williams. 

Mr.  Williams.  Dr.  Cooper,  I  found  particularly  instructive  your 
concerns  and  the  concerns  of  your  association  about  the  lack  of  ap- 
pr<^priate  funding  for— for  financial  assistance  to  college  students 
particularly  minority^  and  disadvantaged.  And  if  it's  appropriate, 
sir,  I  think  tliat  the  chairman  of  the  Subcommittee  on  Postsecon- 
dary  Education,  Congressman  Simon  of  Illinois,  and  the  chairman 
of  the  Subcommittee  on  Elementary,  Secondary,  and  Vocational 
_  '  Education,  Chairman  Perkins  of  Kentucky  would  also  find  your 
association's  specific  thoughts  in  support  of  approprfate  financial 
aid  very  instructive.  And  if  you  and,,your  association  think  it  would 
be  appropriate,  I'd  encourage  you  to  send  a  letter  to  those  two 
chairmen  and  I'd  appreciate  having  a  copy  of  that  letter  outlining 
your  concern  about  the  l^ck  of  financial  assistance  in  tpis  area. 

Dr.  Cooper.  Well,  let  me  3ay;  sir,  we  welcome  that  recommenda- 
tion, of  course.  This  legislativ.e  area  is  largely  within  Mr. 
Waxman's  subcommittee  in  the  House  and  Mr.  Waxman  is  Very 
sympathetic.  He,  as  you  know,  has  SQme  difficulties  in  these  kinds 
of  programs  now  in  the  House  and  the  Senate  is  very  difficult.  But 
our  association  this  year  took  a  stand— a  step  which  had  never 
been  taken  before  and  they  identified  two  priorities  that  they 
would  work  on  for  Federal  legislation.  One  was  student  assistance. 
Two  was  biomedical  research^  The  reason  for  that  is  we  feel  that 
only  the  Federal  Government  can  support.  We  did  not  work  on  ca- 
pitation, on  special  project  grants,  on  all  of  these  other  things.  But 
we  are  deeply  concerned  about  the  lack  of  suppprt  for  the  medical 
student— the  applicants  and  let  me  say  we  have— wexhave  worked 
very  hard  in  every  committee  except  this  one.  But  we  would  be 
very  pleased  to  bring  it  to  the  attention  of  whoever  can  helpful 
to  us  oecause  we  are  deeply  concerned.  \  - 

Mr  WiLUAMs.  Thank  you.  Thank  you,  Mr.  Chairman.  \ 

Mr.  Weiss.  Again,  Dr.  Cooper  we  appreciate  your  taking  the  «me 
away  from  your  other  activities  to  appear  before  us  to  testify.  \ 

Dr.  Cooper.  Thank  you,  Mr.  Weiss.  \ 
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,  Mr.  Wiw,  Tha  hearing  stanids  adjourned  until  9:30  tomorrow 
morning.  Same  room. 

[Whereupon  the  hearing  was  adjourned  until  9:30  a.m.  Thursday, 
November  5, 19^1;]  j  - 

'   [Additional  information  subnyitted  for  the  record  follows:] 

I  /  '  ^ 
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Prbtakko  Statement  or  thk  Amiucan  Dintal 


The  Ameri/an  Dental  Association  opposas  the  enactmant  of  the  bill^, 


national  testing  programs  administered  by  the  Ainerican  Dental 


The  Dental  Admission  Testing  Program  (DAT)  is  an  entrance  examination 
required  by  all  of  the  60  dental  schools  in  tl?e  United  States.  The 
OAT  was  initiated  in'l946  *for  the  express  purpose  of  reducing  the 
unacceptably  high  attrition  rate  which  was  then  occurring  in  dental 
education.    It  was  not  and  is  not  intended  as 'an  instrument  for 
predicting  career  success.    During  the  1930's  and  1940's  the  AnnGal 
attrition  rate  in  dental  schools  approached  25  percent.  ^  Following 
the  introduction  of  the  D,\T  and  its  acceptance  as  an  entrance  require- 
ment, the  attrition  rate  was^  reduced  tcr  only  7  percent; '4'  level  which 
has  generally  been  maintained  since  1950. 


H.R.  mi  and  H.R.  1312,  pending  before  the  Committee.    In  order  to 
~    understand  the  Association's  objections  to  this  legislation  it  is 
necessary  to  recognize  the  purpose  and  unique  nature  of  the  two 
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Much  of  thi«  success  tn  reducing  cttiition  results  from  the  ability  ^  ^ 

of  the  DAT  to  n^asure  fine  manual  dexterity.    In  order  to  graduate 

from  dental  school,  the  student  must  have  the  proficiency  to  practice 

what  is  commonly  called  General  Dentistry.    General  Dentistry,  like 

the  medical  specialty  of  surgery^  as  opposed  to^  the^practice  of 

pipsjt  other  professions,  require^^a  high,^egree  of  manual  technique 

proficiency. '  Not  everyone  has  the  fine  ?nanual  dexterity  to  roaster  ^  , 

the  technical  skills  to  practice  dentistry.    The-  DAT  has  developed 

non-verbal,  perceptual  and  space  relation  tests  which  over  the 

years  have  demonstrated  a  proven  ability  to  measure  and  evaluate 

the  applicant's  fine  manual  dexterity.    The  format  of  these  ^ests 

is  non-verbal  in  nature.    It  is  a  series  of  drawings  of  two  and 

three  dimensional  objects  which  the  test  subject  must  relate  to. 

Because  ,therc  is  a  finite  limit  to  the  number  of  ways  to  represent 

a  box  or  triangle* on  a  drawing,, the  number  of  test  forms  that  can 

be  produced  is  of  necessity  severely  limited.    If  the  Dental 

Admission  ftstin^  Program  waa  required  to  disclose  the  actual  tests 

after  eacH  administration,  as  the  legislation  now  proposes,  within- 

a  very  shtrC  time  these  kind  of  manual  dexterity  testes  would  have. 

to  be  discontinued.    This  issue  is  cftntral  to  our  objections  to 

the  legislation  as  presently  structured.  — 

The  Dentjal  Admission  Testing  Program  is  the  only  entrance  examination 

that  contains  tests  which  measure  abilities  other  than  academic.  ^ 

A  diminution  in  quality  of  the  other  portions  of  the  DAT,  for  example 
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its  science  tests  or  its  reading  comprehension  tests,  could.be 
/jconpensated  for  in  part  by  .separate  criteria  such  as  gradesUn  college. 
Without  the  manual  dexterity  component  of  the  DAT,  however,  (Rental 
schools  would  have  m  criteria  to  discriminate  the  ability 
perform  fine  manual  dexterity  and  as  a  consequence  it  can  be  pJjedicted 
that  the  attrition  rate  in  .dental  schools  would  a^ain  rise  to 
unacceptably  high  levels.    This  reason  alone  compels  the  Assoclalfcion 
to  oppi)se  che  legislation. 

The  Association  further  believes  that  the  numerous  disclosure 
requirements  contained  in  H.R.  1662  are  not  relevant  to  the  purposj^s 
of  the  bill.    Tor  example.  Section  7(2)  mandates  dis-Jlosure  of  inforr 
matipn  regarding  refunds  given,  fee  wiivers  or  reductions  granted, 
income  received,  and  expenses  incurred  by  the  test,  agency.  The 
expenses  are  to  be" citegorized  as^fixe^  or  attributed  to  a  specific 
purpose  or  program.         is  unclear  how  this  information  will  assist 
the  Secretary  of  Edutfatipn  in^  furthering  the  pur'pose  of  the^bill. 

Some  provisions  of  H.R.  1662  would  be  impossible  to  carry  out. 
Section  3(a)(3)  would  require  the  Dental  Admission  Test  Agency  to 
determine  th^f^cS^relation  between  DAT  scores  and  success  in  dep*!istry. 
There  is,  however,  no  pract*^al  way  to  measure  success  in  a  career , 
as^each  pr  a  ctltic.jejf  defines  *  sue  cess  according  to  his  or  her 
personal  and  pV^ofessional  goals. 

I  * 

In  addition  to  the  above  noted  concerns,  the  Association  wishes  to 
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emphasize,  that  the  DAT  progxe«m  has  for  years  provided  a  broad  range 
of  useful  information  to  dental  applicants, 

1)  It  has  released  a,n  example  couy  of  an  exact  fona  of  the  Dental 
Admission ^Test  which  it  has  entitled  "Dental  Admission  Test  Prepara- 
tion Materials."    These  materials  are  distributed  free  of  charge  to 

e 

all  applicants  who  register  for  the  DAT.    It  has  done  this  .to 
neutralize  the  error  measurement  that  has  been  introduced  into  the 
test  scores  by  test  preparation  courses.    Not  all  potential  candidates 
for  reasons  of  economic    circumstance  or  geographic  location,  have 
identical  access  to  preparation  courses.    The  Association  feels  that 
when^a  candidate  studi.es  for  a  test,  he  or  she  ought  to  be  able  to 
study  the  material  which  is  actually  contai.'^  .in  the  test  at  the 
difficulty  level  it  will  be  tested..    This  is  especially  important 
for  the  ncr4-verbal,  perceptual  a;id  space  relation  tests  contained 
in  the  orogram.    The  American  Dental  Association  also  believes  that 
it  IS  assisting  the  dental  schools  to  more  accurately  judge  the 
ability  of  the  candidates  by  eliminating  the  above  types  of  bias 
that  might  be  present  in  their  admission  decisions, 

2)  Annually,  the  American  Dental  Association  conducts  a  complete 
statistical  analysis  of  its  tests  along  with  validity  studies  which 
ate  participated  in  by  all  dental  schools  in  the  United  States. 
The  Statistical  analysis  contains  a  complete  item  by  item  analysis 
of  the  test  to  deteiiui.ii«  not  only  how  reliable  the  tests  were  as 
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a  whole,  but  , also  how  each  specific  item  in  the  test ^performed.    The  » 

analysis  also  contains  additional  studies  to  determine  the  effect  of 

repeating  the  test  more  than  one  time.    These  studies  have  been 

cerj^ied  on  since  the  inception  of  the  program  and  are  fully  published 

and  distributed  free  of  charge  to  anvone  who  has  requested  copies 

of  therp.    These  studies  along  with  other  useful  admission  information 

are  bound  together  under  the  title  Handbook  for  rt:e~Dental  Advisors 

and  annually  distributed  free  of  charge  to  all  pre-dental  advisors 

at  all  under-graduate,  post-secondary  institutions  across  the  country. 

In  this  way,  the  American  Dental  Association  feels  that  it  fully 

informs  and  makes  available  all  information  that  is  necessary  for 

an  applicant  or  advisor  to  3udge  the  quality  or  content  of  ihs' 

Dental  Admission  Testing  Program.    T^ft  additional,  and  we  believe 

unnecessary,  requirements  of  K.R.  1662  and  H.R,  1312  would  substantially 

increase  the  DAT  application  fee, 

The^Association  also  ob3ects  to  the  provision  of  H.R,  1312  which 
Stipulates  that  knowledge  examinations  based  for  entry  into  on 
educational  program  or  a  career  must  be  scored  without  relation  to 
the  distribution  of  scores  produced  by  the  examinations.    Both  the 

,  DAT  Science  exam  and  the  National  Board  Examinations  (noted  below) 
are  scored  using  a  distribution-referenced  scoring  system.  This 
scoring  system  allows  for  consistency  among  scores  and  equivalency 

.of  scores  from  various  editions  of  tf c  examination.    Until  criterion- 
based  scoring  procedures  ate  refined  to  provide  identical  interpretation 
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of  scores  from  testing  date  to  testing  date,  a  distribution-referenced 
scoring  system  is  the  fairest  and  most  reliable  way  of  measuring  the 
cognitive  skills  necessary  to  practice  dentistry. 


HATIO??AL  BOARD  EXAMIt^ATIONS 


The  Council  on  National  Board  Examiipations  was  established  in  1928 
as  a  standing  conunitcee  of  the  American  Dental  Association  for  the 
purpose  of  providing  and  conducting  written  examinations  for  use  at 
the  discretion  of  state  boards  of  dentistry  in  .licensing  Rental 
hygienists.    Currently,  over  12,000  candidates  for  dental  licenses 
and  almost  6,000  candidates  for  dental  hygiene  license^  participate 
in  National  Board  programs  each  year. 

The  dental  .exanln2(tion  battery  consists  of  seven,  100  item  examinations 
.  while  the  dental  r.ygiene  examination  is  a  single  rixamination  consisting 
of  350  items.     In  the  interest  of  serving  the  public,  state  boards 
of  dentistry,  candidates  for  licensure  and  the  profession,  these 
examinations  are  administered  three  times  a  year  at  testing  centers 
throughout  the  United  StStes.    To  insure  examinations  of  high  quality 
that  are  fair  and  just  to  participants,  two  to  three  new  editions  of 
each  dental  exaunination  and  one  to  two  editions  of  the  dental  hygiene 
examination  are  developed  dach  year.    During  any  year,  at  least  four 
different  dental  examinations  are  released  with  answers  and  statistical 
analysis  of  test  items ^to  licensure  candidates,  dental  school  faculty 
members  and  interested  individuals.     Dental  hygiene  examinations  are 
also  released  regularly,  b.ut^.with  less  frequency  due  to  the  length 
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of  the  examinations.    The  American  Dental  Association  therefore 
believes  that,  through  its  cun'ent  policy  of  releasing  National 
Board  examinations,  it  fully  responds  to  the  extent  of  the  disclosure' 
clause.    Our  concern  relates  to  having  undue  restrictions  placed  on 
its  exanination  program  that  would  jeopardize  the  quality  of 
examinations.-    Publishing  all  test  items  after  their  use  would 
.seriously  deplete  the  test  item  files  and  cause  examinations  to 
become  less  reliable  and  less  valid.  ^  ,^ 
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THE  EDUCATIONAL  TESTING  ACT  OF  1981 


THURSDAY,  NOVEMBER  5,  1981 

Representatives,  Subcommittee  on  EtfiMEN-' 
fAky,  Secondary,  and  Vocational  Education  Joint- 
ly With  the  Subcommittee  on  Postsecondary  Edu- 
cation, Committee  on  Education  and  Labors —  ^ 

Washington,  uC. 

The  subcommittee  met,  pursuant  to  ac(journment,  at  9:30  a.m.,  in 
room  2175,  Rayburn  House  Office.  Building,  Hon.  Paul  Simon 
(chairnian  of  the  Subcommittee  oh  Postsecondary  Education)  pre- 
siding. ,        L ' 

Members  present:  Representatives  Perkins,  Simon,  Miller,  Weiss, 
Kildee,  Erdahl,  Petri,  and  DeNardis.  \ 
-  r  Staff  present:  JohnfF.  Jennings,  counsel;  Nancy  L.  Kober,  legisla- 
"   tive  specialist;  and  William  Blakey;  counsel.  ^ 

Mr.  Simon.  The  Subcommittee  on  Elementary,  Secondary,  and 
V()catiorial  Education  and  the  Subcommittee  on  Postsecondary 
Education  will  resume  its  joint  hearings  on  H.R.  1662,  the  Educa- 
tional Testing  Act  of  1981. 

I  will  enter  this  statement  in  thfe  record  which  touches  on  what 
hapj3iened  yesterday.  Let  me  just  say  that  our  colleague  from  New 
York,  Mr.  Weiss,  who  has  introduced  the  legislation  has,  I  think, 
'  through  the  oversight  of  the  subcommittee  and  through  the  action 
-  '  that's  been  taken  by  various  organizations,  caused  considerable 
progress  to  be  made  in  this  area  and  those  of  us  who  are  on  the 
subcommittees  and  on  the  full  committee  appreciate  that. 

[The  opening  statement  of  Congressman  Simon  follows:] 

Ofeming  Statemint  or  Hon.  Paul  Simon,  a  Hewiwentative  in  Congress  From 
THE  State  of  Ilunois,  Novemier  5, 1^,81 

The  subcommittee  on  Elementary,  Secondary,  and  Vocational  Education  and  the 
Subcommittee  on  Poetaecondary  Education  will  resume  its  joint  hearings  on  H.R. 
1662,  the  Educational  Testing  Act  of  1981.  ^  ^^^^  ^ 

Yesterday's  witnesses  presented  testimony  on:  One,  why  H.R.  Ibb2  should  or 
should  not  be  enacted:  two,  the  new  policies  enacted  by  the  testing  mdustry.in  re- 
sponse to  New  York  SUte*s  test  disclosure  legislation;  and  three,  the  areas  that 
have  been  amended  in  New  York  State's  test  disclosure  legislation. 

number  of  yesterday's  witnesses  also  Ulked  about  the  area  of  coaching,  an  area 
ofi  which  many  of  the  witnesses  here  today  will  present  testimony.  A  number  of  the 
M^neises  on  yeaterday's  panel  indicated  that  they  were  not  opposed  to  coaching. 
Dr.  Cooper  of  the  Association  of  American  Medical  Colleges  testified  that  the  Associ- 
ation found  thai  through  coaching  ihe  "higher  gains  were  for  content  specific  sec- 
tions'*  of  the  MCAT  (areas  such  as  biology,  chemistry,  etc.)  as  opposed  to  the  skills 
analysis  section  (reading  and  quantitative  tests).  Mr.  Anrig  from  the  ETS  indicated 
thii  they  do  not  tell  studento  not  w  attend  coacliing  schools  or  programs,  but  that 
he  does  question  how  much  a  student  can  improve  in  the  short  run  in  skill  areas 
that  shoold  have  been, developed  in  the  4  years  of  high  school  study. 
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The  role  and  impact  of  c<>ttching  it  an  area  in  which  this  committee  seeks  more 
information  and  therefore,  we  ar«  happy  ^  have  before  us  today  «  group  of  people 
who  are  involved  in  the  areas  of  testing  and  coaching.  We  have  David  A.  Goilin  who 
is  the  executive  director,  assembly  of  behavioral  and  social  sciences  at  the  ^;*tio"»' 
Academy  of  Science  and  his  colleag«ie  at  the  Academy,  Mrs.  Alexandra  Wigdor, 
study  director,  Comri^rittee  on  Ability  Testing.  We  also  have  present  Mrs.  Lois  Pjnes, 
former  regional  director  of  the  Federal  Trade  Commission  Boston  r^onal  oflice. 
The  FTC's  Boston  office  was  responsible  for  release  of  a  study  entitled,  CxMiching 
for  SUndardiied  Admission  Tests/'  Our  fourth  witnesrwill  be  Mr.  Stanly  Kaplan, 
founder  of  the  SUnley  Kaplan  Educational  Center.  Commissioner  James  Miller  of 
the  Federal  Trade  Commission  was  unable  to  be  with  us  today,  but  will  submit  writ- 
ten testimony  for  the  record. 

The  witness  Tin  going  to  take  first  is  Mrs./Lois  Pines,  the  former 
.  regional  director  for  the  Federal  Trade .  CJommission  from  the 
Boston  regional  office.  The  Boston  office  was  responsible  for  the  re- 
lease of  the  study  entitled  "Coaching  for  Standardized  Admission 
Tests"  aiid  we're  very  pleased  to  have  Mrs.  Pines  here. 

I  might  add  that  we  have  a  caucus  right  now  of  the  Democratic 
members  of  the  Budget  C!ommittee.  We're  putting  together  the 
second  budget  resolution  ,  and  Fm  going  to  have  to  excuse  myself  to 
Mrs.  Pines  and  the  other  witnesses,  at  least  i^mporarily.  I  m  gomg 
to  turn  the  gavel  over  to  Mr.  Erdahl  at  this  point.  If  you  can  come 
on  over  here. 

We  thank  you  for  being  here  and  my  apologies. 

Mrs.  Pines.  Thank  you.  Congressman  Simon.     ,  ,  ,    ,  , 

Mr.  Erdahl.  Thank  you,.Mr.  Chairman.  We're  delighted  to  have 
you  with  us,  Mrk  Pines.  You  may  proceed  in  any  way  that  you 
wish.  Your  statement  will  be  entered  in  its  entirety  into  the  recon} 
and  you  can  give  it  or  summarize  it,%hichever  way  that  you  might 
feel  more  comfortable. 

Please  proceed, 

STATEMENT  OF  LOIS  PINES,  FORMER  BOSTON  REGIONAL 
DIRECTOR,  FEDERAL  TRADE  COMMISSION 

Mrs.  Pines.  Thank  you;  Mr.  Chairman.  * 

My  name  is  Lois  Pines  and  I'm  delighted  to  have  the  opportunity 
to  be  here  this  morning  to  testify  on  H.R.  1662,  the  Educational 
Testing  Act  of  1981.  ,  ^ 

I  firmly  believe  that  the  disclosures  required  by  this  legislation 
are  essential  to  insure  that  the  individuals  who  take  standardized 
admission  tests,  as  well  as  the  institutions  which  utilize  them,  fully 
understand  the  benefits  and  the  limitations  of  those  particular 
tests.  In  my  view,  the  issue  really  is  a  matter  of  marketplace  fair- 
ness. .      '  J.     X  r 

The  2Vz  years  during  which  I  served  as  the  regional  director  ol 
the  New  England  office  of  the  Federal  Trade  Commission  made 
clear  to  me  that  without  full  and  fair  disclosure,. consumers  of  any 
product  or  service  cannot  make  a  reasonable  decision  with  regard 
to  their  purchasing,  nor  can  they  fully  exercise  their  rights  in  the 
marketplace.  In  this  particular  case,  where  the  service  purchased 
can  and  veiy  often  does  permanently  affect  the  purchaser  s  educa- 
tional and  professional  life,  full  disclosure  is  all  the  more  impor- 
tant. Surely  if  consumers  have  the  right  to  be  protected  by  laws  re- 
quiring disclosures  in  such  areas  as  credit  and  product  labeling, 
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they  have  a  right  to  full  disclcMSure  regarding  the  testing  services 
that  shape  their  futures. 

Disclosure  legislation  in  the  education  sphere  is  not  new  and  as  a 
State  legislator  from  the  Commonwealth  of  Massachusetts,  I  spon- 
sored and  wrote  legislation  that  provided  for  the  disclosure  of  stu- 
dents* cumulative  educational  record  in  the  public  schools,  not  only 
to  students  but  also  to  their  parents.  That  legislation  became  effec- 
tive in  Massachusetts  in  1973. 

Experts  in  the  testing  field  who  have  previously  testified  before 
your  committee,  have  cataloged  the  many  dangers  that  are  inher- 
ent in  the  widespread  use  of  standardized  admission  tests.  The  pre,- 
dictive  validity  of  the  tests  has  been  questioned.  Concerns  about 
racial,  ecpnomic  and  cultural  bias  have  been  raised.  Other  critics 
have  stress^  that  these  multiple-choice  tests  cannot  identify  the 
truly  creative  or  independent  thinker;  that  such  individuals  may, 
in  fact,  be  penalized  by  the  tests.  Personal  qualities  of  importance, 
such  as  motivation,  judgment,  creativity  can  simply  not  be  meas- 
ured by  these  tesj^.  My  testimony  today  will  focus  on  still  another 
area  of  concern--^the  degree  to  which  these  tests  are  subject  to  spe- 
cial preparation  or  what  is  commonly  referred  to  as  coaching. 

During  my  tenure. at  the  Federal  Trade  Commission,  my  staff  at 
the  Boston  regional  office  conducted  an  investigation  regarding 
coaching  for  standardized  admission  tests.  The  investigation  was 
spawned  by  concern  that  commercial  testing  schools  were  making 
unfair  and  deceptive  claims  of  effectiveness. 

The  focus  shifted,  however,  after  the  Federal  -Trade  Commission 
staff  conducted  a  statistical  analysis  which  found  that  coaching  at 
one  commeridal  school  was  effective,  raising  its  students'  scholastic 
aptitude  test  scores  an  average  of  approximately  25  points  in  both 
the  mathematical  and  verbal  flections  of  the  test.  Staff  reviewed 
other  studies  on  coaching  for  the  SAT  andt  learned  th^it  other  ^re- 
searchers had  also  found  coaching  to  be  effective.  Our  staff  then 
undertook  a  review  of  the  materials  on  the  SAT  distributed  by  the 
Educational  Testing.  Sefvice  and  College  Board.  The  question 
became  ETS  and  College  Board  fully  and  fairly  disclosed  the  bene- 
fits of  coaching  for  the  SAT? 

Our  investig^ition  culminated  with  the  Commission  s  release  of 
the  Boston  regional  office's  staff  report  on  the  Federal  Trade  Com- 
mission Investigation  of  Coaching  for  Standardized  Admission 
Tests,  copies  of  which  you  have.  I  believe  that  the  staff  report 
makes  the  need  for  H.R.  1662  absolutely  clear. 

One  only  needs  to  read  the  report's  comparison  of  what  the  stud- 
ies! on  coaching  showed  and  what  ETS  and  College  Board  were 
saying  to  conclude  that  students  and  educators  have  been  misled. 
The  report  documents  that  the  information  sent  to  students  and 
educators  regarding  coaching  has  been  repeatedly  in  conflict  with 
the  research  on  that  particular  issue. 

For  example,  in  1968  when  the  College  Board  trustees  were  tell- 
ing students  and  educators  that  coaching  would  not  work,  that- 
such  endeavors  corrupted  education,  researchers  had  already  con- 
.ducted"-*tudies-5howing^oaching.-gains  of  29  on  mefth  and-BQ^wints 
on  the  verHal  section  of  the  test.  After  yet  more  resjearch  attesting 
to  the  effectiveness  of  coaching,  research  at  tiines  sponsored  by  Col- 
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lege  Board,  students  Were  still  being  told  in  the  fall  of  1979  that 
cramming  does  not  raise  scores.  ^  ... 

Now  ETS  and  College  Board  try  to  play  a  semantic  game  m  their 
defense.  They  explain  that  all  they  meant  by  saying  that  cramming 
would  not  help  was  that  a  few  hours  of  drill  on  sample  questions 
would  not  help.  I  fear  that  the  students  and  educators  reading  the 
ETS  and  College  Board  materials  may  not  have  been  able  to  grasp 
such  a  fine  distinction.  When  you  have  no  other  source  of  informa- 
tion, it's  difficult  to  read  between  the  lines.  Coaching  for  the  SAT 
can  help.  Coaching  can  mean  significant  score  improvements,  yet 
students  and  educators  were  led  to  believe  that  it  would  not  help. 

Full  and  fair  disclosure  has  clearly  not  been  the  standard  by 
which  ETS  and  College  Board  have  judged  their  material  on  the 
SAT.  It  is  true  that  very  recently,  in  the  face  of  much  public  dis- 
cussion and  pressure,  students  have  been  given  a  more,  comprehen- 
sive statement  on  the  coaching  issue.  However,  absent  a  legislative 
mandate  of  H.R.  1662  insisting  on  full  and  fair  disclosure  as  the 
norm,  there  will  be  no  assurance  that  eyen  these  modest  recent  im- 
provements will  continue. 

In  fact,  there  is  no  reason  to  believe  that  misleading  statements 
will  continue  to  appear.  ETS's  reponse  to  the  Boston  regional  office 
report  is  a  case  in  point.  A  senior  vicfepresident  for  research  at 
Era  was  said  to  have  argued  that  the  FTC's  findings  were  flawed, 
that  ETS  studies  have  indicated  much  lower  gains,  10  points  or  so. 
Yet  ETS  continues  to  rely  on  studifes  which  its  own  researchers 
have  criticized  as  being  irrelevant  to  today's  test  takers  or  to  an 
assessment  of  the  effectiveness  of  a  subst^tive.and  weUconstroct- 
ed  coaching  program.  Moreover,  a  quote  from  one  of  ETS  s  public 
relations  omcials  is  even  more  astounding  to  me.  On  May  18, 1981, 
that  official  is  quoted  as  saying,  "We  don't  believe  that  short-term 
cramming  can  make  a  difference.  These  are  aptitude  tests  designed 
to  measure  potential  ability  and  can't  really  be  studied  for. 

Mandating  disclosure  about  the  effectiveness  of  coaching  would 
result  in  both  practical  and  psychological  benefits  in  the  SAT  con- 
text. On  the  practical  9ide,  students  would  fully  understand  the  po- 
tential of  coaching  and  be  better  able  to  decide  whether  such^prep- 
aration  is  right  for  them.  Also,  schools  would  be  better  able  to 
counsel  their  students  on  the  question  of  preparation  and  decide 
whether  to  offer  such  preparation  themselves.  On  the  psycbplogi^ 
side,  students  would  be  encour£«ed  hot  to  view  their  three-digit 
SAT  scores  as  the  final  work  of  their  mental  capabilities,  For  if 
scores  can  be  improved  by  coaching,  the  test  is  not  measuring  some 
unchanging  and  innate  capacity  to  learn.  It  is  not  measuring  apti- 
tude. ,  X  XV 

The  Boston  regional  office's  staff  report  documents  vet  another 
reason  why  H.R.  1662  is  essential.  The  report  highlights  the  fact 
that  a  number  of  serious  educational  policy  questions  are  raised  by 
the  finding  that  coaching  for  a  standardized  admission  test,  such  as 
the  SAT,  can  be  effective.  r    .  .    'i  ^.. 

For  example,  the  implications  of  coaching  for  test  validity  must 
be  examined.  Questions  are  raised  about  the  meaning  of  an  exami- 
nation desigiied  to  measure  verbal  and  mathematical  abilities  said 
to  be  developed  over  a  lifetime  of  learnirTg  if  scores  ban  be  mean- 
ingfully changed  in  a  few  weeks  or  months  of  coaching.  Validity 
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may  be  further  questioned  if  coaching  is  helping  students  gain  in- 
flated scores  rather  than  helping  them  demonstrate  their  actual 
skills  and  abilities. 

Perhaps  the  most  important  question  raised  in  the  report  is  the 
question  of  fairness.  Is  it  fair  to  rely  on  a  test  that  is  subject  to 
coaching,  if  that  coachinR  is  not  equally  available  to  all? 

The  evidence  rfeviewedf  in,  the  staff  report  indicates  that  the  un- 
equal access  issue  is  important.  All  test  takers^ dp  not  have  access 
to  coaching.  Commercial  programs  are  available  tO' students  whose 
parents  can  afford  to  spend  $200,  $300,  sometimes  $400;  but  what 
about  students  whose  parents  do  not  have  these  resources?  Schools 
in  wealthy  neighborhoods  may  be  able  to  offer  effective  coaching 
programs,  but  financially  pressed  schools  may  not.  Moreover,  the 
report  indicates  that  the  very  students  most  in  need  of  coaching, 
those  who  may  well  have  the  most  to  gain  by  it,  may  have  the  least 
access  to  it.  For  example,  there  is  some  evidence  that  the  degree  to 
which  one  benefits  from  coaching  is  dependent  on  one's  parental 
income  and  race. 

Before  the  answer  to  the  unequal  access  question  can  be  found; 
however,  some  very  fundamental  questions  about  the  test  itself 
must  be  answered.  What  skills  and  knowl^ge  does  the  SAT  actual- 
ly measure?  What  is  the  Value  of  developing  such  skills  and  knowl- 
edge? And,  finally,  what  is  the  value  of  training  students  to  demon- 
strate those  skills  on  any  particular  examination? 

The  staff  report  does  not  answer  these  important  questions.  In- 
stead, it  encourages  experts  in  the  testing  field  to  devote  th^ir  time 
and  resources  to  finding  these  answers.  In  that  regard,  the  Federal 
Trade  Commission  specifically  asked  the  U.S.  Department  of  Edu- 
cation to  consider  the  important  educational  questions  raised  in 
the  report. 

At  this  time,  however,  it  is  difficult  for  independent  experts  to 
consider  and  conduct  the  necessary  study  and  research.  The  test 
agencies  exercise  enormous  control  over  what  research  is  done  and 
by  whom.  They  have  even  controlled  the  extent  to  which  research 
findings  receive  repeated  citation  and  which  findings  are  treated  as 
•no  more  than  footnotes. 

H.R.  1662  would  break  this  monopoly  power  by  assuiihg  that  in- 
dependent researchers  have  access  to  the  information  they  need  to 
l3e.ableAo_stud\^^^ 

H.R.  1662  would  require  the  public  disclosure  of  the  test  forms  and 
the  scored  correct  answers.  It  would  require,  the  full  disclosure  of 
all  studies  in  which  the  test  agencies  have  been  involved,  whether 
those  studies  support  or  refute  their  positions.  If  such  information 
is  not  placed  in  the  public  'domain  the  questions  raised  by  our 
report  cannot  be  pursued.  Likewise,  without  this  disclosure,  the 
concerns  raised  by  other  critics,  such  as  the  possibility  of  economic 
and  racial  bias  in  the  tests,  cannot  be  effectively  addressed.  The 
impact  of  standardized  admission  tests  is  far  too  strong  to  permit 
only  those  with  a  self-perpetuating  interest  in  the  outcome  to 
review  the  validity  of  the  tests. 

For  the  role  that  standardized  test  scores  play  in  the  educational 
and  professional  lives  of  millions  of  Americans  should  not  be 
under-rated.  Here,  too,  the  Boston  regional  office's  staff  report  pro- 
vides, I  believe,  very  important  information.  The  report  notes  that 
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a  1979  survey  conducted  in  part  by  College  Board  revealed  that 
over  half  the  competitive  colleges  responding  viewed  test  scores  .as 
a  very  important  factor,  and  almost  2  percent  considered  test 
scores  the  single  most  important  factor  in  making  admissions  deci- 
sions. Approximately  40  percent  of  both  the  public  and  private  in- 
stitutions responding  to  the  survey  indicated  that  they  had  mini- 
mum SAT  scores  below  which  applicants  generally  are  not  consid- 
ered eligible  for  admission.  v    ^  ^.i.  • 

TTS  and  College  Board  respond  to  critics  concern  about  the  im- 
portance of  the  SAT  by  explaining  that  many  colleges  are  simply 
no  longer  that  selective.  Such  statements  are  of  little -comfort  to 
the  student  with  a  combined^  score  of  975  who  wishes  to  attend  a 
school  that-has  a  minimum  requirement  of  1,000.  It  is  little  comfort 
to  students  whose  SAT  scores  are  not  high  enough  to  assure  admis- 
sion to  the  college  of  their  choice  because  they  were  ^unable  to 
obtain  effective  coaching.  These  test  takers  have  a  right  to  review 
the  questions  asked  and  to  assure  themselves  that  their  r^ponses 
were  correctly  scored;  They  have  a  right  to  learn  from  their  past 
mistakes  and  by  the  experiences  of  others.  Section  3  of  H.R.  1662 
would  give  test  takers,  the  students,  those  rights. 

Millions  of  students  and  parents  are  traumatized  each  year  in 
confronting  the  SAT.  Yet  the  marketplace  cannot  now  guarantee 
that  the  best  testing  instruments  are  being  used  to  evaluate  our 
children  For  students  cannot  choose  to  ignore  these  tests  and  their 
advocates  cannot  now  effectively  review  them.  Only  if  all  partici- 
pants in  the  testing  marketplace  have  access  to  the  test  questions 
and  the  answers,  and  to  all  relevant  research,  can  we  be  sure  that 
the^tests  used  are  v^lid  and  fair.  A  dollar  figure  can  simply  not  be 
placed  on  the  lost  potential,  if  access  to  college  and  to  the  profes- 
sions is  controlled  by  inadequate  measurement  tools 

In  conclusion,  I  believe  that  the  Bogton  regional  office  s  report 
represents  an  important  question,  ah  important  addition  to 
debate  on  standardized^  admission  tests.  I  hope  that  the  report  and 
my  remarks  will  be  helpful  to  the  committee  in  its  deliberations  on 
H  R  1662 

I'm  personally  very  disappointed  that  the  Federal  Trade  Commis- 
sion and  Joan  Garrity  who  was  the  lead  attornep'  for  my  staff,  who 
prepared  this  report  are  not  with  you  today  ana  I  very  much  hoi» 
Lliai,  iLc  uuiuiiiittcc  will  have  the  opportunity  to  hear  from  the  Fed- 
eral Trade  Commission  with  regard  to  this  matter. 

I'd  be  delighted  to  answer  any  questions  and  very  much  hope 
that  members  of  this  particular  committee  will  believe  that  the 
work  done  by  the  Boston  office  of  the  Federal  "Trade  Commission 
was  valuable  and  that  you'll  assist  in  insuring  that  the  Boston  re- 
gional offic3  is  one  of  the  10  regional  offices  that  the  Federal  Trade 
Commission  continues  to  have  in  place  working  tq  protect  the 

puWic^  p^gp^^gj  statement  of  Lois  Pines  follows;] 

Pbkpaked  Statement  of  Lois  G,  Pines,  Former  Director,  Boston  Regional 
Office,  Fedebal  Trade  Ck)MMiss!ON 
Good  morning  Mr.  Chairmen  and  members  of  the  Subcommittee,  My  nar^^^ 
Lois  G  Pines.  1  am  happy  to  respond  to  the  Subcommitt&.s  invitation  to  speak 
today  on  H.R.  1662,  the  Educational  Testing  Act  o£  1981, 
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I  firmly  believe  that  the  dilwlofures  required  by  H.R.  1662  are  essential  to  insure 
that  the  individual^  who  take  standardized  admission  tests,  as  well  as  the  institu* 
tions  which  utilize  them,  fully  understand  the  benefits  ond.the  limitations  of  those 
U»t8.  In  my  view,  it  is  a  matter  of  simple  marHetplace  fairness. 

The  two  and  one-half  years  during  which  I  served  as  the  Director  of  the  Boston 
Regional  Office  of  the  Federal  Trade  Commission  made  clear  to  me  that  without  full 
and  fair  disclosure,  consumers  of  any  product  or  service  caiinot  make  reasonable 
purchasing  decisions  nor  can  they  fully  exercise  their  rights  in  the  marketplace.  In 
this  particular  case,  when  the  service  purchased  can,  and  very  often  does,  perma- 
nently affect  the  purchaser  s,  educational  and  professional  life,  full  disclosure  is  all 
the  more  important.  Surely  if  consumers  have  the  right  to  Be  protected  by  laws  re- 
luirihg  disclosure  in  such  areas  as  credit  and  product  labelling,  they  have  a  right  to 
ull  disclosure  regarding  the  testing  services  that  shape  their  futures. 

Disclosure  legislation  in  the  education  sphere  is  not  new.  As  a  state  legislator  in 
Massachusetts,  I  sponsored  legislation  that  provided  for  the  disclosure  of  students' 
cumulative  public  school  records  to  students  and  their  parents.  That  legislation 
becam^  effective  in  1973. 

ExpeHa  in  the  testing  field  who  have  previously  testified  before  you  have  catalo- 
gued tH^  many  dangers  inherent  in  the  widespread  use  of  standardized  admission 
^ts.  Tlile  predictive  validity  of  the  tests  has  been  questioned.  Concerns  about  racial, 
economic  and  cultural  bias  have  been  raised.  Other  critics  have  stressed  that  these 
m^liiplfrrchoice  tests  cannot  identify  the  truly  creative  or  independent  thinker;  thai 
iucK  individuals  may,  in  fact,  be  penalized,  by  the  tests.  Personal  qualities  of  im-. 
mcn^  importance,  such  as  motivation  and  judgment,  can  simply  not  be  njieasured 
by  thehe  tests^  My  testimony  today  will  focus  on  still  another  area  of  concern— the 
degree  U)|which  these  tests  are  subject  to  special  preparation  or  "coaching." 

During\piy  tensure  with  the  FTC,  my  staff  at  the  Boston  Regional* Office  conduct- 
ed an  inv^igation  regard ing  coaching  for  standardized  admission  tests.  The  investi- 
gation wdsNspawned  oy  concern  that  commercial  coaching  schools  were  making 
'unfair  and  deceptive  claims  of  effectiveness. 

The  focis  shifted,  however,  after  FTC  staff  conducted  a  statistical  analysis  which 
found  thai  coaching  at  one  commercial  school  was  effective,  raising  its  students' 
Scholastic!  Aptitucle  Test  scores  an  average  of  approximately  25  points  on  both  the 
mathematical  and  Verbal  sections  of  the  test.  Staff  reviewed  other  studies  on  coach- 
ing for  the  SAT  anil  learned  that  other  researchers  had  also  found  coaching  to  be 
enertive.  Staff  then  undertook  a  review  of  the  materials  on  the  SAT  distributedby 
thelklucalional  Testing^  Service  and  College  Board:  The  question  became— have  ETS 
and  College  Board  fuliyvand  fairly  disclosed  the  benefits  of  coaching  for  the  SAT? 

Our  invlMtigation  culminated  with  the  Commission's  release  of  the  Boston  Region- 
al Office'^  Staff  Report  on  the  Federal  Trade  Commission  Investigation  of  Coaching 
for  Standardized  Admission  Tests.  I  believe  that  the  staff  report  makes  the  need  for 
H.R.  1662' absolutely  clear.  \ 

One  only  needs  to  read  the  Report's  comparison  of  what  the  studies  on  coaching 
showed  and  what  ETS  and  Collie  Board  were  saying  to  conclude  that  students  and 
educators;  have  been  misled.  The  i;eport  documents  that  the  information  sent  to  stu- 
dents and  educators  regarding  coaixhing  has  been  repeatedly  in  conflict  with  the  re- 
search onUhat  issue.  \  .  ^  j 
For  example,  in  1968  when  the  College  Board  trustees  were  telling  students  and 
educators! that  coaching  could  not  work^  that  such  endeavors  ^'corrupted"  education, 
researchers  had  already  conducted  studjes  showing  coachings  gains  of  29  points  on 
math  and  i60  points  on  the  verbal  section ^f  the  test.  After  yet  more  research  attest- 
ing to  the  effectiveness  of  coaching,  resew;ch»at  times  sponsored  by  College  Board, 
students  were  still  being  told  in  the  fall  of  1^79  that  cramming  does  not  raise  scores. 

Now  ETS  and  College  Board  try  to  play  a\isemantic  game  in  their  defense.  They 
explain  that  all  they  meant  by  saying  that  "dramming  Would  not  help  was  that  a 
few  hours  bf  drill  oh  s^n^ple  questions  would  nipt  help.  I  fear  that  the  students  and 
educators  reading  the  ETS  and  College  Board  nrt^terials  may  not  have  been  able  to 
grasp  such  a  fine  distinction.  When  you  have  nd.  other  source  of  information  it  is 
difficult  to  read  between  the  lines.  Coaching  for  t^ie  SAT  can  help— coaching  can 
mean  significant  score  improvements— yet  studentd^.and  educators  were  led  to  be- 
lieve that  it  would  not  help.  .  \ 

Fulltand  fair  disclosure  has  clearly  not  been  the  stahdard  by  which  JETb  and  Col- 
lege Board  have  judged  their 'materials  on  the  SAT.  It  iS  true  that  very  recently,  in 
the  face  of  much  public  discussion  and  pressure,  student^  have  been  given  more 
comprehensive  statement  on  the  coaching  issue.  Howevc^r,  absent  the  legislative 
mandate  ofH.R.  1662  insisting  on  full  and  fair  disclosure  ak  the  norm,  there  will  be 
no  assurance  that  even  these  modest  recent  improvements  will  continue. 
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In  fact,  there  is  reason  to  believe  that  misleading  statements  will  continue  to 
appear.  ETSs  response  to  the  Botjton  Regional  Office  report  is  a  case  in  point  A 
senior  vice  president  for  re^arch  at  ETS  was  said  to  have  argued  that  the  FTCs 
findings  were  flawed,  that  ETS  studies  had  indicated  much  lower  gams— 10.  pointa 
or  so.  Yet  ETS  has  relied  on  one  study  for  which  it  says  it  cannot  even  fihd  the 
underlying  data!  Its  own  researchers  have  criticized  many  of  the  other  studies  on 
which. it  relies  as  being  irrelevant  to  today's  test  takers  or  to  an  assessnjent  of  the 
effectiveness  of  a  sub6ta;>tive  and  well  constructed  coaching  program.  Moreover,  a 
quote  from  one  of  ETTS's  public  relations  officials  is  even  more  astounding.  On  May 
18,  1981,  that  official  is  quoted  as  saying— "We  don't  believe  that  short-term  cram- 
ming can  make  a  difference.  These  are  aptitude  tests  designed  to  measure  potential 
ability  and  can't  really  be  studied  for."  ,   .    ^  . 

Mandating  disclosure  about  the  effectiveness  of  coaching  would  result  jn  both 
practical  and  psychological  benefits^  in'  the  SAT  context.  On  the  practical  side,  stu- 
dents would  fully  understand  the  potential  of  coaching  and  be  better  able  to  decide 
whether  such  special  preparation  is  right  for  them.  Also,  schools  would  be  better 
able  to  counsel  their  students  on  the  question  of  preparation  and  to  decide  whether* 
to  pffer  such  preparation  themselves.  On  the  psychological  side,  students  would  be 
encouraged  not  to  view  their  three  digit  SAT  scores  as  the  final  word  on  their 
mental  capabilities.  For  if  scores  can  be  improved  by  coaching,  the  test  is  not  meas- 
uring some  unchanging  and  innate  capacity  to  learn.  It  is  not  measuring  "aptitude." 

The  Boston  Regional  Office's  staff  report  documents  yet  another  re'ason  why  H.R. 
1$62  is  essential.  The  report  highlights  the  fact  that  a  number  of  serious  education- 
al policy  ques^ons  are  raised  by  a  finding  that  coaching  fof'a  standardized  admis- 
sion test,  lucH  as  the  SAT,  can  be  effective. 

For  example,  the  implications  of  coaching  for  test  validity  must  be  exammed. 
Questions  are  raised  about  the^  meaning  of  an  examination  designed  to  measure 
verbal  and  mathematical  abilities  said  to  be  developed  over  a  lifetime  of  learning  if 
scores  can  be  meaningfully  changed  in  a  few  weeks  or  months  of  coaching.  Validity 
may  be  further.questjBned  if  coaching  is  helping  students  gain  inflated  scores  rather 
than  helping  them  demonstrate  their  actual  skills  and. abilities. 

Perhaps  the  most  important  question  raised  ^ip' the  report  is  the  question  of  fair- 
ness. Is  it  fair  tQ  rely  on  a  test  that  is  subject  to  coaching,  if  that  coaching  is  not 
equally  available  to  all? 

The  evidence  reviewed  in  the  'staff  report  indicates  that  the  unequal  access  issue 
is  important.  All  test  takers  do  not  have  access  to  coaching.  Cominercial  programs 
are  available  t<^  students  whose  parents  can.  afford  the  $200-$300  prices,  but  what 
about  students  whose  parents  do  not  have  such  resources?  Schools  in  wealthy  neigh- 
borhoods may  be  able  to  offer  effective  coaching  programs,  but  financially  pressed 
schools  may  not.  Moreover,  the  report  indicates  that  the  very  student*  most  in  need 
of  coaching-those  who  may  well  have  the  most  to  gain  bv  it— may  have  the  least 
access  to  it.  For  example,  theVe  is  some  evidence  that  the  degree  to  which  one  bene- 
fit* from  coaching  is  depcnder^^  on  one*s  parental  income  and  race. 

Before  the  answer  the  unequal  access  question  can  be  found,  however,  some 
very  fundamental  questions  about  the  test  itaelf  must  be  answered.  What  skills  and 
knowledge  does  the  SAT  actually  measure?  What  is  the  value  of  developing  such 
skills  and  knowledge?  And,  finally^  what  is  the  value  of  training  students  to  demon- 
strate those  skills  on  any  particular  examination?  .  <  t 

The  staff  report  does  not  provide  answers  to  these  important  questions.  Instead,  in 
encourages  experts  in  the  testing  fi6ld  to  devote  their  time  and  resource  to  finding 
the  answers.  In'that  regard,  the  Commission  specifically  asked  that  the  E)epartment 
of  Education  consider  the  important  educational  policy  questions  rmsed^jn-the 
report.  --""^  , 

At  this  time.  however»Jt  Js.difficult  for  ind.epftndfint-expcrts  to  conduct  the  neces- 
sary study  and  research.  The  test  agencies  exercise  enormous  control  over  what  re- 
search is  done  and  by  whom.  They  have  even  controlled  the  extent  to  which  re- 
search findings  receive  repeated  citation  and  which  findings  are  treated  as  no  more 
than  footnotes.  '        '       ,  ....  *  j       j  * 

H  R  1662  would  break  this  monopoly  power  by  assuring  that  independent  re* 
searchers  have  access  to  the  information  they  need  to  be  able  to  study  and  evaluate 
the  tests.  Specifically,  H.R.  1662  would  require  the  public  disclosure  of  the  test 
forms  and  scored  correct  answers.  It  would  require  the  full  disclosure  of  all  studies 
in  which  the  test  agencies  have  been  invol\^ed,  whether  those  studies  support  or 
refute  their  positions.  If  such  information  is  not  placed  in  the  public  domam,  the 
questions  raised  in  the  report  cannot  be  pursued.  Likewise,  without  this  disclosure^ 
the  concerns  rais^  by  otner  critics,  such  as  the  possibility  of  economic  and  racial 
bias  in  the  tests,  cannot  be  effectively  addressed.  The  impact  of  standardized  admis- 
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sion  tests -is  far  too  strong  to,  perm  it  only  those  with  a  self-perpetuating  interest  in 
the  outcome  to  review  the  validity  of  the  tests. 

For  the  rOle  that  standardized  admission  test  scores  play  in  the  educational  and 
professional  lives  of  millionfr  of  Americans  should  not  be  underrated.  Here,  too,  the 
Boston  Regional  Office's  staff  report  provides  important,  information.  The  report 
notes  that  a  1979  survey  conducted  in  part  by  College  Board  revealed  that  over  half 
the  competitive  colleges  responding  vie^yed  test  scores  as  a  very  important  factor, 
and  almost  two  percent  considered  them  the  single  most  important  factor  in  making 
admission  decisions.  Approximatefy  forty  percent  of  both  the  public  and  private  in- 
stitutions responding  indicated  that  the^  had  minimum  SAT  scores  below  which  ap- 
plicants generally  are  not  considered  eligible  for  admission.  / 

ETS  and  College  Board  respond  to  critics'  concern  about  the  importance  of  the 
SAT  by  explaining  that  many  colleges  are  simpiv  no  longer  that  selective.  Such 
statements  are  little  comfort  to  tht  student  with  a  combined  score  of  975  who 
—wishes  to  attend  a  school  that  has  ^minimum  requirement  of  1,000.  It  is  little  com- 
fort to  students  whose  SAT  scores  are  not  high  enough  to  assure  admission  to  the 
college  of  their  choice  because  they  were  unable  to  obtain  effective  coaching.  These 
test  takers  have  a  right  to  review  the  questions  asked  and  to  assure  themselves  that 
their  responses  'Were  scored  correctly.  They  have  a  right  to  learn  from  their  past 
mistakes  and  the  experience  of  others.  H.R.  1662  would, give  test  takers  those  rights: 

Millions  of  students  and  pairents  are  traumatized  each  year  in  confronting  the 
SAT.  Yet  the  marketplace  cannot  now  guarantee  that  the  best  testing  instruments 
are  beinff  used'tb  evaluate  our  children.  For  students  cannot  choose  to  ignore  these 
tests  and  their  advocates  cannot  now  effectively  review  them.  Only  if  all  partici- 
pants in  the  testing  marketplace  have  access  to  the  test  questions  and  answers,  and 
to  all  relevant  research,  can  we  be  sure  the  tests  used  are  valid  and  fair.  A  dollar 
Hgure  can  simply  not  be  plactod  dn.  the  lost  potential,  if  access  to  college  and  to  the 
professions  is  controlled  by  inadequate  measurement  tools. 

In  conclusion,  I  believe  that  the  Boston  R^ional  Office's  report  represents  an  im- 
portant addition  to  the  debate  on  standardized  admission  tests.  I  hope  that  the 
report  and  my  remarks  are  helpful  in  your  deliberations  on  H.R.  1662. 

I  strongly  urge  that  you  support  the  bill.  ' 

Mr.  Erdahl.  Thank  you  very  much  for  your  statement,  Mrs. 
Pines.  The  staff  hasjust  informed  me  that  there  is  a  reasonable 
poasibility  .that  the  FTC  will  be  submitting  some  written  testimony. 

You  know  it,  Fm  sure,  that  Mr.  Weiss  has  arrived,  the  principal 
author  of  the  bill  and  from  the  m^ority  side  and  I  )yould  at  this 
time  relinquish  the  ga^el  to  my  colleague  from  New  York. 

Mr.  Weiss.  Mr.  Erdahl,  thank  you  very  much  for  assuming  the 
chair  and  I  want  to  apologize  for  not  having  been  here  earlier.  The 
Senate  Committee  on-  Government  Operations  is  holding  some 
hearings  which  affected  some  of  my  constituents  and  I  had  to  tes- 
tify so  that's  my  reason  for  not  being  here. 

I  want  to  welcome  you,  Mrs.  Pines,  for  being  with  us  and  for 
your  participation  in  this  issue  over  the  course  of  the  years.  I  don't 
know  what  to  expect  from  the  FTC  these  days,  so  Fm  not  sure  that 
the  word  that  they're  going  to  make  a  submission  is  necessarily 
good  news./We  shall  wait  and  see. 

Mrs.  PiNfes.  I  might  remind  you.  Congressman  Weiss,  that  when 
the  report  was  issued  by  the  Federal  Trade  Commission  in  May  of 
this  year,  it  was^done  so  with  a  unanimous' vote  of  all  5  members. 

Mr.  Weiss,  Yibs;  but  there  have  been  some  changejs. 

Mrs.  Pines.  Fhave  notedvthat. 

Mr»  Weiss,  Yes;  in  arty  eVent,  we  hope  for  the  best. 

Do  you  have  information  br^ould  that  really  have  been  at  staff 
level  as  to  the  manner  in  which  the  study  was  set  up,  can  you  tes- 
tify to  that  at  all  as  to  who  was  interviewed  and  on  what  basis,  and 
so  on? 

Mrs.  Pines.  When  the  original  study  was  done  by  the  Federal 
Trade  Commission,  I  was  not  the  Regional  Director  and  I  would. 
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prefer  to -submit  to  ^ou,  whic^j  Vd  be  happy  to  do,  material  with 
regard  tc  the  spedfic*  of  that  j)articular  study.         v  . 

1  initiated  this  study,  which  was  based  upon  the  ohginal  study 
that  I  believe  your  stiff  has  with  regard  to  a  finding  that  CMchmg 
can  be  effective.  ThaA  study  was  dpne  as  I  arrived  at  the  Federal 
Tirade  Commission,.  I  didn't  participate  in  setting  that  study  up  m 
terms  of  establishing  the  boundaries  of  that  study.  \ 
Mr.  Weiss.  All  right;\  .      .  ^  o  \ 

Was  yoilrrbasically  d  statistical  and  mterview  study?  \ 
Mrs.  PiNis.  No;  no,  our  original  study  was  a  very  carefully  done 
statistical  study  that  took  a  great  deal  of  time.  ,  .i..  V  ^ 

Mr.  Wiffls.  We  had  some  infonnationyesterday,  !  thmk  that 
Commissioner  Anrig  gave  us  indicating  ElS's  conclusions  as  to  the 
^  difference  which  coaching  made.  And  again,  1  don't  have  the  lum- 
bers in  front  of  me.  My  Recollection  is  that  he  said  that  it  w^  a 
difference  of  13  points  on\the  verbal  and  21  on  math.  Is  that  riaht 
or  do  you  remember?  I  think  that  those— on  the  averse,  nght.  \ 

The  statistics  that  you  have  indicate  a  iriUch  larger  variable  than 
that.  \  "  ■  .  \ 

Mrs,  Pines.  .Unfortunately,  I  have  ^lot  had  1the  opp^unity  to 
read  or  heai  Commissione*  Anrig's  comments.  I  undej^stand  thafe 
those  figures  were  provided  for  20-hour  programs  as  opposed  to 
longer  programs.  Did  he  deAl  with,  for  example,  a  40-hour  course? 

Mr.  Wnss.  It  is  significanfl  that  ETS  has  been  much  moi-e  specif- 
ic over  the  course  ofthe  pastiyear  or  so  up  through  yesterday  as  to 
exactly  what  they  meant  andlwhat  they  mean  by  the  kind  oi  coach- 
ing which  has  no  impact,  littte  impact,  greater  impact.  And  I  think 
that  we're  perhaps  getting,  clise  to  a  point  -here  we  re  using  lan- 
guage in  the  same  way  and  lUhirik  that  partly  . has  been  the  prob- 
lem that  we've  had  in  arrivirig  at  mutual  conclusions  in  that  we 
were  using— we  seemingly  wdre  using  the  sane  language  but  in 
fact  we  were  not.  I  think  tha^  We're  getting,  there. 

Mrs.  Pines.  I  guess  I  would  ask  for  a  clarification,  are  th^ 
gaying— are  they  agreeing  thatj  coaching— did  they  refute  tiie  Fed- 
eral Trade  Commission's  report  Westerdaiy?  ,  '  .  ,  ,  , 
Mr  Weiss.  No.  No.  They— wefreally  I  don't  thmk  had  verv  much 
to  do  by  way  of  refutation.  I  think  what  they're— v/hat  Commis- 
sioner Anrig  was  ^ying  was  thWt  in  a  sense  the  discussion  ab^ut 
coaching  is  sort  of /irrelevant  and  second  that  the  amount  of  differ- 
ence it  makes  obviously  depends  bn  how  much  coaching  or  prepara- 
tion work  is  done  and  I  ddn'^t  thirik  anybody  h^  disputed  that. 

The  earlier  position  that  ETS  lhad  taken  was  quite  different  as 
the  testimony  indicates. 
Mrs.  Pines.  Absolutely. 

Mr.  Weiss.  OK.iMr.  Erdahl.      .  ^  , 

Mr.  Erdahl.  Thank  you  very  n^uch,  Mr.  Chfairman,  I  than)' you 


again  for  being  wiih  Us  today. 

From  your  testimony,  maybe  I 
elusion,  are  you  against  testing  per 
Mrs.  Pines.  Absolutely  not. 

Mr.  Erdahl.  What  are  some  of  p^nc.  «i^w.«v*.w«  

school  or  institution  to  at  least  forscast^  for  themsehes  and  for  the 
students  potential  academic  success?  You.  mentioned  m  your  re- 
marks, I  believe  that  some  schools  establish  a  cutoff  for  admission 


iave*  arrived  at  an  improper  con- 
1  se  or  the  standardized  tests? 

;he  alternatives  to  testing  for  a 
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of  a  combined  SAT  score  of  1,000.  The  person  that  scored  975  was 
^    out..  What  of- the  person  that  scored  300? 

Mrs.  Pines.  Our  report  did  not  deal  with  whether  or  not  there 
should  be  testings  our  report  and,  my  comment  dealt  with  the  issue 
of  whether  coaching  could  be  effective  in  assisting  a  student  ip 
raising  his  or  her  scores.  And  once  you  determine  or  you  accept  v-? 
fact  as  I  believe  now  has  been  done,  that  coaching  can  be  effective 
in  assisting  a  student  in  raising  his  or  her  scores.  Then  that,  1  be- 
lieve, calls  into  question  the  validity  of  that  particular  test  with 
regard  to  what  it  is  that  test  is  intended  to  do. 

I  am  not  here  recommending  that  no  testing  or  no  standardized 
testing  be  utilized,  but  what  we've  attempted  to  do  is  to  raise  ques- 
tions which  we  think  educators  are  best  able  to  deal  with. 

ETS  for  years  has  represented  that  coaching  would  not  help  and 
that  all  one  needed  to  do  was  to  have  a  good  night's  sleep  and  a 
good  breakfast  before  you  took  that  particular  test  that  day  and 
what  the  Fedejral  Tra^e  Commission  looked  into  was  the  validity  of 
that  particular  statement  and  we  concluded  in  our  report  that  they 
have  misrepresented  the  evidence  with  regard  toxoaching. 

Mr.  ErdahL  Mr.  Chairman,  that  leads  to  another  question,  when 
does  one,  either  the  taker  or  the  giver,  when  do  we  cross  the  line 
from  studying  and  cramming  and  coaching?  I  tliink  that  may  be  a 
fuzzy  question,  but  I  think  it's  fundamental.  If,  it's  wrong  to  be 
coached  for  a  test,  is  it  wrong  to  try  to  cram  or  to  study? 

You  mentioned  about  the  students  traumatized  by  ETS  tests.  I 
suppose  a  lot  of  us  \yhen  we  were  going  to  school  were  traumatized 
by  any  tests.  I'm  not  sur^  that  that  is  our  goal  to  get  away  from 
that  potential  trauma  or  pressure.  That  maybe  is  good..  Could  you 
tell  me  when  do  we  cross  the  line  between  studying,  cramming  apd 
coaching? 

Mrs.  Pines.  Well,  as  Chairman  Weiss  indicated,  we're  dealing 
with  semantics  in  terms  of  what  this  issue  is  all  about.  ETS  basical- 
ly stated  that  for  years  that  one  could  not  prepare  for  their  test. 
What  we  established  was  that  indeed  there  have  been  various  stud- 
ies that  appear  to  be  quite  valid ^Ihat  do  substantiate  that  coaching 
has  be^en  helpful  .to  students  in  increasing  their  scores. 

Certainly  I  would  imagine  that  most  educators  would  encou^i^^e 
students  to  continue  to  study  and  to  learn  and  to  improve  them- 
selves educationally.  And  when  one  particular  test  has  the  magni- 
tude that  the  SAT  has,  then  obviously  a  great  deal  of  scrutiny 
needs  to  be  given  to  that  test  and  the  circumstances  that  surround 
,the  giving  of  that  tpst. 

It's  not  an  ordifiary  test,  because  the  SAT  is  the  single  most  im- 
portant factor  used  by  2  percent  of  the  colleges  that  responded  to  a 
survey  doiie  by  the  Coll'^ge  Board. 

Mr.  Erdahl.  That  stkistic  surprised  me  because  I  would  have 
thought,  that  it  would  have  been  used  by  at  least  50  percent.  Other 
criteria  surely  come  in  whether  its  high  school  scores,  evali  ^tion 
by  teachers  and  a  lot  of  things.  I'm^not  trying  to  challenge  you,  but 
I  frankly  was  surprised  that  only  2  percent  used  that  as  a  major,  1 
assumed  that  it  was  used  by  more.  \ 


Mrs,  Pines.  The  single  most  important  factor  however  let  me  \ 
check  my  statistic  here,  but  many  of  the  schools  used  it,  most  of 
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the  schools  use  it  and  the  question  is  to  what  degree  do  they  rely 
upon  it.  o    -  . 

Mr.  Erdahl.  We  had  some  hearings  on  this  last  year  where 
many  of  the  university  schools  and  others  testified  they  used  high 
school  rank  and  other  indications  but  that  testing  is.  one  of^the 
tools  used  I  supposed  for  them  and  for  the  student  to  give  some  in- 
dication of  potential  academic  achievement  and  whether  he  or  she 
is  going  to  survive  in  that  school.  ^ 

Mrs.  Pines.  That's  correct,  however,  when  56  percent  of  the 
school,  it's  almost  57  percent  of,  the  schools,  cited  the  admission 
score  as  a  very  important  factor  and  33  percent  considered  them 
one  of  several  factors.  An  enormous  amount  of  weij^ht  is  obviously 
being  placed  on  one  test.  Oftentinies  to  the  excluision  of  xhe  aca- 
demic record  of  that  student  over  their  entire,  high  school  career. 
And  for  that  reason  we  felt  that  this  was  a  very  important  issue 


weight  put  on  it.  /        .  . 

You  have  mentioned  the  Study  several  times.^I  have  not  read  it 
yet,  but  I  have  a  copy  of  it  and  evidently,  as  I  understand  it,  this 
was  released  under  a  blue  cover  and  designated  as  a  staff  nl^mo- 
randum.  Its  date  \yas  September  1978,  but  it  ^yas  released  in  May 
of  1979.  r  believe  that  wds  the  time  you  were  the  Regional  Director 
up  at  Boston,  is  that  correct?  / 
NMrs.  PiUES.  I  had  become  Regional  Director  in  March  of  1979. 

MI^Erdahl.  OK.  / 
.  Then  Tm  goingjojieaijudisclaimer  that  appears  on  the  cover  of 
the  report  and  wouldTTke  to^have  you  comment  on  that. 

It  says,  note,  this  memorandum  is  being  placed  in  the  public 
domain  because  ilTmight  ma}ce  a  contributibn  to  the  public  debate 
on  the  issues  addressed.  Thie  views  and  conclusions  expressed  in 
this  iTiemorandum  are  those  of  staff  members  of  the  Boston  Region- 
al Office  of  the  Federal  Trade  Commission.  Those  views  and  conclu- 
sions have  not  been  adopted  by  the  Conimission  or  any  individual 
[  rcommigsioner.  . 

\  Moreover,  the  Commission  specifically  believes  that  some  of  the 
Ij  conclusions  in  the  study  are  riot  supported  by  the  Evidence  ob- 
1*  tanned  injhe. investigation.  " 
1  -Gould  you  comment  on  that  disclaimer  and  why  didn  t  at  least 
lone  of  the  members  of  the  Federal, Trade  Commissior  express  a 
willingness  to  be  identified  with  the  staff  report? 

Mrs.  Pines.  I  don't  believe  that  the  issue  Was  i^laced  before  the 
[Commission  wilh  regard  to  a  decision  op  the  adoption  of  the  report. 
(The  Federal- Trade  Commission  prepares  many  staff  reports  on  nu- 
merous or  hundreds  of  issues  over  a  period  of  time.  Ecmiomic  anal- 
ysis as  well  as  a  statistical  analysis,\such  as  that  one.  ^ 
\  And  the  issue  was  not  whether  or  not  the  Qommission  should 
idopt  the  report,  it  never  was  broumt  to  the  Commission  for  such 
adoption.  \         ■  /  . 

\Mr.  Erdahl.  So,  you  claim  that  the  disclaimer  is  not  really  a 
judgment  on  it  but  just  the  fact  that  they  didn't  consider  it? 

lyirs.  Pines.  Absolutely  and  indeed,  this  particular  report  which  I 
submitted  to  you  today  was  indeed' adopted  hy  the  Gomipission  and 
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was  voted  to  be  distributed  by  a  unanimous  repo  I  and  this  report 
relies  upon  the  statistical  analysis  that  was  done  in  the  report 
vyhich  you  have  before  you. 

Mr.  Erdahl.  Again,  Fm  not  trying  to  be  contentious  here,  but 
staff  has  just  handed  me  a  copy  of  the  brief  report  and  it. says  the 
views  contained  in  this  document  are  those  of  the  staff  of  the  Fed- 
eral Trade  Commission,  the  views  have  not  been  formally  adopted 
by  the  Commission.  If  I  could r|respond  to  your  other  observation, 
somebody  on  the  Commission  lOr  some  other  staff  members  must 
have  made  a  judgment  because  the  closing  sentence  is,  moreover, 
the  Commissioa  specifically  believes  that  some  of  the  conclusions 
in  the  study  are  not  supported  by  the  evidence  obtained  in  the  in- 
vestigation. 

Is  thai;  disclaimer  placed  on  by  the  Commission  or  a  commission- 
er or  other  staff?- 

^rs.  Pines.  That  question  ought  to  be  asked  of  the  Federal  Trade 
Commission  when  they  appear  before  you,  I  am  not  here  represent-^ 
/ing  the  Commission,  I  am  here  as  an  individual  this  morning.  I  was 
the  Director  of  the  Office  that  prepared  this  report  and  not  that 
report.  '  ^ 

Mr.  Weiss.  By  this  report  you  mean  the  small  staff  summary,  is 
that  the  idea? 

Mrs.  Pines.  Correct. 

Mr.  Erdahl.  Fm  still  a  bit  confused.  Just  so  we  have  it  straight 
because  I  understand  that  this  was  released  in  May  1979.  The  date 
on  it  is  September  1978,  but  it  was  released  at  a  time  during  the 
period  that  you  were  in  fact— I'm  not  trying  to  cross-examine  you,  I 
don*t  want  to  make  it  appear  that  way,  because  you've  b,een  a  very 
cooperative  witness  and  you  gave  us  some  good  testimony.  But  it 
was  released  during  the  time  that  you  evidently  were  the  Director 
but  you  said  you  were  not  involved  in  tJie"^  first  report?' 

Mrs.  Pines.  That's  correct,  I  was  not  personally  ^involved  in  the 
preparation  of  the  original  report.  The  report  that  J  believe  that 
you  have  before  you  was  released  by  the  Bureau  of  Consumer  Pro- 
tection in  Washington.  "  \ 

jMr.  Erdahl.  I  don't  know  about  that>  but,  Mr.  Chairman,  it  says 
it's  a  staff  memorandum  of  the  Boston  Regional  Office  of  the  Fed- 
era.1  Trade  Commission,  the  effects  of  coaching  on  standardized  ad- 
mission examinations. 

Mrs.  Pines.  That's  correct.  Let  me  try  to  explain. 

Mr.  Erdahl.  OK.  \ 
/  Thlpn  Fm  probably  taking  more  of  my  time,  but  please  make  an 
expla^iation  and  I  yield  back  to  my  colleagues,  but  go  ahead. 
/  Mr^,  Pines.  Part  of  my  tenure  at  the  FTC,  the  Boston  Regional 
/Office  ^id  an  analysis.  The  Office  of  the  Bureau  of  Consumer  Pro- 
^tection  |n  Washington  did  a  reanalysis  and  they  issued  an  addition- 
al  report.  At  that  time  J  had  become  the  Regional  Director  of  the 
Boston  Office,  however,  I  personally  did  not  participate  in  any  way 
with  regard  to^the  issuance  of  that  report  or  the  research  done  on 
which  thai  report  was  based. 

Mr.  Erdahl.  OK. 

Maybe  this  will  clarify  it.  Are  the  report  or  reports,  are  they  the 
result  of  a  group  of  studies,  two  studies  or  one  study? 
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Mrs.  Pikes.  The  original  statistical  analysis  was  dori^  once  and  it 
was  reexamined  and  reanalyzed  several  times.  This  particular 
report  with  regard  to  coaching  for  standardized  admissions  tests 
was  based— was  an  additional  report  that  was  based  upon  the  find- 
ings in  the  statistical  analysis  that  coaching  could  be  helpful  and 
effective  for  students.  '  ^  rr 

It  was  also  based  upon  additional  research  done  by  my  statt  with 
regard  to  the  other  studies  that  had  been  done  by  EPS  and  others 
on  the  issue  oif  coaching  per  se.  So,  that  I  was  not  involved  with  the 
study-done  by  the  Federal  Trade  Commission  initially  prior  to  my 
tenure  relative  to  the  analysis  of  the  effectiveness  of  coaching  for  a 
group  of  students  that  were  carefully  analyzed. 

Mr.  Erdahl.  OK.  ^  ^,  . 

Thank  you  very  much.  Thank  you,  Mr.  Chairman. 

Mr  Weiss.  Mr.  DeNardis,  Tm  sorry,  it's  a  lon^moming 
^  Mr.  DeNardis.  Mrs.  Pines,  thank  you  for  your  testimony;  this  is 
a  subject  of  great  interest  to  me  as  a  former  educator,  teacher, 
social  scientist  for  the  past  16  years  before  my  election  to  this  body. 
Tm  apt  to  want  to  scrutinize  testimony  on  this  subject,  therefore, 
more  carefully  than  might  be  normally  expected  And  I  was  inter- 
ested in  the  exchange  between  you  and  Congressman  Erdahl.  1 
think  there  is  one  further  question'  in  that  if  I  may.  Immediately 
inside  this  blue  front  cover  of  the  report  there  appears  a  full  page 
statement  from  the  Bureau  of  Consumer  Protection,  which  I 
assume  is  in  the  FTC  

Mrs,  Pines.  In  Washington. 

Mr.  DeNardis.  The  headquarters  bureau?  .  ,       ,  t 

Mrs.  Pines.  I  don't  happen  to  have  that  report  with  me.because  1 
was  hot  planning  to  testify  on  that  report.  r^-     *  f 

Mr.  DeNardis.  This  is  dated  May  1979.  You  were  the  Director  at 

that  time?  .  ai^l     u       t  *  u 

Mrs  Pines.  I  had  just  become  the  director.  Although,  as  1  tpld 
Congressman  Erdahl,  I  was  not  involved  in  the  preparation  of  t^ 
particular  report  in  any  way.  That  was  issued  out  of  Washington 
and  although  the  initial  research  and  work  had  been  done  by  the 
Boston  regional  office,  it  was  .before  I  was  personally  there  and  1 
had  no  affiliation  with  that  report.  ,  .    .   \  .  w 

Mr  DeNardis.  Well,  in  the  interests  of  truth  in  testifying,  let  us 
just  clarify  this  and  say  for  the  record  that  there  doe^  appear  a 
statement  by  the  Bureau  of  Consumer  Protection  dated  May  IJTy, 
which  further  disclaims  the  Boston  office  report  and  in  tact,  says 
there  are  several  major  flaws  in  the  data  analysis  making  the  re- 
sults unreliable.  I  think  that  should  be  noted  for  the  record. 

I  think  you  have  been  very  forthright,  however,  about  |  your  in- 
volvement with  this  and  I'm  not  questioning  that,  I  m  just  ques- 
tioning the  document:  You  were  the  director  for  a  time  an^  during 
that  time  you  reissued  a  report   , 

Mrs.  Pines.  It  wasn't  a  reissuance  of  a  report,  it  was  a  ditterent 

analysis.  ^ 

Mr.  DeNardis.  A  different  analysis. 

Mrs  Pines.  This  is  a  different  report  than  that  report.  \ 
,    Mr.  DeNardis.  But  as  Congressman  Erdahl  has  noted,  the  dis- 
claimers still  appear. 
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Mrs.  Pines.  That  is  common  practice  by  the  Federal  Trade  Gom- 
mission.  ' 

Mr,  DeNardis.  At  any  rate,  what  we're  trying  to  do  is  to  estab- 
lish your  interest  and  involvement-^  

Mr.  Miller.  What  is  the  common  practice? 

Mis  Weiss.  Are  you  asking  Mr.  DeNardis  to  yield  to  you? 

Mr.  MlLtER.  Yes;  if  you  would  just  for  a  minute  because  I  have 
the  same  confusion.  We  have  a  disclaimer  on  the  cover  

Mr.  DeNardis.  I  would  be  very  glad  to  yield  to  my  colleague 
from  California. 

Mr.  Miller..  We  apparently  have  not  cleared  up  the  problem  of 
what  is  the  impact  or  the  status  of  the  report  with  the  disclaimer 
on  the  cover.  You  mention  that  the  report  has  been  adopted  unani- 
mously. Is  it  a  matter  of  changing  the  cover  to  reflect  that?  I  think 
we  have  some  confusion  on  the  panel  here  still. 

Mrs.  Pines.  Congressman  Miller,  the  common  practice  of  the 
Federal  Trade  Commission  is  to  put  this,  disclaimer  on  practically 
everything  that  comes  out  of  the  Commission.  And  the  Commission 
did  vote  to  issue  this  report  by  unanimous  vote  and  in  addition^  the 
Chairman  of  the  Commission  pursuant  to  the  recommendations  of 
the  staff  wrote  to  the  Department  of  Education  referring  this 
report.  Copies  of  this  report  were  sent  by  the  Chairman  of  the 
Commission  to  the  members  of  the  Congress  who  are  interested  in 
this  particular  issue. 

Mr.  Miller.  Well,  for  the  purposes  of  this  committee,  if  I  can  in- 
terrupt you,  what  does  that  mean,  that  they  stf^hd  behind  the 
report,  that  they  have  found  no  flaws  in  the  report  as  they  have 
analyzed  it,/nd  they  think  the  methodology  is  correct,  what  does 
that  mean?>Does  it  mean  that  they  basically  believe  it's  correct  but 
it's  not. going,  to  get  their  good  housekeeping  seal  of  approval?  I 
don't  understand  what  that  means. 

Mrs.  Pines.  The  Federal  Trade  Commission  did  vote  unanimous- 
ly, to  forward  this  report  to  Members  of  Congress,  to  issue  it  to  the^ 
public  and  to  forward  a  letter  to  the  

Mr.  Miller.  But  it  hasn't  been  adopted  by  

Mrs.  Pines.  Secretary  of  Education,  but  indeed  to  the  best  of  my 
knowledge  such  jreports  are  never  dealt  with  any  differently  than 
this  report. 

Mr.  Miller.  I  guess  it's  a  luxur>^  that  those  of  us  in  politics  don't 
understand.  I  don't  understand  how  I  could  put  soniething  out  of 
my  office  and  say  it  doesn't  reflect  my  views  and  it  hasn't  been 
adopted,  but  it's  out  there.  Where's  the  accountability  for  the 
report,  that's  all  I'm  trying  to  establish. 

Mr.  Weiss,  Well,  if  the  gentleman  will  yield,  I  assume  that  if  the 
FTC  were  to  send  a  representative  we  could  clarify  that  position, 
but  we're  not  sure  at  this  point  as  to  whether  they  will  in  fact  send 
someone  in  person,  '  ^,         .  . 

Mr.  Miller,  Just  send  the  committee  a  letter  explaining  the  pro- 
cedure and  ho^  this  is  done.  Tm  npt  trying  to  attack  the  validity  of 
the  report. 

Mr.  Weiss.  We  will  ask,  so  that  the  record  is  complete,  for  the 
FTC  to  explain  what  their  various  notations  and  grading  on  reports 
which  are  released  by  their  office. 

[Information  referred  to  follows:] 
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Ch^l^il^S^u&niittee  on  PosUecondary  Education,  Committee  on  Education  and 
Labor,  House  of  Reprt$entative$,  Washington,  AC,. 
DiA«  Mr.  Chairman:  Thank  yon  for  your  letter  of  November  10, 1981. 
In  response  to  your  questions:  ,  ,         ^  v  ^ 

(1)  FTC  reports  are  published  with  a  disclaimer  whenever  the  reports  have  uot 
been  adopted  by  a  vote  of  the  Commission. 

(2)  Reports  iseued.by  regional  offices  are  handled  in  the  same  way. 

For  example,  the  statement  Mr.  Muris,  Director  of  the  Bureau  of  Consumer  Pro- 
tection  submitted  to  your  joint  hearings  conUined  a  disclaimer  for  the  very  same 
reason/ to.distinguish  .staff  views  frojn  formal  CommisBion  positions. 
Please  let  me  know  if  you  have  any  further  questions. 

Sincerely  yours,.  James  C.  Miller  III, 

Chairman. 

Mr.  Wess.  Mr.  DeNardis.  j      i  ^ 

Mr.  DeNardis.  Yes.  So,  we  have— we  have  established  at  least 
this,  that  one;,  you  are  an  independent  witness,  you  are  appearing 
here  on  your  own  and  second,  you  have  presented  us  with  some  re- 
ports which  have  not  been  adopted  by  the  Federal  Trade  Commis- 
sion>  but  wh|ch  rn^^V,^^  interesting  and^illumin^^^ 
riarro>y  range  of  reliability. 
Mr.  Weiss.  You  may  expand  on  that. 

Mr.  DeNardis.  And,  that  third,  I  understand  that  you  are  now 
engaged  in  a  political  campaign  in  the  State  of  Massachusetts.  Is 
'  that  true  too?  . 

Mrs.  Pines.  Fm  planning  to  be.  ,  .  r 

Mr.  DeNardis.  Good  luck.  L  don't  know  what  you  re  running  for 
or  what  label  you  bear,  biit  we're  glad  to  welcome  you  to  the  politi- 
cal arena. 

Mrs.  Pines.  Fve  been  there  before.  i . 

Mr.  Weiss.  Mrs.  Pines,  if  you— I'm  sure  Mr.  DeNardis  would 
want  you  to  have  the  opportunity  to  respond  to  the  comment  ques- 
tion that  he  jUst  put  to  you  in  its  entirety  in  anyway  that  you 
.  would  like,  right?  .         ^  ,  ,  ,  . 

Mr.  DeNardis.  Certainly,  Mr.  Chairman.  I  was  going  to  go  on  but 
you  may  respond  to  that,  but  I  was  going  to  go  on  and  ask  you  an- 
other question  if  I  might  with  respect  to^your  testimony  on  p'ige  7. 

Mr.  Weiss.  Before  you  do  that,  do  you  want  to  expand  on  the 
characterization  that  Mr.  DeNardis  made  of  what  you  testified  to 
as  far  as  these  reports  are  concerned? 

Mrs.  Pjnes.  I'm  concerned  with  Congressman  DeNardis  s  com- 
ments obviously.  An  enormous  amount  of  work  and  effort  went 
into  this  analysis,  I  oversaw  the  work  personally  and  the  Federal 
Trade  Commission  has  adopted  this  policy  with  regard  to  issuing 
their  disclaimers  on  everything  from  press  releases  to  all  of  the 
staff  work  that's  done  on  an  ongoing  basis  and  it's  common  ordi- 
nary practice  for  the  Federal  Trade  Commission.  I  m  not  comment- 
ing on  the  validity  of  it  or  the  acceptability  of  it  or  the  process  and 
certainly  I  would  ask  the  FTC,  although  they  have  no  reason  to  re- 
spond to  me  at  this  time.  To  forward  to  you  

Mrs.  Weiss.  We'll  do  that. 
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Mr.  PiNES.They're  common  ordinary  the  analysis  of  this  proce- 
dure that  has  been  adopted. 

But  I  would  certainly  hope  that  the  members  of  this  committee 
would  hot  allow  the  adoption  of  a  disclaimer  to  detract  from  the 
vfrAk  that  was  so  carefully  done^  and  analyzed  and  read  carefullv 
by  all  members  of  the  Commission  before  the  Commission  took 
action  based  upon  this  particular  matter. 

Mr.  DeNardis.  I  would  say  that  it's  not  merely  the  lack  of  adop- 
tion by  the  Commission  that  concerns  us  but  it  is  their  comment 
about  the  validity  or  lack  thereof  of  the  conclusions  based  on  the 
methodology  and  the  evidence  examined.  And  since  you  have  now 
just  stated  that  you  personally  supervised  the  work,  it  is  now  ap- 

Sropriate  for  me  to  ask  you  what  background  and  experience  you 
ave  in  the  design  of  research  and  the  analysis  of  empirical  data, 
which  I  would  not  have  asked  l)ad  you  not  said  you  personally  su- 
pervised the  work. 

Mrs.  Pines.  Tm  sorry.  Congressman,  you  obviously  misunder- 
stood what  I  attempted  to  say.  I  did  not  supervised  the  initial 

—       report,  l  am  only-referring'to-this  particular-repjort  —  

Mr.  Weiss.  Instead  of— may  I  make  a  suggestion,  instead  of  talk- 
ing about  this  report  and  that  report,  perhaps  if  we  put  a  date  on 
the  report.  When  was  the  small  report  that  you  have  anything  to 


Mrs.  Pines.  The  May  1981  report.  ^ 
Mr.  Weiss.  All  right. 

So,  we're  talking  about  the  1981  report,  but  you  had  nothing  to 
do  with  the  1979  report,  is  that  right? 
^  Mrs.  Pines.  That  is  correct. 

Mr:  Weiss.  Thank  you. 

Mr.  DeNardis.  Thank  you,  Mr.  Chairman,  for  helping  us  clarifv 
this.  On  page  7  of  your  testimony,  the  second  paragraph,  you  talk  ^ 
about  the  role  of  standardized  admission— the  role  that  standard- 
ized admission  test  scores  play  in  the  educational  and  professional 
lives  of  millions  of  Americans.  You  go  on  to  make  the  point*  that 
over  half  of  the  competitive  coUegeG-rasponding  viewed  test  scores 
as  a  very  important  factor  and  aJfnost  2  percent  considered  them 
the  single  most  important  factor  in  making  admission  decisions. 

The  Weiss  bill  as  I  read  it  and  as  I  understand  it  .  does  not  affect 
how  admissions  counselors  and  admissons  committees  deal  with  the 
standardized  test  scores  and  I  just  wanted  

Mrs.  Pines.  Absolutely. 

Mr.  DeNardis.  OK.  ^  ... 

So  you're  not  saying  that,  however  much  you  might  be  raising 

that  as.  a  point  and  taking  issue  with  this  

Mrs.  Pines.  No. 

Mr.  DeNardis.  You're  riot  taking  issue  with  it.  Then  let^s  simply 
clarify  it,  that  this  bill  does  nothing  to  correct  the  inappropriate 
use  of  test  scores? 

Mrs.  Pines.  I'm  not  suggesting  that  it's  an  inappropriate,  I'm  not 
making  a  value  judgement  with  regard  to  how  the  educational  in- 
stitutions utilize  the  particular— -any  tests  or  other  educational  in- 
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.  formation  that  they  utilize  which  to  make  their  decisions.  Howev- 
er, we  are  jnerely  stating  the  conclusion  of  the  ETS  or  the  College 
Board  study  where  schools  were  interviewed  and  asked  to  what 
'  degree  they  relied  upon  the.>SAT.  ,  i      .  i. 

And  based  upon  the  responses  of  the  institutions  merely  point 
out  that  the  institutions  are  relying  very  heavily  or  many  of  them 
are  relying  very  heavily  on  this  particular  test  and  thereby  putting 
forth  the  question  if  tKey  rely  on  the  test  and  coaching  can  be  help- 
ful 8Jid  students  or  some  students  or  many  students  do  not  have 
access  to  coaching,  what  does  it  mean  for  the  future  of  that  partic- 
ular student  who  may  score  at  a  lesser  level  than  would  be  needed 
to  gain  admission  to  that  particular  institution. 

Mr.  DeNardis.  Well,  what  woul^  the  adoption  of  this  bill  do  to 
remedy  that  situation?  .      .  ,    ,    .  i  u 

Mrs  Pines.  I  believe  that  the  adoption  of  the  legislation  would 
provide  for  fuller  and  fair  disclosure  to  the  public  with  regard  to 
the  test  results  and  test  scores  and  in  addition  the  information  that 
the  statistical  information  and  othe^  data  gathered JLlhe  J^ 

 agencies  and  thus  give  Independenl  researchers  the  opportunity  to 

do  the.analvses  that  might  be  helpful  in  terms  of  making  the  edu- 
cational judgements  or  adding  to  the  discussion  with  regard  to  the 
educational  arena  with  regard[to  these  educational  policy  issues. 

I  think  that  the  bill  is  important  because  it  provides  students 
with  an  opportunity  to  see  their  tests,  ascertain  where  they  went 
wrong  and  in  some  cases  as  I'm  sure  you're  well  aware,  when  ETS 
chose  to  do  that,  in  one  instance,  a  particular  youngster  found  that 
he  had  answered  the  question  correctly  although  ETS  had  called  it 
wrong,  thus  forcing  ETS  to  alter  or  to  raise  240,000  youngster  s 
scores  because  they  had  answered  the  question  in  a  similar  vein. 

Mr.  DeNardis.  Be  that  as  it  may,  isn't  it  true  now  that  there  is  a 
considerable  amount  of  voluntary  disclosure  as  the  r^ult  of  the 
pressure  of  this  legislation  and  legislation  in  several  States?  The 
fact  of  the  matter  is  there  is  considerable  amount  of  voluntary  dis- 
closure at  this  point.  .  .  i 

Mrs.  Pines.  There  is  voluntary  disclosure.  There  is  some  volun- 
tary disclosure  at  'this  point.  I  think,  however,  that  it  s  very  impor- 
tant that  this  legislation  be  passed  so  as  to  insure  that  limited  vol- 
untary disclosure  is  expanded  to  cover  all  tests  in  all  circum- 
stances. 

ETS  has  for  many  years  failed  to  disclose  much  of  the  informa- 
tion that  I  personally  should  have  been  made  public.  ETS  chose  not 
to  report  the  findings  of  several  studies  with  regard  to  coaching  in 
their  own  literature.  I  think  that  it's  important  for  the  public  to 
have  full  access  to  all  the  information  so  that  an  appropriate  anal- 
ysis can  be  made.  It  would  end  the  monopoly  that  ETS  presentlv 
has  with  regard  to  the  information  gathered  by  them  and  the  anal- 
yses done  by  them  and  I  think  that  in— that  that's  very  important 
when  we're  talking  about  an  issue  that  affects  millions  9f  students 
who  take  this  test.  And  their  futures  are  obviously  critically  de- 
pendent on  what  happens  to  them  in  t\ie  taking  of  this  one  test  in 
their  lifetime.  ^  ^  .     ^         .      ,  .  - 

Mr.  DeNardis.  Thank  you.  I  have  additional  questions  but  1 
would  yield  to  the  chairman  who  would  like  to  pass  on  to. another 
member. 
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Mr.  Weiss.  Thank  you  very  much,  I  appreciate  your  cooperation, 
we'll  come  back  to  a  second  round,  if  any  member  wishes  to  ques- 
tion. 

Mr.  Miller..  ^ 
Mr.  Miller.  Thank  you,  Mr.  Chairman.  You  at  some  point  m  the 
report— I  think  it's  on  page  12,  try  to  show  the  preciseness  with 
which— within  some  institutions,  the  SAT  is  used.  Either  with  the 
combined  grade  point  score  or  at  our  own  University  of  California, 
you  have  a  sliding  scale  depending  upon  the- combined  grade  point 
and  SAT.  Then  in  your  executive  summary  you  suggest  that  the 
College  Board  has  submitted  some  descriptive  materials  prepared 
for  the  1980-81  testing  year,  talking  about  whether  a  10  point  or  15 
point  gain,  coiild  be  made  by  various  coaching  programs. 

Actually,  for  a  combined  25  point  increase  and  then  a  suggestion 
that  the  Commission  feels  in  some  instances  that  may  even  be 
hfgher  and  there's,  also  a  question  raised  in  the  executive  summary 
whether  that  first  suggestion  of  10  or  15  points- is.  in  fact  going  to 
be  increased. 

I  still  have  a  concern  that  I  don't  see  that  it  is  answered  either 
by  the  legislation  or  by  the  testing  service  and  that  is  what  hap- 
pens to  kids  tliat^n't  partake  in  coaching.  And  as  we've  heard 
over  the  life  of  the  hearings,  this  does  have  a  serious  impact  on  the 
future  of  these  young  people. 

I  encountei:ea  it  last  week  or  the  week  before  when  my  son  came 
home  and  told  me  he  was  going  to  take  the  PSAT,  I  guess,  and 
then  suggested  what  coaching  could  do  for  him.  I  tried  to  suggest 
that  yes,  no,  maybe— a  lot  like  the  report  here. 

But  he  was  convinced  if  he  enrolled  in  a  coaching  course  he  was 
going  to  pick  himself  up  50  or  100  points.  I  assume  that  was  based 
upon  locker  room  talk  at  the  high  school,  but  it  was  obviously  very 
prevalent  that  this  is  what  everybody  was  going  to  do. 

I'm  very  concerned  to  wh^t  happens:  one,  the  extent  to  which 
students  are  being  misled  about  what  coaching  will  or  will  not  do 
and  to  the  extent  to  which  those  students  who  are  not  able  to  par- 
ticipate in  coaching,  if  it  does  have  an  increase  of  somewhere  be- 
tween 25  poinfe  and  100,  what  happens  to  those  students.  And  I 
echo  that  concern  and  I  think  we  can  get  as  bogged  down  as  we 
want  on  disclaimers,  but  this  has  not  yet  been  answered  by  this 
Educational  Testing  Service  and  it  has  not  yet  been  answered  by 
the  Commission  or  this  committee. 

I  dare  say  there  is  a  whole  host  of  students  that  are  being  left 
out. 

Mrs.  Pines.  I  would  agree  with  you.  Congressman  Miller,  and 
that's  the  reason  tha^  I  chose  to  come  today  on  my  own  because  I 
felt  that  this  was  a  very  important  issue. 

There  are  many  students  who  are  unable  to  perform  well  on  a 
standardized  test.  However,  the  Federal  Trade  Commission  merely 
pointed  out  the  evidence  so  that  the  educators  and  the  Department 
of  Education  and  the  Congress  too,  could  deal  with  this  particular 
subject.  The  Federal  Trade  Commission  and  certainly  myself  are 
not  educational  experts  and  we  did  not  put  ourselves  forward  as 
educational  experts,  however  based  upon  the  information  that  we 
have,  we  believe  that  these  are  important  educational  issues  that 
need  to  be  dealt  with  and  we  hope  that  by  putting  forth  this  report 
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we  would  encourage  the  ^ucational  people  to  consider  this  issue 
carefully. 

Mr.  Miller.  Well,  I  wish  they  would  and  I  think  to  some  extent , 
the  committee  may  be  misled  in  that  we  have  had  testimony  from> 
certain  law  schools  and  medical  schools  and  certam  universities 
suggesting  that  what  they  really  do  is  to  look  at  the  whole  person 
and  make  these  individualized  determinations. 

I  suspect  that  for  the  vast  majority  of  students  who  apply  to  col- 
leges and  universities  that  ,  is  not  the  case.  Andrthat  in  fact  there  "is 
a  formula  worked  out  and  you  c^n  engage  in  special  pleading  if 
you  don't  get  In.  and  try  to  present  your  cate.  t.    ,  ^  n 

I  think  we're  being  misled  when  universities-and  law-schoois-tell 
us  that  that's  in  fact  what  they  really  do,  I  just/ don't  believe  that's 
true  for  the  overwhelming  number.  It  sounds  good  and  it  kind  of 
makes  the  issue  go  away  because  nobody  is  ref^lly  being  harmed." 
ButJ  don't  think  that's  so  in  your  evidence-tKat  you-presente^^ 
of  the  University  of  California  undergraduate,apphcatioiL.packet  of 
'  1981-82  or  the  others  suggest  that  that  is  not  the  case. 

Mrs.  Pines.  That's  is  why  we  felt  that  it  was^important. 

Mr  Miller.  L  don't  know  how  many  thousands  of  students  apply 
to  the  University  of  California  system  each  year  as  freshman,  but 
I'd  be  very  surprised  if  each  one  of  them  got  a  little  interview  here 
to  detetmine  whether  they  really  had  inner  qualities  that  would 
get  them  2.79  to  3.01.  I  Just  don't  believe  that  that  happens  and 
therefore,  I  think  you  have  what  appears  as  a  djscriminatory  test. 
Where  the  discrimination  can  possibly  be  overcome  by  the  expendi- 
ture of  money,  at  that  point  I  think  we'v|^got  a  {wlicy  problem  that 
we've  got  to  cope  with. 

I  don't  know  if  our  testing  bill  is  the  ri^ht  answer  or  the  wrong 
answer,  but  I  think  we've  got  a  problem  here  that  suggests  that  the 
students  are  being  excluded  or  potentially  being  excluded  for  that 
reason. 

Mr  Weiss.  Will  the  gentleman  yield  on  that? 

Mr.  Miller.  Yes,  I'd  be  delighted  to  yield,  I  just  want  to  thank 
you  very  much  for  your  testimonv  and  your  statements. 

Mrs.  Pines.  Congressman  Miller,  I  appreciate  your  comments 
very  much.  I  too  have  a  youngster  who  is  now  a  senior  in  high 
school  and  waiting  for  the  decision  from  the  cplleges  to  which  he 
has  submitted  an  application.  And  I  share  your  concern  as  a  parent 
who  had  gone  through  this  process  and  you'll  have  another  year  to 
cogitate  on  it.  ,  ,  . 

I'd  also  say  that  I  had  the  opportunity  to  appear  before  you  sev- 
eral years  ago  with  regard  to  the  asbestos  issue  and  very  much  ap- 
preciated the  leadership  thjyLyou  and  Coiigressman  Perkins  pro- 
vided in  that  area.  ^    ,  ^      , ,  , 

Mr  Miller.  Thank  you  for  your  nice  comments,  but  you  d  love 
to  see  what  EPA  has  done  to  that  one.  Don't  go  into  those  old 
schools  right  at  the  moment. 

Mrs.  Pines.  Well,  I'm  happy  to  say  in  Masachusetts  where  I  was 
a  State  legislator  at  the  time  and  the  chairman  on  the  Conimission 
on  Asbestos  that  we  have  done  a  great  deal  and  we've  analyzed  all 
of  our  schools  and  we've  made  those  changes  where  needed  and  we 
continue  to  monitor  those  schools  that  have  potential  problems  for 
the  future. 
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Mr.  MiiXER.  God  bliess  you. 

Mr  Weiss,  Yes,  I  thank  you  for  yieldihg,  Just  on  the  question  of 
coaching  and  what  the  benefits  of  this  legislation  is  to  those  who 
otherwise  Vould  not  be  able  to  afford,  even  if  they  were  aware  of 
the  fact  that  coaching  was  available  or  that  it  could  be  helpful. 

We  had  testimony  at  our  hearings  in  July  from  a  young  man 
who  i?  the  executive  director  of  a  college  and  career  counseling 
program  in  EastLHarlem,  New  York  Gity  and  what  he  pointed  out 
was  that  because  of  the  disclosure  provisions  of  the  New  York 
State  law,  he  is  now  able  to  compete  very  effectively  with  Mr. 
Kaplan  for  example,  that— without  having  the  kids  subjected  to  the 
fees,,  which  they  could  not  otherwise  afford;  even  though  Mr. 
Kaplan's  program  provides  scholarships,  he  canft  cover  everybody, 

And  so  indeed  the  disclosure  provision  provide;  an  opportunity  for 
.kids  who  otherwise  would  not  have  had  the  opportunity  for  coach- 
ing and  could  not  compete  on  an  equal  level. 

Mr.  Miller.  WqII  that's  wery  helpful.  I  guess  many  of  u^  in  poli- 
tics draw  on  our  own  experiences.  I  remember  when  I  was  graduat- 
ing from  college  and  took  the  LSAT.  My  scores  really  stunk  so  I 
took  them  a  second  time  on  the  theory  that  you  could  improve 
.them.  They  went  down  and  my  father  begged  me,  don't  take  it  any- 
more, he  saidi  or  I  won't  be  able  to  help  you.  So  he  helped  me  and  I 
got  a  special  interview  with  the  dean  of  the  law  school.  My  father 
was  chairman  of  the  Senate  Finance  Committee,  they  needed  a 
building  and  I  got  into  law  school  I  did  very  well  in  law  school,  but 
I  would  have  been  excluded  based  upon  that  test.  I  didn't  know 
there  was  coaching,  I  don't  know  if  coaching  would  have  helped, 
but  there  was  a  lot  of  suggesting  that  coaching  wouldn't  even  have 
helped.  \ 

Later  when  I  graduated  from  law  school,  thA-e  came  the  State 
bar  exam.  I  signed  up  with  one  of  these  bar  review  courses  with  a 
fellow  who  nobody  had  ever  heard  of  but  gave  guaranteed  results 
and  it  worked.  I  passed  the  bar  on  the  first  time,  And  I  suspect 
,  that  the  manner  in  which  this  fellow  approached  it  for  the  b^r 
would  be  considered  outrageous  bv  those  people  that  gave  the  bar, 
by  those  people  who  now  practice  law  ,  ^  ,  ,  t 

I'm  very  concerned  that  people  still  could  be  precluded  because  1 
.still  have  friends  that  have  taken  the  bar  14  times  and  still  trvmg 
to,  iump  the  hurdle  that  is  precluding  them  from  practice,  from 
professonal  life,  from  entering  professional  school  and  how  even 
being  precluded  from  entering  college  and  universities.  And  I  m 
very  disturbed  about  that  system. 

Vm  not  suggesting  that  we're  going  to  develop  a  system  that 
treats  everyone  as  equals  because  clearly  that's  not  going  to  be  the 
case.  But  I  think  weVe  got  to  ask  ourselves  when  a  single  event  in 
a  person's  life  can  change  the  course  of  that  individual  s  like,  you  d 
like  to  know  at  least  that  you  give  him  the  best  shot  you  could. 
Whether  that's  providing  Federal  scholarships  to  Mr.  Kaplans 
school,  I  don't  know.  But  you'd  like  to  believe  that  they  all  started 
out  with  the  same  shot. 

Thank  you.  ^  . 

Mr.  Weiss.  Thank  you,  Mr.  Miller  Mr.  Petri,  ^  .  . 

-  Mrs.  Pines.  Could  I— excuse  me— could  I  just  respond  to  the  inti- 
tial  question. 
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Mr.  Weiss';  You  still  remember  it?  | 
Mr.  Miller.  This  is  a  test.  ,  i  .       ,  i  «_  , 

Mrs  Pines  I'd  like  to  underline  what  youve  indicated,  JVlr. 
Chairman,  with  regard  to  the  importance  of  the  legislaUon  m  it  re- 
lates to  coaching  because  the  legislation  m  section  ^  specifically  r^ 
quires  thkt  the  statistical  data  be  made  available  and  the  analysis 
Se  made^yailable  and  thus  there'd  be  an  opportunity  to  better  un- 
derstand oV  at  least  have  our  educators  l?etter  understand;  statisti- 
cians bettei-  able  to  make  judgments  with  regard  |toj^hat  kind  of 
cpaching  .dries  help.  And  that  information  is  not  presently  availa- 

^'so  I  belie)e  the  bill  is  important  in  that  UEEOgi^hat-dis^ 
sure  and  independent^researchers^ould-h-aveThat  andi  analysis 
^oliid  be  ableTtobe  made  which  presently  cannot  be  made  l«cause 
the  information  is  not  available  from  the  Educational  Testing  Serv- 

iC6  •  ,  '  .  ' 

Mr.  Weiss.  Mr.  Petri.  r    .  ,  •  1.1. 

Mr  PirrRi  Thank  you,  I'd  like  to  thank  you  for  itaking  the  time 
to  come  and  offer  testimony  here  today.  I'm  sittin^g  here  istening 
•to  all  this  trying,  to  figure  out  whether  there  is  a  clear  lipe  betwf  n 
coaching  and  education?  I  mean  we  know  that  seniors  do  better 
than  firat  graders  and  you  could  say  that  they've  been  coached  for 
12  Jears  and  then  take  the  test.  Kids  go  to  sumiper  schools  hat 
are  oriented  more  towards  the  exams— is  that  .something  that 

^^rwti^^tVSSrin  the  Midwest  where  only  three  of  us  in  my 
class  even  heard  of  or  even  took  the  educational;  tests  and  then 
there  are  kids  going  ^  extra  schools  and  such  who  se®"^  ^o 'goyear 
after  year  through  educational  courses  oriented  toward  that  bome- 
how  I  suppose  you  could  say  that  those  of  us  from  other  parts  of 
the  country  are  at  a  disadvantage  if  we're  not  oriented  in  that  way, 

but  is  that  really  true?  ,  .     .      j  i  u  *  ^i,„o+;«„ 

Is  there  some  clear  idea  of  what  coaching  is  and  ;what  education 
is  and  how  you  separate  one  from  the  other?  ,       ^,   ,  , 

Mrs  Pmk  Well,  I  think  that's  really  a  major  issue  that  we  re 
dealing  with.  Coaching  at  the  present  time  is  available  to  very  few 
yoSters  nationwldl,  and  it  appears  that  those  youngsters  that 
have  had  access  to  coaching  have  benefited  from  it  or  many  ot 
themhavebenefitedfrom.it.  yj 

And  it  appears  that  some  kind  of  coaching  or  d"ll  maynot  b^^of 
help  and  in  fact,  in  the  analysis  done  original  y  by  the  ^9'^ff£- 
were  tv/o  coach  ng  programs  that  were  studied.  One  which 'was 
helpful  and  orie  wlich  was  not  helpful.  Sp  the  issues  really  Wome, 
what  kind  of  coaching  is  helpful  and  to  whom  is  it  available.  And 
are  you  precluded  from  access  to  that_coaching  because  o^your 
income  or  your  rates,  the  way  you  live,  geographic  location^ 

And  those  are  the  issues  that  I  personally  belieye  need  t9  be 
raised  and.  that's  the  reason  the  report  was  published  andjthe 
o  reason  that  1  felt  that  it  was  important  to  come  here  to  discuss  it. 

Mr  Petri.  And  so  what  we're  trying  to  do  is  to  address  oursejlves 
to  someone  who  attempts  to  help  a  Student  get  a  better  score  ^part 
and  aside  from  whatever  school  or  whatever  other  thing  they  hap- 
pened to-be  engaged  in  and  the_person  does  that  for  money,  is  that 
the'idea?  . 
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Mrs.  PiNis.  Well,  the  issue  is  really  what  kind  of  coaching  or 
education  is.available  to  students  generally.  Some  public  schools  as 
well  as  private  schools  provide  a  coachihg  program  as  part  of  their 
academic  curriculum  in  some  parts  of  the  country. 

But  agai)i,  on  a  limited  basis. 

Mr.  Petri.  But.should  we  regtilate  that?  What  are  we  trying  to 
getat^hece? 
Mrs.  Pines.  What  Tm  tnring  to  do  is  

Mr.  WEiss.  Gentleman,  if  you  will  yield.  Perhaps  I  can  place  into 
context  what  we're  *d6ing  here  today.  We've  had  a  series  of  hear- 
iMs  starting  in  I  think  July  of  1979,  on  the  issue  of  the  truth— so. 
called  truth  in  testing  legislation.  And  we  touched  on  various  as- 
pects of  the  field  and  various  aspects  of  the  legislation. 

One  of  the  issues  that  has  cropped  up  and  which  is  in-  fact 
touched^  on  the  legislation  as  far  as  disclosure  is  concerned  is  on 
the  effect  of  coaching  on  the  taking  of  various  tests,  disclosing  th^t 
information.  '  . 

We  have  not  had  a  session  that  was  devoted^  specifically  to  the 
coaching  issue  although  from_time--to^time  in  soihe  of  the  panels 
we've  hacLsome  expiration  of  the  issue  and  so  what  we  did  for 
- — today  is  to  put  together  a  forum  for  exploring  that  issue  and  that's 
what  we're  doing  today.  We're  trjdng  to  cover  various  aspects  and 
indeed  we'll  have  some  experts  testifying  in  addition  to  Mrs.  Pines,, 
\        who  will  be  touching  on  different  aspects  of  the  issue. 
\  Thank  you,  Mr.  Petri,  Mr.  Kildee. 

Mr.  KiLDEic!  I  have  no  questions,  Mr.  Chairman. 

Mr.  Weiss.  Mr.  Erdahl. 

Mr.  Erdahl.  Thank  you  very  much,  Mr.  Chairman,  maybe  I 
should  plead  a  bit  guilty,  becaoise  we  got  off  on  to— maybe  thev  re 
,  not  tangents  but  a  little  different  area  about  the  report  itself.  I 
think,  Mr.  Chairman,  you  properly  zeroed  in  on  the  focus  of  today's 
hearing  which  is  the  consideration  of  the  impact  of  this  coaching 
oih  the  testing  and  I  would  share  that  concern.  I'm  not  sure  if  your 
bill  addresses  it,  but  it  seems  to  me  that  we  have  to  be  concerned 
that  if  specific  coaching  is  available  to  students  that  might  have 
the  money  to  pay  for  it. or  might  live  in  an  area  where  its  availa- 
ble, then  we  have  questions,  rfow  do  we  address  that?  Should  that 
be  part  of  the  high  school  curriculum,  should  it  be  something  inan- 
dated  by  the  Congress,  which  we've  kind  of  shied  away  from  doing? 
Should  i)t  be  subsidized  in  some  way?  I  think  it  raises  some  very 
serious  question.  '  \  ~ 

Mr.  Chairman,  I'm  not  sure  

Mr.  Weiss.  If  you'll  yield  just  on  that  one  point. 

Mr.  ErdAhl.  Of  course  I  yield! 

Mr.  Weiss^  Again,  at  pagp  4. of  the  legislation  under  section  3, 
sub  4,  sub  C,\  the  requirement  is  for  statement— disclosure  on  the 
registration  form  of  statements! concerning  the  effects  on  and  uses 
of  test  scores  including  C,  the  extent  to  which  test  preparation 
coursj^  improve  test  subject  scores  on  average  expressed  as  a  per- 
I  centage. 

And  again,  all  that  this  legislation  does  is  to  seek  disclosure,  we 
are  not,regulating\anything; 
Mr.  Erdahl.  Tha^ik  ^ou  very  much.  I  understend  that  but  it  does 
*    raise  a  broader  question  if  we  find  that  in  fact  your  bill  if  it's 
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paaied  would  come  up  with  that  conclusion.  As  Mr.<^iller  said, 
ma^be  as  members  of  the  Congress  we  can  afford  to  send  our  sons 
and  daughters  to  a  coaching  school  maybe  other  people  can  t.  1 
think  that  your^: — 
■■/  Mr.  Wmss.  Next  bUl.     .  • 

Mr.  E«DAHL.  Next  bill.  OK. 

Mr.  Wkiss.  Not  this  one. 

Mr.  Erdahl.  ok.  ^  i.     *  t 

But  then,  Mr.  Chairman,  I  would  ask  this  as  a  requ^t  that  I  re. 
ceived  from  our  colleague,  Bill  Goodling,  who  couldn  t  be  here 
today  that  came  through  staff  just  a  few  minutes  ago.  We  have  had 
what  could  be  described  as  some  rather  strong  charges  against  is  l-b 
for  maybe  their  failure  to  disclose  and  so  forth.  I  understand  we 
have  a  person- in  the  audience  who  I  have  not  met,  ^Mesic  I  be- 
lieve it!s  pronounced;  I  .think  that  he  is  regarded  as  ETSb  coaching 
expert  ahd  I  was  wdhdering  if  it  would  be  proper  at  this  time  or 
something  during  the  course  of  this  hearing  to  see  if  he  has  any 
response  to  any  questions.  ,.  ,  jj^ 

I  see  from  the  witness  ligt  that  this  individual  is  not  included  on 
your  formal  list,  Mr.  Chairman.  ,^  . ,    .  „  *  <•  •* 

Mr  Wiiss.  I  think  that  ETS  will  probably  tell  ^ou  that  if  it 
wasn't  for  the  honor,  tliey'd  jus*  as  soon  walk.  They  have  been 
riven  perhaps  more  of  an  opportunity  to  participate  in  the  series  of 
hearings  than  they  would  have  liked  if  they  had  the  chaiice  to 
make  the  determination.  ■  / 

Obviously  if  the  time  permits  and  we  ve  <gone  through  the  wit- 
nesses whom  we  specifically  invited,  we'd^pleased  to  put  them 
on.  We  had,  as  you  know,  the  president  of  ETS  testifying  yesterday. 

Mr.  Erdahl.  Yes,  I  was  here.  .  •  ,  ,  ,^  ,  r 

Mr  Wisiss.  On  some  of  those  issues,  but  I  do  have  people  trom 
the  National  Academy  of  Sciences  w'lo  have  been  invited  to  come 
down  and  I  want  to  put  them  on  next.  I'd  like  to  put  Mr.  Kaplan 
on  and  then  if  after  that  we  still  have  time  and  the  mertibers  want 
to  hear  additional,  witnesses,  I  would  be  pleased  to  be  as  accommo- 
dating as  you  want.  ,        ^  .         x  tu '  i  *u_*'» 

Mr  Ekdahl.  Thank  you  very  much,  Mr.  Chairman,  l  tninK  mat  s 
most  reasonable  and  again,  ma'am,  thank  you  very  much  for  being 
with  us  today;        1  ' 

Mr.  Wnss.  Mr.  DelNardis.  L  o*  u 

Mr  DeNardis.  Following  up  on  your  review  of  section  dA,  sub- 
section 4,  and  subsection  C,  which  deals  with  the  prbvision  on 
coaching.  I  guess  I  want  to  clarify  with  you  first,  that  this  nas  to  do 
with  the  test  agency.  Thfe  test  agency  shall  provide  this  informa- 
tion and  make  statements  concerning  the  use  of  test  scores,  but 
wouldn't  that,  Mr.  Chairman,  be  dependent  upon  the  private  coach- 
iri^'agency  providing  that  information  to  the  test  agency?. 

Mn  Wnss.  Again;  if  the  gentleman  would  yield.  Part  of  the  prob- 
lem that  we've  had  and  I  think  that  we've  developed'  it  so  that 
we've  almost  come  to  a  meeting  of  the  minds  «•  that  there  had 
been  inforination  gathered  by  various  researchers  including  ETS 
and  its  researchers  as  to  what  the  impact  of  various  kinds  ot  pre-  • 
,  paratory  courses  would  be.  .     \  •  ^  i^t 

However,  in  submitting  the  information  to  the  re^tr*t,  even- 
tual iort  taker,. the.  impression  until  we  started  in^his  wKole  proc- 
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ess,  indeed  up  to  a  year  or  a  year  and  a  half  ago  that  ETS  created 
was  and  quite  liberally  was  that  coaching  was  in  essence  a  future 
effort  and  we  had  a  panel  about  a  year  and  a  half  ago  in  which  we 
explored  the  extent  to  which  some  of  their  own  research  had  not 
been  disclosed  and  so  what  we're  really  asking  is  that  if  you've  got 
the  information  as  to  whaj;  the  impact  is,  for  crying  out  loud,  don't 
con  people  into  not  taking  preparatory  courses  or  coaching  courses 
when  in  fact  you've  got  a  test  which  may  determine  what  you're 
going  to  te^oing  foe  the  rest  of  your  life. 

And  I  think  that  on  the  basis  of  the  exchange  that  we  had  yes- 
terday  and  even  before  that  with  ETS,  I  think  we've  fairly  well 
,eome  along  at  this  point  where  they  recognize  what  they  were  talk- 
ing about  was  short  term  less  than  4  hour  drills.  What  everybody 
else  is  talking  about  were  in.  fact  courses  which  Tan  20,  40  hours  or 
longer.  And  everybody  agrees  now  that  if  you  take  the  longer 
courses-,  yes,  you're  going  to  improve  your  scores.  There  may  still 
be  a  difference  as  to  exactly^  what  the  average  may  be  but  we're 
coming  pretty  close  to  that.  \ 

And  all  that,  we're  asking  is  the  disclosure  not  from  the  coaching 
schools,  but  from  the  objective  researchers  as  to  what  the  im{)act  of 
those  courses.are.  '  i 

Let  the— let  the  test  takers  make  th'eir"bwn  judgment  ^  to 
whether  they  want  to  take  coaching  courses  or  not.  I  don't,  want;  to 
force  them*  That -information  ought  to  be  disclosed  honestly  and  <^b* 
jectively. 

Mr.  DeNArdis:  As  I  recall  from  my  son's  packet  last  year  as  he 
•  prepared  to  take  the  test,  isn't  there  a  reference  made  to  that  in 
the  packet  that  is  distributed^ 

Mr.  Weiss.  We're  getting  there,  yes.  If  you  were  to  check  the 
stuff  they  had- 2  or  3  years  ago. 
Mr.  DeNardis.  Well,  I  think.  Congressman  Weiss,  you  have  donev 
.  the  whole  field  of  testing  a  great  service.  I  really  mean  that.  I 
think  this  bill— the  mere  existence  of  this  bill/has  had  a  salutory 
,  effect  on  the  whole  testing  field*  <? 

I.  think  the  question  before  the  committee  is  should  we  e^ctually 
enact  it  intp  -law.  ^ 

•Mr.  Weiss.  You  want  to  stop  me  on  the  1-yard  line.  Is  that  what 
you're  saying? 

Mr.  DeNardis.  Well,  very  often  the  threat  of  legislation  brings 
about  reform  without  its  actual  enactment. 

Mr.  Weiss.  Right.  Thank  you. 

Mr.  DeNardis.  I  have  no  further  questions. 

Mr.  Weiss.  Mrs,  I^ines,  thank  you  very,  very  much,  we  appreciate 
yoifr  perseverance*  and  you're  taking  your  own  tinie  to  come  hefe 
and  testify. 

"  Our  .next  witnesses  are  David  A.  Goslin,  executive  director,  as- 
sembly of^behavioral-and  social  sciences.  National  Academy  of  Sci^ 
ences  and  Alexandra  Wigdor,  study  director,  committee  on  ability 
testing.  National  Academy  of  Sciences.  . 
I  welcome  you  both  and  appreciate  your  patience  in  standing  by. 
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SfTATEMEN^  OF  DAVID  A.  GOSLIN,, 


EXECUTiyE  DIRECTOR,  AS- 


Mr.  G06UN.  Thank  you,  Mr.  Chairman,  it's  a  pleasure  to  be 
My  name  is  David  Goslin,  I'm  the  Ejijecutive  Diresctor  of  t^e  A 


SEMBLY  OF  BEHAVIORAL  AND.  SOCIAL  SCIENCES,  NATIONAL 
RESEARCH  COUNCIL,  NATIONAI^  ACADEMY  OF  SCIENCES, 
WASHINGTO'N,Np.C.  j 

be  here. 

bly  of  Behavioral  and  Social  Scienc^es,  which  is  one  of  the  eight 
major  divisions  of  the  National  Research  Council,  the  principal  op- 
erating arm  of  the  National  Academj^  of  Engineering, 

In  accordance  with  the  Academy's  .Congressional  Charter  enacted 
in  1863,  the  Assembly  responds  to  requests  from  executive  branch 
agencies  and  from  the  Congress  for  ajdvice  on. specific  scientific  and 
technical  questions  involving  behavioral  and  social  sciences  and  on 
occasion  takes  the  initLafe^n^pxoiosjng-.^^^^  topics  of  na- 

tional concern.  !  J. 

Currently,  the  Assembly  is  repoftsible  for  supervising  the  act^i- 
ties  for  30  major  committees  and  pahels,  involving  over  500  distin- 
guished behavioral  and  social  scientists  and  other  experts,  andjad- 
dressing  a  wide  rang§^of.significant  topics  including  national  statis- 
tical programs,  child^  developitnent  rbsearch  and  public  policy,  /law 
enforcement  and  the  administratiori  df  justice,  population  an^\de- 
mography,  basip  research  in  the  l^hayioral  and  social  sciences, 
human  factors,  vision  and  hearing,  substance  abuse,  and  aging.  As 
you  know,  members  of  Academy  coirimittees  serve  without  compen- 
sation othe'^than  travel  and  other  necessary. expenses.  /  ' 

The  Assembly's  Committee  on  y^.bilify  Testing  was  forined  in 
1978  to  undertake  a  broad  examine  tion  of  the  uses  and  pptential 
•  abuses  of  standardized  ability  tests[  in  American  society.  Supiwrt 
for^the  committee's  work. was  provided  by  the  Carnegie  Corpora- 
tion of  New  York,  the  National  Insljitute  of  Education,  the /Nation- 
al Institute  of  Mental  Health,  the  Office  of  Personnel  Management 

and  the  Ittleson  ^Foundation.  *  j  

Given  it's  broad  mandate,  a  special  effort  was  made  at  the  outset 
to  appoint  as  members  of  the  committee  a  diverse  group  of  out- 
standing scientists  and  other  expeiits,  a  msyority  of  who[  had  not 
been  involved  in  the  existing  controversies  about  tests. 

Mr.  Weiss.  We  do  have  a  live  quarium  at  this  point,  I'm  going  to 
remain  and  will  continue  the  hearing  but  anybody  who  wants  to 
go,  we'll  be  here  when  you  get  back. 

Mr.  Goslin.  The  chairman  of  the  Committee  on  Ability  o'esting. 
Professor  Wendell  Garner,  is  a  distinguished  experimental  psychol- 
ogist, a  member  of  the  National  Academy  of  Sciences  andUormer 
dean  of  the  graduate  school  at  Yale  University.  His  schedule,  un- 
fortunately, did  not  permit  him  to  b^  present  this  morning.  V 
Among  other  members  of  the  cobimittee  are  Burke  Marchall, 
^  former  &)licitor  General  of  the  Unit^  States  and  now  profeskor  of 
,  law  at  Yale  University,  Philip  Kurland,  distinguia^hed  professor  of 
^constitutional;  l^w  at  the  University] of  Chicago,  John  Tukey,'u)ro- 
ifessor  of  statistics  at  Princeton  that  many  thinkJs  the ^most  distin- 
guished -statistician  in  the  United  States,  Sociologist  William 
Sewell  of  .the  University  of  Wisconsin  and  chairman  of  the  recent 
National* Ck)mmission  on  Research,  Marcus  Alexis,  former  Commis- 
sioner of  the!  Interstate  Commerce!  Commission  and  Historif 


Oscar  Handlin.  Two^tinguished  psychometricians,  Leb  Cronback 
of  Stanford  University  land  Mel  Novick  of  the  University  of  Iowa 
also  served  on  the  comnuttee.  A  complete  list  of  commiJ;tee  mem- 
fers  will  be  submitted  as  part  of  Alexadra  Wigdor's  subsequent  tes- 
timony. ^  \ 

The  committee  has  completed  its  report,  which  is  now  ^undergo- 
ing final  editing  prior  to  formal  riblication  by  the  National  Acade- 
myPress.  In  light  of  the  report's  significance  and  the  cpipplexity  of 
the  issues  it  addresses,  the  full  report  will  be  released  to  the  public 
on  February  2,  1982  at  a  day-long  symposium  sponsored  by 'the  Na- 
tional Academy  of  Sciences.  I  and  the  Academy's  new  President, 
Dr.  Frank  Press,  hope  that  you  and/or  members  of  the  committee 
staff  will  be  able  to  attend.  We  will  be  in  touch  with  your  commit- 
tee staff  regarding  specific  plans  for  this  event. 
Mr.  Weiss.  I  thank  you  for  the  invitation. 

Alexandra  Wigdor,  study  director  for  the  committee  is  with  me 
this  morning  to  offer  substantive  tstimony  on  behalf  of  the  commit- 
tee. She's  a  legal  historian,  trained  at  the  University  of  Maryland 
and  has  directed  staff  work  for  the  committee  during  the  last  Wz 
years.  ;  "  ' 

Finally,  let  me  add  a  word  of  personal  perspective  on  this  project 
and  on  the  legislation  being  considered  by  the  subcommittee.  For 
the, first  half  dozen  years  of  my  career  as  a  sociologist,  from  1961  to 
196A  I  realize  that's  7  instead  of  6,  I  participated  in  the  series  of 
studies  j^onducted  by  the  Russell  Sage  Foundation  on  the  social 
consequences  of  standardized  testing.  In  addition  to  authoring  two 
of  the  several  volumes  that  resulted  from  this  work,  I  was  responsi- 
bile  for  preparing  the  foundation  s  report,  "Guidelines  for  the  Col- 
lection, Maintenance  and  Dissemination  of  Pupil  Records,"  which: 
subsequently  served  as  a  basis  for  what  is  now  known  as  the  Buck- 
ley amendment.  It  was  clear  to  us  at  the  foundation  in  the  early 
1960's  that  the  problems  associated  with  the  widespread  use  of 
standardized  tests  in  our  society  transcended  the  many  technical 
issues  of  validity  and  test  bias  that  were  being  argued  then  and  the 
have  been  so  hotly  debated  in  the  intervening  years.  At  the  heart 
of  the  controversy  that  has  surftmnded  testing  are  the  central 
questions  'pf  what  qualities,  talents,  and  skills  the  society  values 
most  and  'Jiow  best  to  nurture  them.  As  John  Gardner  put  it  in 
1958,  "thelgreatness  of  a  nation  may  be  manifested  in  many  v/ays 
in  its  purpose,  its  courage,  its  moral  responsibility,  its  cultural  and 
scientific  eminence,  the  tenor  of  its  dailv  life.  But  ultimately  the 
source-ofJts.greatnessJs  in  the  individual  who  constitute  the  living 
substahce  of  the  Nation.**  If  this  is  true;  then  the  means  that  are 
used  to  differentiate  one  individual  from  another  and  to  reward 
those  attributes  most  highly  valued  will  determine  not  only  the  for- 
tunes of  individuals,  but  also  that  of  the  society.  It  is  my  hope  and 
expectation  that  the  Academy*s  forthcoming  report  will  make  a  sijj- 
nificant  contribution  to  what^will  and  should  be  a  continuing  na- 
X  tional  debate  on  these  issues. 

I     With  your  permission,  Mn  Chairman,  I  should  now  like  to  mtro- 
,  duce  Alexandra  Wigdor,  Study  Director  of  the  Committee  on  Abili- 
.ty  Testing.  Following  her  statement,  we  are  prepared  to  respond  to 
/questions  that  members  of  the  subcommittee  may  have. 
Thank  you. 

[The  prepared  statement  of  David  Goslin  follows:] 

;tr  .  838 


834 

P«iFAMD  Statiiient  Of  David  A.  GoeLiN.  Executive  Diwctoe,  AasEMBLY  or  Be- 

HAVIOKAL  AND  SOCIAL  SCIENCES.  NATIONAL  .HkeARCH  CoUNCIL,  NATIONAL  ACADE- 
MY or  SCIENCE!,  Washington,  D.C. 

I  «a  D«viu  Goilin,  Executive  Director  of  the  Aiiembly  of  Behavioral 
and  Social  Sciencea,  one^of  eight  wajoi^  .dilifions  of  the  National  Re- 
•carch  Council,  the  principal  operating  >agency  of  the  National  Academy  of 
Science! .    In  accordance  with  the  Academy '•  Congreiiional  Charter,  en- 
acted in  1863,  the  Assembly  responds  to  requeiti  from  executive  branch 
agenciei  and  the  Congreis  for  advice  on  specific  scientific  and  technical 
queations  involving  the  behavioral  and  social  sciences  and,  on  occasion, 
takes  the  initiative  in  proposing  studiea  on  topica  of  national  concern* 
Currently,  the  Assembly  is  responaible  for  supervising  the  activities  of 
approximately  30  major  committeea  and  panels,  involving  over  500  distin- 
guished behavioral  and  aocial  scientists  and  other  experts,  and  address- 
ing a  wide  range  of  aignificant  topics  including  national  statiatical 
programs,  child  development  research  and  public  policy,  law  enforcement 
and  the  administration  of  justice,  population  and  demography,  basic  re- 
search in  the  behavioral  and  social  sciences,  human  factors,  viaion  and 
hearing,  substance  abuse,  and  aging*    As  you  know,  membera  of  Academy 
coimnittees  serve  without  compensation,  other  than  travel  and  other  neces- 
sary' expenses; 
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The  Assembly's  Coannittee  on  Ability  Testing  was  formed  in  19?0,  to 
undertaKe  a  broad  examination  of ^ the  uses  and  potential  abuses -of  stan- 
dardized ability  tests  in  American  society.    Support  for  the  Committee's 
work  was  provided  by  the  Carnegie  Corporation  of  Kev  York,  the  National 
Institute  of  Education,  the  National  Institute  of  Mental  Health,  the 
Office  of  Personnel  HanagernenL^  and  the  Ittleson  Foundation. 

Given  its  broad  mandate:,  a  special  effort  was  made  at  the  outset  to 
appoint  as  members  of  the  Committer  a  diverse  group  of  outstanding  sci- 
entists and  other  experts^  a  majority  of  whom  had  not  been  involved  in 
existing  cr^ntroversies  about  tests*    The  Chairman  of  the  Committee,  Pro- 
fessor Wendell  Garner,  is  a  distinguished  experimental  psychologist,  a  " 
membeT  of  the  National  Academy  of  Sciences,  and  former  Dean  of  the  Grad- 
uate School  at  Yale  University.    (His  schedule,  unfortunately,  did  not 
permit  him  to  be  present  this  morning. 3    Other  members  of  the  Committee^ 
include;    Burke  Maishall,  former  Solicitor  General  of  the  U*S.  and  now 
Professor  of  Law.  at  Yale  University;  Philip  Kurland,  Professor  of  Consti- 
tutional Law  at  the  University  of  Chicago;  John  l^ikey.  Professor  oi  Sta- 
tistics at  Princeton  IMiversity;  Sociologist  William-Sewell  of  the  Uni- 
versity of  Wisconsin  and  Chairman  of  the  recent  National  Commission  on 
Research;  Harcus  Alexis,  former  Commissioner  of  the  Interstate  Commerce 
Commission;  and  h istorian 'Oscar  Handlin*    Two  distinguished  psychome- 
tricians,  Lee  Cronbach  of  Stanford  University  and  Melvin  Novick,  Univer- 
sity of  Iowa  also  served  on  the  Committee.    A  complete  list  of  Committee 
.members  will  be  submitted  as  part  of  Alexandra  WigdorU  subsequent  tes- 
tinony» 

The  Committee  has  completed  its  report,  which  is  now  undergoing 
final  editing  prior  to  its  formal  publication  by  the  National  Academy 
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Preaf«    In  light  of  the  report's  liinificance  and  the  complexity  of  the 
iffuef  ifc  adciresiei,  the  full  report  will  be  released  to  the  public  on 
February  2nd, -1982,  at  a  day-long  symposium  sponsored  by  the  National 
Acadcny  of  Sciences.    I  and  the  Academy'a  new  President,  Dr.  Frank  Press, 
hope-t^wiryou  and/or  members  of  the  Committee  staff  will  be  able  to 
attend.    (We  will  be  in  touch  with  your  staff  regarding  specific  plans 
for  this  important  eve^t.)  ^ 

Alexandra  Wigdor,  Study  Director  for  the  Committee,  is  with  me  this 
morning  to  offer  substantjLve  tes timpny  on.,behalf  of  the  ^Committee .  Sandy 
is  «  legal  historian,  trained  at  the  University  of  Maryland,  and  «he  has 
directed  staff  work  for  the  Committee  during  the  last  year  and  «  half. 

Finally,  let  me  add  a  word  of  personal  perspective  on  thia  project 
and  on  the  legislation  being  considered  by  this  subcommittee.    For  the 
first  half  dozen  years  of  my  career  as  «  aociologiat,  from  1961  to  1968  I 
participated  in  the  series  of  atudie^s  conducted  by  the  Russell  Sage  Foun- 
dation on  the  social  consequences  of  standardized  testing.    In  addition 
to  authoring  two  of  the  aeveral  volumca  that  resulted  from  this  work,  I 
was  responsible  for  preparing  the  Fpundation'a  report;    Cuidelinea  for 
the  Collection,  Maintenance,  and  Dissemination  of  Pupil  Records,  which 
subsequently  served  as  a  basis  for  what  is  now  known  as  the, Buckley 
Amendment.    It  was  clear  to  us  «t  the  Foundation  in  th«  early  1960's  that 
the  problems  aasociated  with  the  wideapread  uae  oi  standardized  tests  in 
our  society  tronscended  f'.i:  Iwny  technical  issues  of  validity  and  teat 
bias  that  were  being  argued  then  and  that  have  been  so  hotly  debated  in 
the  intervening  years.    At  the  heart  of  the  controversy  that  haa  sur- 
rounded testing  are  the  central  questions  of  what  qualitiea,  talents,  and 
skilla  the  society  values  most  and  how  best  to  nurture  them.    As  John 
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.Gardner  put  it  in  1958,  "the  (reatnett  of  a  nation  may  be  manifeated  in 
many  w^ya  in  ita  purposea,  ita  courage,  ita  moral  reaponaibility,  ita 
cultural  and  acientific  emminence,  the  tenor  of  ita  daily  life.  But 
\       ultimately  the  aource  of  ita  greatneas  i«  in  the  individuala  who  conati- 
tute  the  living,  aubatance  of'the  nation."*    If  thia  ia  true,  then  the 
meana  that  are  uaed  to  differentiate  one  individual  from  another  and  to 
reward  thoae  attributea  moat  highly  valued  will  determine  Rot  only  the 
fortunea  of  individuala,  but  alao  tfiat  of  the  aociety.    It  is  my  hope  and 
expectation  that  the  Academy *a  forthcoming  report  viXl  make  a  aignificant 
contribution  to  what  will,  arid  should,  be  a  continuing  national  debate  on- 
theae//iaau«a. 

With  your  permiaaion,  Mr.  Chairman,  I  ahould  now  like  to  introduce 
Alexandra  Wigdor,  Study  Director  of  the  Committee  on  Ability  Teating; 
Following  her  atatement,  we  are  prepared  to  reapond  to  queationa  that 
membera  of*  the  Subcommittee  may  have. 


*The  Purauit  of  Excellence;    Education  and  the  Future  of  America, 
Special  Studiea  Project  Report  V,  copyright  by  Kockefeller  Brothera  Ibnd, 
Doubleday  and  Company,  Gar^den  City,  NY  1958,  ^p.  1. 
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Mr.  Weiss.  Thank  you  very  much.  Miss  Wigdor. 


STATEMENT  OF  ALEXANDRA  WIGDOR,  STUDY  DIRECTOR,  COM- 
MITTEE ON  ABILITY  TESTING,  NATIONAL  ACADEMY  OF  .SCI- 
ENCES, WASHINGTON,  D.C. 

Ms.  Wigdor.  Thank  you.  Thanks,  Pave.  Since  Dave  has  already 
'  introduced  you  to  the  committee  arid  its  mandate  I'll  get  right  on 
with  my  remarks  about  the  bill  before  you  and  about  the 
Committee's  work. 

As  I  understand  it,  your  primary  interest  is  the  use  of  standard- 
ized tests  for  admissions  to  colleges,  universities,  and  professional 
schools.  You'll  obviously  not  be  surprised  to  learn  that  the  commit- 
tee found  that  many  ^unior  and  community  colleges,  most  4-year 
•  colleges  and  virtually  all  graduate  and  professional  schools  require 
applicants  to  submit  standardized  test  scores  to  admissions  offi- 
cials. It  is  somewhat  surprising  to  learn,  however,  that  the  great 
majority  of  undergraduate  institutions  are  not  very  selective,  that 
test  scores  and  indeed  GPA's  are  likely  to  present  barriers  only  to 
those  who  rank  very  low  among  high  school  graduates  and  to  that 
small  portion  of  applicants  who  want  to  attend  very  highly  selec- 
tive and  prestigious  schools. 

The  situation  in  professional  school  admissions  is  very  different. 
On  suspects  that  the  public  perception  of  admissions  tc^t  as  being 
the  great  makers  and  breakers  of  educational  opportunities  result 
from  the  situation  facing  law  schools  and  medical  schools,  where 
it's  not  uncommon  to  xind  5,000  applicants  competing  for  120 
places. 

Despite  the  evidence  that  most  undergraduate  institutions  iire 
not  very  selective.  The  committee  felt  that  many  of  the  impulses 
expressed,  in  the  movement  for  test  disclosure  are  well  founded. 
Openness  in  the  exercise  of  power  is  important  to  the  American 
concept  of  equity.  It  seems  a  reasonable  ^ipplication  of  that  princi- 
ple to  take  the  view  that  the  allocation  of  educational  opportunity 
is  an  exercise  of  pow^r  and  that  it  ought  not  to  be  conducted  en- 
tirely  behind  closed  doors. 

To  place  the  issue  of*  test  disclosure  in  perspective,  it  is  worth 
noting  that  it  was  not  until  1958  that  the  College  Board  decided  to 
report  scores  to  students.  Prior  to  that  tiine  scores  ha<J  only  been 
offered  to  the  admissions  officials,  not  to  the  students.  That  was 
the  beginning  step  in  what  has  become  a  bigger  and  bigger  move- 
ment toward  openness.  The  Buckley  amendment  was  a  much  great- 
er step  in  that  direction.  The  committee  felt  that  the  truth  it  in 
testing  movement  is  in  the  spirit  of  these  developments.  It  is  an  im- 
portant assertion  of  the  interest  of  students  and  of  society  in  gener- 
al in  the  allocation  of  educational  opportunity. 

As  a  general  principle,  the  committee  believes  that  it  is  desirable 
that  the.  entire  post  secoridalry  selection  process  be  open  and 
known.  In  addition,  there  are  very  specific  reasons  for  encouraging 
test  develof)ers  to  make  more  information  available  about  their 
testing  programs  than  has  traditionally  been  the  case.  One  of  the 
^  biggest  sources  of  problems  with  testing  in  America  in  the 
committee's  judgment  lies  with  the  misunderstandings  and  the 
misinterpretations  of  test  results  by  test  users,  test  takers,  and  the 
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public  in  general  The  committee  concludes  in  its  report  that  well- 
developed  and  well-researched  admissions  ^tests  can  be  useful  selec- 
tipn  aides  if  admissions  officials  understaivi  their  limitations.  Like 
the  sponsors  of  this  bill,  however,  the  committee  realizes  that  the 
usefulness  depends  on  having  the  knowledge,  knowledge  about  the 
nature  of  the  test  and  what  it  purports,  to  measure,  knowledge 
about  the  scaling  methods  used  to  give  scores  meaning  and  particu- 
larly knowledge  about  the  Ifmitations  of  tests. 

Insofar  as  the  bills  before  you  then  stem  from  a  desire  to  pro- 
mote more  knowle^e  about  tests  and  about  the  appropriate  use  of 
test  scores,  you'll  find  thexommittee's  reports  to  be  consistent  with 
your  efforts.  The  cpinmittee  has  been:fuliy  cognizant  of  the  need  to 
improve  public  understanding  of  this  widespread  technology  and  it 
expects  its  report  to  be  an  important  source  of  information  to  test 
users,  test  takers,  and  indeed  policvmakers. 

.While  the  c^ommittee  agrees  with  this  need  for  information,  how- 
ever, it  found"  the  question  of  how  openness  can  best  be  achieved 
extremely  difficult.  Three  important  questions  present  themselves. 
First,  will  disclosure  result  in  substantial  benefits  to  test  takers? 
Second,  will  disclosure  of  test  forms  have  dilatorious  effects  on  the 
validity  and  reliability  of  tests?  And  third,  is  regulation  by  the  Fed- 
eral Governmen*^  the  best  means  to  promote  openness? 

The  first  and  most  important  question  is  whether  full  disclosure 
will  Bring  substantial  benefits  to  test  takers,  and,  if  so,  to  which 
test  takers.  The  committee  is  skeptical  about  the  assumptions  and 
expectations  expressed  by  many  supporters  of  truth-in-testing  bills. 
Two  claims  have  been  made:  the  first  of  them  deals  with  test  qual- 
ity, the  second  with  test  fairness.  Supporters  have  argued  that  such 
laws  will  provide  an  external  spur  to  quality  assurance  by  allowing 
test  talkers  to  judge  the  quality  of  the  tests  being  used  to  make  de- 
cisions, about  them.  In  the  committee's  opinion,  this  is  highly  un- 
likely prospect.  Most  test  takers  do  not  have  the  expertise  among 
other  things,  the  statistical  expertise  required  to  make  any  serious 
kind  of  analysis  of  the  adequacy  of  the  test  or  its  research  base. 
This  is  not  to  say  the  disclosure  will  not  reveal  ambiguities  in  test 
itemsi  errors  in  scoring,  we  all  know  that  there  have  been.three  or 
four  instances  of  that  already  and  to  that  extent  it  s  been  very 
useful.  But  in  terms  of  a  deeper  analysis  of  the  value  of  tests  and 
the  res^&arch  that  lies  behind  them,  it's  a  highly  unlikely  prospect 
that  disclosure  will  help.  The  more  likely  as^Ject  is  that  wider 
acces^  of  the  research  community  to  the  data  basis  will  be  useful 
and  in  that  sense  opening  up  the  data  basis  to  the  research\commu- 
nity  might  indeed  aid  the  improvement  of  tests.  ^ 

The  committee  did  hear  complaints  by  various  parties  that  the 
testing  companies  have  not  always  been  as  open  as  they  might  be 
to  bona  fide  researchers  and  insofar  as  that  is  the  case,  the  com- 
mittee strongly  recommends  that  the  testing  companies  revise 
their  policies.  •  ,  i 

Supports  of  truth-in-testing  laws  have  also  expressed  the  hope 
that  disclosure  will  somehow  make  the  testing  process  fairer,  par- 
ticularly that  it  will  be  fairer  and  to  the  benefit  of  disadvantaged 
minority  students.  The  Educational  Testiiig  Service  has  released 
some  data  about  the  first  two  administrations  of  the  SAT  since  the 
New  York  law  that  casts  some  doubt  on  that  hope,  it  turns  out  that 
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most  of  the  students  that  asked  for  copies  of  the  tests  afterward 
and  their  scores  or  their  answer  sheet  reported  significantly  higher 
family  incomes,  this  is  self-reported  obviously,  but  nevertheleiss 
they  were  falling  in  the  higher  group  and  they  had  higher  scores 
on  the  tests.  Given  this  early  and  very  partial  data  it  doesn  t  seem 
likely  that  the  hope  that  disclosure  is  going  to  help  disadvantaged 
students  is  a  very  real  and  accurate  hope.  _ 

Dave  Goslin  brought  to  my  attention  a  study  of  Sesame  btreet 
that  adds  some  corroboration  to  my  fear— the  committee's  fear- 
that  is  more  advantaged  students  will  be  the  ones  who  benefit 
most.  Researchers  foun^  that  "Sesame  Street"  was  indeed  valuable 
to  disadvantaged  children  who  watched  it  but  it  was  more  valuable 
to  middle  and  upper  class  middle  children,  they  watched  it  more 
regularly,  they  had  more  reinforcing  experiences  in  their  daily 
lives,  they  got  more  out  of  it.  One  suspects  that  that  might  also  be 
the  case  with  disclosre.  r  ,i  j.  i 

While  the  committee  was  not  convinced  that  full  disclosure, 
therefore,  would  benefit  the  students  and  particul&r  disadvantaged 
students,  was  equally  unconvinced  that  the  disclosure  was  ^oing  to 
bring  about  the  demise  of  standardized  testing.  You've' heard  testi- 
mony from  a  lot  of  testing  companies  and  L  think  over  the  last 
couple  of  years  that  testimony  has  changed  a  bit.  Neverthel^, 
some  of  the  companies  remain  convinced^  that  disclosure  will  de- 
stroy the  validity  and  the  reliability  of  the  their  tests.  Others  have 
been  much  more  optmistic  about  the  likely  effects  and  feel  that 
they  are  going  to  be  able  to  develop  new  aquating  techniques,  de- 
velop sufficiently  large  item  pools  and  so  on  tha  they  will  in  other 
words,  be  able  to  rise  to  the  challenge. 

The  committee  felt  that  the  experience  of  the  last  2  years  seems 
to  bear  out  the  more  optomistic  predictions.  Largely  because  of  the 
prefisure  brought  by  truth-in-testing  supporters,  we  have  a  number 
of  experiments  going  on  right  now.  You're  all  familiar  with  the 
California  and  New  York  laws,  there  are  partial  and  full  disclosure 
experiments  underway.  The  client  boards  of  three  and  as  I  under- 
stand it  now  four  of  the  major  admissions  test  have  decided  to  dis- 
close their  test  nationwide.  Educational  Testing  Service  has  insti- 
tuted public  interest  principles  by  which  they  will  commit  them- 
selves in  their  relationships  with  colleges,  universities  and  their 
client  boards  to  making  more  information  available  and  otherwise 
being  more  open.  .       ,  ' 

Apparently,  the  College  Board  is  going  to  introduce  new  equating 
techniques  with  the  SAT  in  1982  that  oucht  to  solve  some  of  the 
problems  or  at  least  experimentally  they'll  see  whether  they  solve 
some  of  the  problems  the  current  techniques  face  with  disclosure. 

It's  clear  that  so  far  none  of  these  innovations  has  destroyed  test- 
ing, what  isn't  yet  clear  and  we'll  only  know  in  time  is  whether 
test  standards  can  be  maintained.  Whether  the  real iability  and  va- 
lidity of  these  instruments  can  indeed  be  maintained  or  indeed 
whether  they'll  be  improved  through  disclosure. 

With  regard  to  the  final  question  that  I  raised,  there  are  those 
that  claim  that  only  Government  regulation  of  testing  companies 
can  insure  openness.  Proponents  of  Governemnt  oversight  of  the 
industry  have  drawn  analogies  to  various  regulatory  precedents. 
Some  use  the  analogy  to  public  utilities,  that  the  testing  companies 
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have  a  monopoly  as  public  utilities  do  and,  therefore,  ought  to  be 
related.  Some  draw  on,  the  example  of  sunshine  laws  to  justify 
opening  up  the  process  to,  public  scrutiny.  Some  use  truth-in-lend- 
ing, truth-inj^tdvertising  models  for  the  protection  of  consumer  in- 
terests. \ 

Committee  on  ability  testing  did  not  fjnd  these  arguments  totally  ^ 
convincing.  First,  the  committee  did  not  see  evidence  of  systematic ' 
abuse  by  the  testing  companies  serious  enough  to  warrant  Govern- 
ment intervention  or  at  least  to  make  it  imperative.  , 

Second,  the  analogies  are  an  , important  r^pect  misleiEiding.  There 
are  three  participants  in  the  testing  process,  that  is  the  testing 
company,  the  educational  instituticn  and  the  student.  The  bills 
before  you  reach  only  one  of  those  participants,  the  testing  compa- 
nies. The  actual  decisionimakers,  that  is  tjhe  .  educational  institu- 
tions, will  not  be  reached  by  this  legislatioii  and  therefore,  the 
actual  use  of  tests,  will  not  necessarily  be  effectied  in  anyway. 

Thus  while  supporting  the  gen^eral  principle  of  openness,  the 
committee  was  not.  convinced  of  the  desirability  of  Federal  legisla- 
tion.   ^  \  r  X      1.      1.  . 

In  sum,  in  the  committee's  judgment,  none  of  the  three  basic 
questions  raised  by  H.R.  1662,  that  is  will  disclosure  benefit, -test 
takers,  will  disclosre  compromise  the  tests  and  is  Federal  regula- 
tion the  best  route  to  openness,  none  of  these  questions  nQ>y  allow 
clear-cut  apswers*.  . 

This  led  the  committte  on  ability  testing  to  propose  as  its  m^or 
recommendation  of  test  disclosure  a  policy  of  watching  and  wait- 
ingr^his  recommendation  is  not  a  veilea  proposal  to  do  nothing, 
but  it  is  a  call  to  a  different  plan  of  action  than  you  are  not  consid- 
ering. Instead  of  speculating  about  the  technical  costs  and  consum- 
er tenefits  of  disclosure,  the  committee  believes  that  the  States, 
Congress,  and  the  research  community  should  monitor  th3  develop- 
ments of  the  next  few  years  so  that  all  parties  can  made  a  better 
informed  judgment  about  creating  a  workable  balance,  between 
openness  and  testing  and  objective  assessment  of  academic  ability. 

This  committee  further  recommends  that  the  Department  of 
Education  .through  the''  National  Institute  of  Education  embark 
upon  a  positive  program  of  monitoring  the  experience  with  test  dis-_ 
closure  that  is  now  underway.  Because  the  conditions  exiist  at  pres- 
ent for  an  impirical  investigation  of  the  affects  of  various  kinds  of 
disclosure  plans,  NIE  has  the  perfect  opportunity  and  with  your  en- 
couragement would  no  doubt  seize  the  opportunity  to  underwrite 
the  collection  and  evaluation  of  data  needed  to  provide  the  basis  of 
future  policy. 

That  ends  my  formal  remarks,  we  will  be  delighted  to  entertain 
questions. 

[The  prepared  statement  of  Alexandra  Wigdor  follows:] 
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PUPAAI^  StATEMINT  or  AUUANDRA  K,  WlODOlt  ON  BtHALT  Of  THE  COMMITm  ON 

^A^wuTY  Tmtino,  National  AcADiMYjUEJ5cixMCKi-_^  1 — 

\?  Committee  on  Ability  Testing  was  convened  in 
1978  at  \  time  of  widesjjread  controversy  over  the  use  of  \ 
-Standard liz^-  tests  in  the  schools,- for  college  and         -  \^ 
university\^  admissions,  :and  for  the  selection  of  employees. 
Its  central  task  was  to  conduct  a  broad  examination  of  the 
role  of  testing  in  American  life.    Because  the  charge  to 
the  Committee  calJ^ei^£A^-^r-stu3y  of  testing  from  a  sociaJ^^. 
perspective/^  Vhe  members  haye  bjtgin.  sen^i^^ive^  to  thejriee.d 
to  go  beyond  questions  of  technical  adequacy,  and  to  / 
-explore  the  implications  of  test  use  for  individuals^ 


minor.ity  groupsi  institutions,  and  society  as  a  whole. 

The  report\of  the  Committee,  which  will  be  published 
in  February  by  the  National  Academy  Press,  might  best  be 
characterized  as  k  white  paper  on  testing;     It  is  intended 
to  describe  acquxately  the  theory  , and  practice  of  testingi 
to  illuminate  competing  interests  in  a  balanced  fashion? 
and,  ultima^t^ly/  to^^help  those  who  make  decisions  with 
tests  or  about  testing  to  reach  better-informed  judgements 


\ 

\ 
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'  than  is  now  the  case.  ,  Ttie  report  is  not  a  document 

written  primarily,  by  or  for  psychometr iclans  and  testing 

jSpeC'ialistsi.  it  represents  the  cons^ensus  of  a  muiti- 

idisciplinary  group  of  social  scientists  and'  legal  experts, 

a  majority  of  whom  have  no  connection  with  testing,  artd  it 

is  addresQ.€d  to  policy  makers  and  test  .users--lawmakers , 

judges,  educators,  personnel  administrators,  and  the 

jjournaJLists  and  commentators  who  do  so  much  to  shape 

public  understanding  of  testing..'issues..    '  . 

My  jrjem'arks  today  will  focOs 'on;  what  J  understand  to 

! 

,b|  your  prjimary  interest,  that  is,  the  use  of  standardized 
tests  in  sielecting  applicants  for  adrpission  to  colleges, 
graduate  schools,  and  professional  schools.    You  will  not 
be  surprised  to  learn  that  the  Committee  found  that  many  , 
junior  and  community  colleges,  most  four-year  colleges, 
and  virtually  all  graduate  and  professional  schools 
require  applicants  to  submit  scores  on  ability  tests  for 
the  use  of  admissions  officials.    It  is  surprising^  to 
learn,  however,  that  the  great  majority  of  undergraduate 
insti.tuticrns|  are  not  very  selective,  and  that  test  scores 
(and  CPAs)  are  likely  to  present  barriers  only  to  those 
who  rank  low  among  high  school_^raduates  and  to  that  sm^l 
group  ot  applicants  who  want  to  attend  the  most  selective 
colleges  and  univecsities--f or  the  most  part,  the  elite 
private  school^^s.    The  situation  in  professional  school  , 
admissions  is,,  of  course Very  different!  it  is  probable^v 


o  i         ■•  •    '  -8  4  S- 


'    '      '     \  ' 

that  the  public  percepfcign  of  admissions  tests  as /the  '  ' 
great  makers  and  brftakers  of  educational  opportunities 

/ 

deriv'es  jwch^  from  the  , situation  facing  law  schools  and 
medica^l  schools,  where  it  is  not  uncommon  to  fipd  5,000 
applicants  competing^  for  A20  peaces.  / 
Despite  the  strong  evidence  that  most  undergraduate 
institutions  are  n4t  very  selective,  and  that.'  test  score^ 
play  a  s«ignificant  role  only  for  a'  very  smalj  portion  of 
students,  the  Committee  $elt  that  many  of  the  impulses 

.pressed  l-n^the  movement  for  test  disclosure  are  well  j  ^- 

'  •    *  -  .     .        .  L 

f6un'ded.    Openness  in  the  exercise  of  power  is  importan^t 

T-o  the  American  concept  of  equity.    It  seems  a  reasonable* 

application  of  -the  principle  of  openness  to  take  the  view 

that  the  allocation  of  educational  opportunities  shoul<S|  be 

recognized  as  an  exercise  of  power  that  ;bught  not  be  ^ 

conducted,  entirely  behiod  closed^oors.;  | 

I     '   ^ "  .    '      .  *  1 .  !• 

To  place 'the  issue  of  disclosure/ in  perspective,  it 

is  worth  noting  that  before  1958  test/re^ults  were  reported 

only  to  d^ignated  college  and  univei^sity  admissions 

officers.     In  that  ^ear,  the  Collec,^^  Board  decided' to  ^ 

inform  test  takers  of ,  their  SAT  sco.res.    The  so-called 

^  ^    /  *  t  *  .  i  \ 

Buckley  Amendment 'of  J974,  which  requires  educational 

institutions  receiving  federal  financial  assistance  t< 

«  \ 
allow  students  (or  their  parents  or  guardians)  access  to 

their  acaSlemic  files.,  represen±s  a  further  step  in  the     ^  . 

direction  of  openness  with  regard  to  information  used  to  • 
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/ 

/ 

make  educational  decisions.    Ttie  truth-in-testin,g  movemertt 
is  in  the  spimt  of  these  developments.     It  is  ^n  impor- 
tant assertion  of  the  interest  of  students,  andjof  society 
in  general,  in  the*  axlocation  of  educational  opportunity. 

As  a  general  principle,  the  Committee  beljieves,  that 
it  is  desirable  that  the  entire  post  secondary  jsel^ect ion 
process  be  open  and« known.    In  addition,  ithere  are  very 
specific  reasons  for  encouraging,  test  developers  to  make 
more  information  available  about  their  testing  programs 

than  has  traditionally  been  the  case.    One  of  the  biggest 

> 

sources  of  problems— wi±h_testing  in  ^merica^  in  the  Com- 
mittee's judgment,  lies  with  the  misunderstandings  and 

misinterpretations  of  test  results  by^  test;  users,  test 

/ 

takers,  and  the  public  in  general.    The  Committee  con- 
cludes in  its  report  that  weli-developec/^hd  -researched 
admissions  tests  '*can  be  useful  selection  aids  if  adm\s- 
sions  officers  respect  their  limits. "j  But,  like  the 
sponsors  of  H.R.  1662,  the  Committee  recognized  th/at  the 
usefulness , of  testis  depends  in  large  measure  upon 
knowledge  posses^sed  by  the  participants  in  a  ^selection 
decision  (both  the  user  of  test  results  and  the  test 
takerj --knowledge  about  the  nature  of  the  test  and  what  it 
r^irports  to  measui'^,  the  scaling  methods  used  to  give 
scores  meaning,  and  the  limitations  of  the  test. 

-  Ini^o'far  as  the  bills  befofo  you  stem  from  a  desire 
.to  promote  more  knowledge  about  tests  and  more  appropriate 
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use  of  test  results,  you  v^lll  find  the:  Committee  *s  rlport 


to  be  consistent  with  your  effor^ts.    T^e  Cojnmittee  h^s 
been  fully  J^ognizant  of  the  need  \to  imF|rove  public 
understanding  of  this  widespread  Aechnobtogy,  and  expects 
vits  report  zo  be  an  important  source  of ,  information,  for 
test'users,  Itest  takers^  Lnd  policy  makers. 

/    While  Ithe-  Committee  agress  with  the  sponsors  of  the 


bills  under  piscussion,  about  the  need  fo^  more  generally 
available  information ^ibout  the  characteristics,  appropri- 
ate  uses,  and  limitati^ons  of  standardized ^tests,  however,    [  ^ 
it  found  thejquestioh  of  how  openness  can  ^best  be  a~chi:eyei3  7 

very  difficuljt.    Ttiree  basic  questions  prejsent  themselves:, 

'    r        ^  -  ^  ,1 

1.  .  Wiia^i  disclosure  result  in  .substantial  benefits 

'  1/          ,  \ 
to  test  takers?  '  ' 


2.    Will  disclosure  of -test  forms^ shortly  after  some 
or  all  admlnistrationo  have  damaging  effects  on 
the  validity  or  reliability  of  tffe  tests? 

.3.     Is  regulation  by  the  federal  government  the  best 
me  alls  to  promote  openness?  \ 

.  i, 

1.    Th^  first  and  mos,C  important  question  is  wheither 


full  disclosure/,  that  is,  disclosure  of  the. actual  test 
questions  and  answers,  will  bring  substantial  benefits  to 
test  .tr.kers,  and  if  so,  to  which  vest  takers.    The  Commit- 
tee  Is  skeptical  about  the  assumptions  and  expectations 
exprl»ssed  |b'y  pany  supporte^/s  of  truth-in-testing  legisla 
tionJ    OVo  clairjs  have  been  madet    one  concerns^  tes^'t 
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quality  and  the  other  test  fairness.    Supporters  have 

argued  that  such  laws  vfill  provide  an  external  spur  to 

I 

quality  assurance  by  allowing  test  takers  to  judge  the 

quality  of  tests  used  to  jnake  decisions  about  their 

edlfcational  future.    However r 'expertise  far  beyond  the 

capacity  of  most  test  takers  is  required  for  any  serious 

analysis  of  the  adecjuacy  o^  ,a  test  and  its  research  base 

(although  disclosure  may  be^  and  occasionally  has  be^n, 

useful  in  turning  up  ambiguities  in  specific  items -arid 

errors  in  scoring).    Wider  access  of  the  research  com^ 

munity  to  test  data  is  far  mort  germane  to  improving  the 

quality  of  tesi.s.    1t)ere  have  b\\en  complaints  that  the 

testing  companies  do"  »io,t  always  welcome  bona  fide 

researchers  from  outside  the  organization.    Insofar  as 
« 

this  is  the  case,  the  policies  ought  to  be  revised. 

*^       Supporters  of  truth-in-testing  laws  i^ave  also 
expressed  the  hope  that  disclosure  will  somehow  make  the 
testing  process  fairer,  and  particularly  that  it  will 
benefit  disadvantaged  and  minority  students.     On  the 
question  of  which  students  will  benefit  from  test 
disclosure,  an  Educational  Testing  Service  staff  ana'lysis 
of,±he  first  two  SAT  administrations  since  the  New  York 
law  took  e.ffect  indicates  that  the  studen*:s  who  requested 
a  copy  of  the  test  booklet  and  answer  sheet  had  signifi- 
cantly higher  mean  scores  and  higher  (self-reported)^ 
family  incomes  than  those  who  did  not.    The  hope  that 
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.disclosure  will  improve  the  competitive  position  of 
disadvantaged  and  minority  students  is  not  borne  out  by 
this  early  evidence,  although  it  is  just  that — very  early, 
and  partial  evidence.    Some  corroboration  is  offered  by 
the' study  of  the  children's  television  program,  Sesame 
Street,  published  by  the  Russell  Sage  Foundation  in  1975. 
The  creators  of  the  program  intended  t^^at  it  enrich  the 
early  learning  experience's  ovfd^sc^d van t aged  children, 
which  it  did*    Butothe  infant  Jievters  from  middle-  and 
upper  middle-class  homesk.b^nef ited  even  more  because  they 
watched  the  program  morjs  regu.larly  and  had  more 
reinforcing  experiences  in  their  daily  lives.  The 
experience  with  Sesame  Street  suggests  that  while  full 
disclosure  may  be  of  some  benefit  in  terms  of  student 
performance,  it  ij5,  likely  that  the  best  students  will 
receive  the  most  benefit. 

2.     While  the  Committee  is  not  convinced  that  full 
disclosure  would  be  of  much  benefit  to  the  the  student, 
either  in  terms  of  test  quality  or  in  improving  the 
performance  of  disadvantaged  test  takers,  it  was  equally 
unconvinced  that  full  disclosure  would  cause  serious 
problems  with  regard  to  test  validity  and  reliability  in 
large  testing  programs.    As  you  arc  well  aware,  many  test 
developer'iS  have  expressed  concern  that  test  disclosure 
will  have  negative  effects  on  the  quality  of  the  tests. 
Some  feel  that  the  pool  of  possible  items  is  so  limited 
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and  item  development  so  difficult  a  process  that 
disclosure  after  each  administration  of  a  test  will  soon 
give*  test  takers  what  amounts  to  prior  knowledge  of  the 
test  questions  r    They,  have  also  expressed  the  concern  that 
the  reliability  of  the  tests,  which  relates  to  the 
consistency  of  test  scores,  will  be  reduced  because  full 
disclosure  rules  out  the  traditional  equating  techniques. 
But  there  are  other  test  developers  who  feel  that  the 
industry  will  be  able  to  respond  to  these  challenges,  that 
they  will  be  able  t<,  develop  new  item  pools  and  new 
equating  techniques  rapidly  enough  to  maintain  test 
quality. 

The  experience  or  the  last  two  years  seems  to  bear 
out  the  more  optimistic  predictions.    I^argely  because  of 
the  pressure  brought  by  supporters  of  open  testing, 
experiments  with  various  kinds  of  test  disclosure  have 
be^n  set  in  motion.    California  .and  New  York  have  passed 
state'  "truth-in«-testing**  laws.     The  California  law 
requires  that  facsimiles  of  postsecondary  admis^sions 
tests,  along  wi*-h  validity  ^ata  and  scoring  irforjjiation, 
be  filed  with  the  Postsecondary  Education  Commission. 
Test  takers  are  to  be  given  information  about  the  purposes 
of  the  tests,  the  nature  of  the  subject  matter,  scoring 
procedures,  and  sample  questions,  thus  placing  a  legal 
obligation  on  test  publishers  where  formerly  voluntary 
action  sufficed.     The  New  York  law  requires  full 

,854 


850 

disclosure.    Under  the  terms  of  the  Lavalle  Act,  test 
producers  must  file  with  the  Commissioner  of  Education  and 
supply  to  the  test  taker  upon  request  the  actual  test 
questions  and  answers  within  30  days  of  administration. 

In  addition  to  these  state  disclosure  laws,  some  of 
the  testing  companies  and  client  boards,  despite  continued 
concern  about  the  effects  of  full  disclosure  on  test 
quality,  "have  begun  to  respond  positively  to  the 
challenge.     The  Educational  Testing  Service  ha s_ developed 
"public  interest  principles"  to  guide  its  staff  and  its 
relations  with  the  client  boards  and  colleges  and 
universities  that  use  its  admissions  tests.    Of  ;Tiore 
immediate  consequence,  three  client  boards,  the  Law  School 
Admissions  Council,  the  Graduate  Management  Admissions 
Council,  and  the  Graduate  Record  Examination  Board,  have 
decided  to  disclose  their  examinations  nationwide.  And 
new  equating  techniques  are  being  developed  and  apparently 
will  be  used  .on  an  experimental  basis  with  the  SAT  in  1982. 

None  of  these  innovations  has  brought  about  the 
immediate  and  total  col-lapse  of  standardized  admissions 
testi'ng,  although  the  long-term  effects  for  good  or  for 
ill  remain  obscure. 

3.,  .With  regard  to  the  final  question,  there  are 
those  who  claim  that  only* government  regulation  of  the 
testing  companies  can  ensure  openness.    Proponents  of 
governmental  oversight  of  the  industry  have  drawn 
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analogies  to.  various  regulatory  precedents:    some  argue 

that  testing  companies  have  a  monopoly  on  the  instruments 

of  human  resource,  allocation  that  would  justify  their 

treatment  as  a  public  utilityi  some  draw  on  the  example  of 

sunshine  laws  to  justify  opening  up  the  process  of  test 

development  and  validation  to  public  scrutinyi  others 

b.elieve  that  "truth  in  lending"  and  "truth  in  advertising" 

provide  models  for  the  protection  of  consumer  interests.  . 

The  Committee- did  not  find  these  aguments  totally 

convincing.    First,  the  Committee  did  not  see  evidence  of 

systematic  abuse  by  the  testing  companies  serious  enough 

to  make  government  intervention  imperative.    Second,  the 

analogies  are  misleading.    There  are  three  participants  in 
» 

the  testing  process:     testing  company,  educational 
institution,  and  aspiring  student.    The  proposed  test 
disclosure  bill  does  not  directly  influence  the  behavior 
of  the  actual  decision  maker,  the  educational  institution^ 
and/  therefore/  will  not  necessarily  have  much  effect  on 
how  tests  are  used.    Thus  while  supporting  the  general 
principle  of  openness,  the  Committee  was  not  convinced  of 
the  desirability  of  federal  legislation.    Nor  did  it  find 
self-evident  the  efficacy  of  the  laws  c.urrently  in 
operation  or  unoer  discussion  in  the  states  for 
significantly  improving  tests  or  the  way  they  are  used. 

•    In  sum,  in  the  Committee's^ judgment ,  none  of  the 
three  basic  questions  raised  by  H.R.  1662— Will  disclos^pre 
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beLOefit  the  test  takers?>  Will  disclosure  compromise  the 
tests?)  Is  federal  regulation  the  best  route  to 
openness?--allow  clearrcut  answers  at  present,    itiis  led 
the  Committee  to  propose/  as  its  major  recommendation  on 
test  disclosure^  a  poliby  of  watching  and  waiting*  Hiis 
recommendation  is  not  a  veiled  proposal  to  do  nothing* 
But  it  is  a  caTl  to  a  different  plan  of  action  than^you 
are  now  considering*    Instead  of  speculating  about  the 

technical  costs  and  consumer  benefits  of  disclosure^  the  

Committee  believes  that  the  siatesi  Cohgress#  and  the 
research  community,  should  monitor  the  developments  of  the 
next  few  years  so  that  all  parties  can  make  a  better 
informed  judgment  about  creating  a  workable  balance 
between  openness  in  testing  and  objective  asessment  of 
academic  ability* 

The  decision  of  the  three  client  boards  to  disclose 
their  tes.ts  nationwide,  together  with  the  existing  state 
open-testing  programs  in  New  York  and  California /  provides 
all  parties  to  the  truth-in-testing  debate  with  the 
opportunty  to  establish  the  effects  of  disclosure 
empirically*    The  experience      ^h  these  efforts  over  the 
next  few  years  will  indicate  whether  full  disclosure  is 
technically  feasible,  what  the  financial  costs  will  be# 
whether  there  are  improvements  in  the  quality  of 
admissions  tests,  and  whether  the  hoped  for  benefits 
accrue^t;^o  sudents.  ^ 
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Committee  further  recommends  that^the  Department 
of  Education,  through  the  National  Institute  of  Education, 
emba.rk  upon  a  positive  program  of  monitoring  the 
experience  with  test  disclosure.    Because  tKe  conditions 
now  exist  for  an  empirical  investigation  of  the  effects  of 
various  plans  for  .te^t  disclosure,  NIE  has  the 
cpportunity--and  with  your  encouragement  would  no  doubt 
seize*  it--to  under>/rite  the  collection  and  evaluation  of 
data  needed  to  pro^de  the  basis  for  future  policy. 
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Mr.  Weiss.  Thank  you  very  much.  I  think  there  had  been  a  re- 
quest for  Dr.  Goslin  that  the  list  of  the  members  on  the  committee 
on  Ability  Testing  be  entered  into  the  record. 

Ms.  WiGDOR.  Yes. 

Mr.  Wbss.  That  will  be  done  at  this  point. 
[Information  submitted  by  Alexandra  Wigdor  follows:] 
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F  ^ 

COMMITTEE  ON  AIILltV  TESTING 

wfNpciL  R.  GARNER  (Cha/f),  Department  of  Psychology,  Yale  Univer- 
sity 

MARCUS  ALEXIS,  Departnient  of  Economics,  Nbrthwestern  University 
WILLIAM  SEVAN,  Departnient  of  Psychology,  Duke  University 
LEE ).  CRONBACH,  School  of  Education,  Stanford  University  (psychor 
metrics)  • 

,  2VI  CRiLich*.  V  Department  of  Economics,  Harvard  University 
OSCAR  HANDiiN,  Director  of  Libraries,  Harvard  University  (history) 
DELMOS  lONES,  Department  of  Anthropology,  City  University  ot  New 
York  • 

LYLE  v.  lONES,  L.L.  Thurstooe  Psycbpmetric  Laboratory,  University  of 

North  Carolina  (psychonoetrics,  statistics) 
PHILIP  •.  KURLAND,  Law  School,  UmVersity  of  Chicago 
•URKE  MARSHALL,  Law  School,  Yale  University 
MELVIN  R.  NOViCK,  JLirKk^uist  Center  for  Measurement,  University  of  k)wa 

(statistics,  psychometrics) 
LAUREN      RESNiCK,  Learning  Research  and  Development  Center. 

University  of  Pittsburgh  (psychology,  educational  psychology) 
ALICE  ROSSI,  Department  of  Sociology,  University  of  Massachusetts 
WILLIAM  H.  SEWELL,  Department  of  Sociology*  University  of-Wisconsin 
JANET  T.  SPENCE,  Department  of  Psychology,  University  of  Texas 
ALAN  A.  STONE,  Lsw  School,  Harvard  University  (psychiatry,  law)* 
MARY  L.  TENOPYR,  HufTian  Resources  Laboratory,  American  Telephone 
-  and  Telegraph  Company,  Morristown,  N.).  (industrial  psychology) 
JOHN  w.  TUKEY,  Bell  Telephone  Laboratories,  Inc.,  Murray  Hill,  NJ. 

and  Princeton  University  (statistics) 
E.  BELViN  WILLIAMS,  Educational  Testing  Service,  Princeton,  N.K  (psy- 
chology) 

ALEXANDRA  K.  wiCDOR,  Study  Director 
SUSAN  w.  SHERMAN,  Sen/of  /Research  >A550c/a(e. 
GLADYS  R.  toSTioc,  Adm/nis(ra(/ve  Secretary 
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Mr.  Weiss.  Could  .y9U  describe  for  us  the  methodology  that  was 
used  by  the  comrrtittee  in  coming  touts  conclusions? 
Ms.  WiGDOR.  Ves,  indeed.  I  don't  think  I'd  call  it  a  n|ethodology;,- 

.but   /  '  ■  I 

Mr.  WEiss/The  process.  ..^  ■ , '  . 

.M8.-WiGtiOR.  The  process,  yes.  The  committee  s  investigatipn  m- 
volved  a  liumber  of  kind3  of  strategies  and  in  the  first  place  we  did 
hold  ouf  own  hearings  2  years  ago,  at  which  time  we  had  repre- 
sentatives of  testing  companies,  test  users,  student  associations, 
various  advocacy  groups,  some  of  which  for  example,  represented 
minority  interests,  the  Urban  League  was  thefre,  NAACP,  and  the 
Association  of  Black  Psychologists.  I  can't  rerMmber  thejimjis 
the  moment.  But,- at  these  hearings  asked  people  both  to  give  us 
their  impressions  about  standardized  testing  in  general  and  about 
specific  issues.  Some  of  the  people  did  speak  on  test  disclosure 

In  addition  to  that,  we  invited  written  submissions  from— as  1  r^ 
Tiember  175  interested  individuals  and  organizations  and  compiled 
a- huge  library  of  their  experiences  with  testing,  their  problems 
with  testing,  so  on  aiid  so  forth.  That  was  one  kind  of  activity  that 
was  aimed  at  trying  to  allow  everybody  who  had  an.. interest  m  test- 
ing issues  in  general  and  a  disclosure  and  specific  to  make  sure 
that  the  cortmi^tee  was  aware  of  their  position.     .  / 

Another  kind  of  activity  included  marshaling  t^e  research  litera- 
ture Now,  Academy  committees  do  not  themselves  do  original  re- 
search, what  they  do  is  bring  together  and  sun^ixiarize^the  best  ex- 
isting research.  This  is  done  through  literature  searches  through 
various  kinds  of  connections  with  scholara  working  in  the  tield,  so 
on  and  so-forth   ^  .  ^,    „   .    ...       i  ^ 

As  part  of  its  information-gathermg  effort,  the  Committee  also 
leaned  upon  the  services  of  experts  outside  its  own  membership. 
We  have  as  part  of  the  report— appended  to  the  report  a  coHectioir 
of  11  signed  papers,  a  couple  of  thenri  done  by  Committee  and  staH 
people,  most  of  them  done  by  outside  experts,  one  of  the  oncoUege 

^^riiS'papers  again  brought'together.  the  best  of  the  research  for 
the  Committee's  consideration.  Committee  membership\  itself,  ot 
course,  included  years,  and  years  and  years  of  experience  and  ex- 
pfertise  on  various  kinds  of  issues,  not  always  very  obvious.^  . 

For  example,  I  think  both  of  the  members  of  the  committee  who 
are  on  law  school  faculties  have  sa*  on  law  school  admissions- 
boards.  Many  of  the  inembers  have  had  that  sort  of  dreadful  expe- 
rience so  that  they  had  personal  experience  with  the  problems 
facing  admissions  officers  and  personal  experience  of  how  th^proc- 
ess  really  works,  how  the  decisions  really  are  .  made,  whar  role 
scores  pipy.  In  other  words,  that  kind  of  firsthand  knowledge. 

Dave,  have  I  missed  any  of  the  obvious^wAys  in/vhich  our  cpm-^ 
mittee  got  it — "  ,      .  '" 

Mr,  GosuN.  The  obvious  way  that  you've  missed  i*  that  the  U)pi- 

mittee  met  many  times.  '  : 

Ms.  WiODOR.  Yes.  ,  .  ^,  ^  „    j  i  »  *i 

Mr.  GosuN.  I'm  sorry  Ihe-mget  obvious  thing  th^t  band;f  left  out 

is  that  the  Committee  met  many  times  over  a  3-year  period  and— 
Mr.  Weiss.  By  many,  how  many  times  would  you  say? 


Ms.  WiGDOR.  I  think  we  had,a  total  12  meetings,  one  of  {hem 
being  a  4-day  meting,  most  of  the  ri&st  being  2y2-day  meetings. 
And  that  was  of  the  full  committee.  In  addition  to  that,  the  com- 
mittee in  the  last  IV2  year  broke  upointb  "working.groupsi  writing 
groups,  four  or  five  committee  menibers  got  tpg:ether'in  three  dif- 
ferent writing  groups  and  they  met  on  an  average  of  three  times, 
the  writing  groups  and  then  j^ack  intojthe  full  Committee,  so  it  was 
•  a  great  deal  of  contact.  Sharing  of  knowledge  of  information,  work- 
ing out  positions,  Avorking  out  the  wisdom  that— — 

Mr.  Weiss.  And  were  there  position  papers  on  specific,  issues  pre- 
sented to  that  group  with   ^ 

Ms.  WiGDOR.  Yes. 

Mr.  Weiss.  Proposed. opthm^^rfor  ju'Jtgment  or  conclusions  to*^be 
^doptea-aird-then  there  was  ^  vote  taken?  Did  th^  committee  ulti- 
mately come  ',0  ail  decision  that  they  would  say  yes  or  no  as  to-  a 
particular  conclusion?  ^  ' 

Ms.  WiGDbR.  Yes;  -we  used  the  technique  of  position  papers  to 
3tart  getting  the  committee  to  form  basic  opinions  and  then >as  the 
writing  groups  got  to  v/ork,  drafts  were.pirculated  ainong  the  whol,e_ 
committee,  everyWly  responded  in  wrXting  to  .the  various  drafts, 
things  were  redrafted,  where  there  was.^ifference  of  opinion  more 
information  was  gathered^  more  discussion  was  held  until  gradual- 
ly we  had  what  is  a  genuine  document  of  consensus. 

Now,  this  is  not  ^to  say  that  every  liiember  of  that  committee 
agrees  with  every  single  word  in  the|  report;  you  never  get  18 
people  to  agree  to  every  word  of-anythif^g.  

Nevertheless,  it  is  a  document  that  represents  the  consensus 
opinion  and  1  thipk  a  genuine  consensus.  We  have  had  an  unbdiev^ 
able,  amount  of  participation  of  the ,  committee  members  in  the 
writing  process  and  in  working  out  posiUons-and-policies. 

Mr.  Weiss.  And  the  whole  process  ^oilk  how  long? 

Ms. -WiGDOR.  The  first  meeting  was  held  February  3  and  4,  1978; 
it's  Been  a  long  process.  •  j 

Mr.  Weiss.  And  you  will  have  your  report  rfc^leased  February  of 
1982,  fight?  '  ^ 

.  .  Ms.  WibDOH.  That's  right.  J         "  ^ 

Mr.  WEiss.*lloughly  4  years  from  beginning  to  end  of  the  process 

Ms.  WiGDOR.  That's  right.  I  might  alfeo  add  that— this— is  true  of 
aay  Academy  report^  but^it's  true  of  hMxs  that  it  went  through  a 
doubla  level  of  review  as  all  Academy i reports  do.  It's  reviewed  by 
the  Assembly  of  Behavioral  and  Social  Sciences^  of  which  Dave  is 
the  executive  director,  that  review  involved  six  members  of  the  as- 
sembly who  read  the  report  and  wrote  written— gave  us  written 
comments. to  which  we  responded.  Therej^f{:er,  the  report  went 
through  review  by  the  Report  jReview  Com'mittee  of  the'National 
Academy  of  Scic^hces.  These  reviewers  v^ere  not  pHmarily  socidi  sci- 
entists, but  scientists  who  as  a  genera^  ^ule  look  at  the  adequacy  of 
evidence  so  on  and  so  forth  and  we  had'  very  helpful  comments  at 
that  level  6f  revijew  as  well. 

That  proccos  assures  that  sloppinesf  doesn't  slip  through,  that 
the  committee  does  indeed  have  the  documentation  to  support  its 
position.  So  on  and  so  forth.  We  founds  i  ra: very  useful  process. 

Its  had  a  good  deal,  in  other  words,  a  good  deaJ  of  peer  review. 
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Mr  w/i»s.  So  that's  it,  again,  just  to  be  sure  that  J  am  correct. 
This  wa6  riot. any  kind  of  independent  research,  oripnal  research, 
that  th4  /Academy  undertook.  It  was  real  y  a  study  based  on  infor'- 
matioiTgathered  by  it  "and  submitted  to  it,  with  the.  original  work 
having  bfeen  done  by  others  and  out  of  all  that  

Mr.  (iOSUN.  Including  the  members?  ■ 

Ms.  VfiODOR.  Including,  yes.  '        r  ,i     fUof  a  ^nn 

■  Mr  /Wiiss.  Including  the  members»and  out  of  all  of  that,  a  con-, 
sehsur/  document  was  arriv^  at  which  takes-in  rough  form  the  po- 
sition'as  outlined-in  the  testirnony  that  you  gave-us. 

/  M»  WiGDOR.  On  disclosure,  which  is  just  one^of  a  very  large 
^uijiber  of  issues,  yes;  but  this  is  the  position  of  the  committee  on 

dis^!l08ures.  ,  .  ■      '  ' 

Mr.  Wliss.  On  disclosure,  right.  •  '  ' 

/Ms.  WiGDOR.  For  college  admissions  or  postsecondary  Admiasione 

/  ISf^Wiiss  Did  you  find  that  the  committee's  pbsitioris  changed 
as  a  result  of  developments  that  occurred  during  the  int^im  of  the 
^study?  -As  of  ,1978  there  was  no  legislation  on  the  books  anyplace. 
Letrislation  here  had  not  peih  introduced  and  the  conclusion  that 
you've  come  to  now  that  U'ke.got  legislation  on  the  books^is  let  s- 
watch  and  see  how  it  works  (but  and  let  s  monitor  it  closely. 
Ms.  WiGDOR.  Indeed  that  Jes,  indeed  that  is  the  case.  ,  .  ^ 
One  of  the  reasons  thaMthis  project  took  3  V2  years  is  that  so 
many  activitiM  suddenly  V*ere  underway  and  the  committee  telt 
ihat  since  its  mandate  waslo  look  at  testing  from,  a  social  perspec-. 
tive,  social  impact  o.f  testing,  that  it  must  indeed  be  cognizant  of 
what's  goihff  on  ia  society.  We  have  been  at  your  hearings. for  the 
last  ryeare.  We  have  been  following  these  developments  yeq^  close. 
Iv  Obviously  when  the  committee  was  first  formed  they  did  not 
know  they-  ^yould  be  talking  about  test  disclosure.  Yes^hey  have 
been  monitoring  these  developments.  i 
^.J^ftTWEiss.  The  committee  did  not  know  that  it  would  be  talking 
about  test  discloHure?'  '  .  ,.  ,         ■        •  „  *^  k1 

■  Ms.  WicboR.  Did  not  know  that  test-disclosure  was  going  to  be 
an  important  part  of  its  report.  i_.  u 

Mr  Weiss  OK.  That  sort  of  obviates  my  next  questujn  which  was 
going' t6  be,  was  there  then  a  change  in,  in  pcsition  from  February 
1978  to-sometime  in  1980,  sometime  after  the  time  when  the  Ne^ 
'  York  le'gislatioirWSs  adopted,  for  example?  Had  there  been  a 
change /of  position  On  the  part  of  the^  members  of  the  committee^ 
/Ms  WiGDOR.  That's  really  a-  question  I  can  t  answer,  at  least  ,1 
think  in  the  way  you.  want  it  answered.  Yes,!in  o«rsense  there  is 
always  change  when  you've  got  18  people  with  different  kinds  of 
experiences  and  expertise  getting  together  and  educating  one  an- 
h^es,  there  is  change.  I  would^y^at  half  the  members  of 
the  cornmittee,  those  who  are -not  testers,  psychologiste  or  in  some 
oth6r  way  connected,  with  or  having  exi)enence  ^  testing,  they 
didh^t  know  disclosure  was  art  issue  to  begin  with.  They  knew  it  by 
thfe  time  things  were  moving;h^reand  m  New  York.  In  that  sense, 
of^  course,  there  was  changer|Pe6pirweieeanated.  I  wo^l^^say  yf 
obinion  evolved:  I  think  that  the  questions,  the  mndamentai  ques- 
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would  be  on  tests  and  they  are  still  not  sure  of  that.  They  have  not 
found,  there  has  not  been  enough  time  for  enough  evidence  to  be  in 
to  make  that  kind  of  assessment. 

So  in  that  sense,  that  question  remains  and  I  would  say  the  other 
question,  that  is,  is.  this  really  going  to  benefit  students  and,  par- 
ticularly, is  it  going  to  benefit  disadvantaged  students?  That  ques- 
tion still  remains  as  the  central  question  and  the  committee  feels  it 
has  no  real  answer  yet. 

Theso  things  have  remained  constant  overtime  and  the  commit- 
tee found  them  very  troubling  questions.  ^ 

Mr.  GosLiN.  At  the  same  time,  I  can  remember  the  first  meeting 
of  the  committee  and  there  was  a  very  clear  compiiitment  on  the 
part  of  members  of  the  committee  to  the  concept  of  openness. 

Ms.  WiGDOR.  Yes. 

Mr  GosLiN.  '  And  that  has  remained  constant  and  is  reflected 
cleaply  in  the  committee's  report. 

/Mr.  Weiss.  Well,  I  wonder  if  you  would  expand  on  that  a  little 
bi^.  I  find  a  seeming  conflict  or  perhaps  contradiction  in  the  com- 
mitment to  openness,  except  in  the  implementation  of  steps  which 
wbuld  in  fact  lead  toward  greater  openness. 

Ms.  WiGDOR.  Obviously  we'll  have,  to  define  degrees  andy,  well, 
define  terms  first,  and  talk  about  degrees  of  openness. 
^        Mr.  Weiss.  OK,  >yhat  do  you  mean  by  openness? 

Ms.  WiGDOR.  By  openness,  not  what  I  mean,  but  what  I  think  the 
*    .  committee  means  by  openness.' 

Mf.  Weiss.  Right.  • 

Ms;  WiGDOR.  Would  be  something,  I  thin^k  youVe  even  used  the 
word  yourself,  getting  away  with— doing  away  with  the  mystery. 

Mr.  Weiss.  Doing  with  

Ms.  WiGDOR.  The  mystery  that  has  

Ivir  Weiss  Yeah  right 

Ms.  WiGDOR.  Sorry.  That  has  traditionally  surrounded  tests. 
There  was,  I  think,  a  carryover  from  the  early  d^ys  of  testing  when 
the  expert  was  put  on  a  pedestal  and*  so  on.  There  has  been  a  tend- 
ency in  our  society  to  shroud  these  instruments  in  mystery. 

The  committee,  I  think,  feels  that  that  is  extremely  detrimental. 
This  is  a  too  widely  abused  technology  to- be  allowed  to'\be  thought 
of  and  used  that  way.'  So  the  committee  is  entirely  in  agreement 
with  you  that  we've  got  to  do  away  with  the  mystery  that  test 
users  and  test  takers  simply  need  to  know  a  lot  more  about  tests 
than  they  do. 

I  think  we  are,  the  committee  is  not  convinced,  in  terms  of  your 
,  position,  is  that  the  ultimate  step,  that  is  making  the  answer,  the 
questions  and  answers  available  afterward,  not  convinced  that  this 
\  is  an  absolutely  essential  step  to  take.  Not  convinced  that  it's  not. 
\   Mr.  GosuN.  It'si-not  convinced  that  it  isn't  either. 
\  Ms.  WiGDOR.  Right.  But,  just,  you  know,  that  is  where  they  then 
draw  the  line,  of— there  is  still  an  unaswered  question  here  in 
terms  of  balancing  openness  against  the  technical  adet[uacy  of  the 
t^sts 

IfvfuU  disclosure,  if  af);er  how  ever  many  years  it  takes  to  see 
what  kinds  of  new  equating  techniques  the  companies  can  come  up 
with,  \pnd  so  on  and  so  forth,  if  it  turns  out  that  disclosure  is  not 
having  ahy  detrimental  effect  on  the  test,  the  committee  woiild  say 
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unanimously,  of  course,  make  them  available.  If  nothing  else  it  will 
give  the  students  a  little  peace  of  mind. 

If,  on  the  other  hand,  it  would  destroy  the  usefulness  of  the  test, 
the  committee  would  say  you  should  draw  the  line  before  that. 
Make  facsimiles  available,  make  much  more  information  about 
scaling  and'^what  ^ores  mean  and  the  limitations  of  tests.  Make 
much  more  of  that  kind  of  information  available,  but  draw  the  line 
on  full  disclosure  if  it  will  ultimately  destroy  the  quality  of  the 
tests* 

Mr.  Weiss.  Let  me  cite  two  examples  for  you.  You're  familiar 
with  them.  The  law  college  admissipns  council  has  decided  to  go 
the  full,  total  route  of  openness.  The  medical  college  admissions 
group  has  gone  180  degrees  the  other  way.  They've  gone  to  court  to 
prevent  the  New  York  law  from  applying  to  them.  They  had  Dr. 
Coope/  testifying  yesterday  that  the  information  that  they  test  is 
so  limited  and  so  finite  that  they  have:  limited  number  of  questions 
that -they  can  ask  and,  therefore,  disclosing  their  tests  would  in  fact 
do  harm  to  the  entire  testing  process. 

Now,  these  are  two  professional  organizations,  that  is  organiza- 
tions dealing_  with  two  of  the  major  test-taking  factions  in  this 
country,  coming  to  those  conclusions.  — 

I  Assume  that  you  looked  at  the  approaches  that  are  taken  by 
those  two  professions  and  I  wonder  if  you  have  drawn  any  conclu- 
sions atall  from  the  varying  positions  which  they  take. 

Ms.  WiGDOR;  The  committee  did  not  and  does  not  in  its  report 
support  one  or  the  other  of  those  positions;  It  does,  I  don't  think  it 
does  in  the  report,  but  it  did  in  its  discussions,  point  out  a  basic 
difference  between  the  situation  of  the  Law  School  Admissions 
Council  and  their  test  and  the  medical  exam  and  that  is  the  law 
school  test  is  not  as  curriculum  bound.  There  is  no  common  pre-law 
undergraduate  education  as  there  is  premed.  Therefore,  their  test 
is  designed  to  be  less  curriculum  bound  than  the  medical  school 
test  is.  Where  that  test,  as  I  understand^ it,  I'm  not  speaking  as  an 
expert,  th§ir  test  is  much  more  dependent  on  having  had  chemistry 
and  having  had  zoology  and  having  had  biology  and  so  forth.  It  s 
much  more,bound  to  a  specific  premed  curriculum.  \ 

That  means  that  their  concerns  could-b[e  justified- and  the  other 
position  could  be  justified  as  well.  Tm  not  an  expert  and  Im  not; 
really  in  a  position  to  say.  The  committee  did  not  excel 

I  would  say  only  that  there  might  be  something  there  that  both, 
both  positions  could  be  justified.  Not  that  either  of  them  is  because 
of  the  differences  in  the  examinations.  ^         .  . 

First,  one  of  the  real  problems  in  talking  about  testing  is  we  talk 
about  tests  but  there  are  tests  and  tests  and  tests  and  each  test  has 
its  on  character  and,  i^  own  uses  and  we're  generalizing  when 
sometimes  the  generalizing  is.  not  furthering  our  understanding. 

Mr.  Weiss.  Without  wanting  to  be  at  all  pejorative  

Ms.  WiGDOR.  Yes? 

Mr.  Weiss.  It's  sort  of— in  talking  about  these  two  groups,  it  puts 
me  in  mind  of  talking  to  two  people,  one  of  whom  says  the  world  is 
round  and  the  other  one  of  whom  says  the  world  is  square  and  yo,u 
come  along  and  say,  I  guess  either  one  of  you  could  be  right. 

Ms.  WiGDOR.  Depending  on -.What  world  you  live  in. 

Mr.  Weiss.  Well,  I,  I  . 
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Ms.  WiGbOR.  It's  not  that  they're—— 

Mr.  Weiss.  I  think,  I  think  that  that's  why  some  of  us,  perhaps 
all  of  us,  are  going  to  have  a  problem  with  the  report  that  you 
come  out  with; 

.  Mr.  GosuN.  Another  answer  to  that  same  question  is  that  not 
enough  time  has  passed  yet  to  see  what  the  potential  results  of,  the 
policies  taken  by  those  two  organizations  are.  I  think  that  there  is 
a  natural  experiment  going  on;  The  law  school  pjeople  did  one 
thing.  The  medical  school  people  did  another.  And  it  will  be  used 
consistently  with  the  committee's  report  that  says  let's  wait  and 
see  what  happens.  .  . 

Mr.  Weiss.  Is  there,  any  reason— I'll  give  you  a  ball  right  over 
yijj^plate — is  there  any  reason  why,  given  the  description  that  you 
ffSe  us  as  to  how  the  committee  arrived  at  its  conclusion,  given 
the  process  that  you  have  observed  these  subconynittees  going 
through  over  the  course  of  the  last  2V2  years,  is  there  any  reason  to 
believe  that  the  conclusion  that  you  have  come  to  is  any  sounder 
than  the  conclusion  that  we  may  come  to? 

Ms.  WiGDOR.  Yes.  Jf  I  may  be  so  bold. 

Mr.  Weiss.  Go  ahead. 

Ms.  WiGDOR.  You  have  a  great  many  things  on  your  plate  all  the 
time.  You  cannot  devote  it,  although  your  steff  people,  I'm  sure, 
devote  a  great  ^eal  of  their  time  to  the  problems  of  testing.  You 
people  cannot jJieyfite- the  kind  of  time  that  the  committee  ivas  able 
to  do  to  the^  questions,  I  think.  I'm  just  assuming  that  you  have 
so  many  responsibilities  in  this  case. 

Mr.  Weiss.  This  committee  has,  in  2  years,  met  a  dozen  times. 
You  ill  4  years  and  your  committee  h^ve  met  a  dozen  times.  I 
assume  that  your  people,  that  is  the  members  of  your  committee, 
do  other  things  than  just  devote  themselves'to  the  committee. 

Ms.  WiGDOR.  Yes;  indeed'we  do. 

Mr.  Weiss.  They  have  professional  lives. 

Ms.  WiGDOR.  Yes.  ^ 
^  Mr.  Weiss.  This  is  sort  of  a  sideline  for  them. 

Ms.  WiGDOR.  Yes;  indeed  they  do. 

Mr.  Weiss.  We  are,  for  better  or  worse,  almost  professional  at 
being  Members  of  Congress  and -this,  most  of  us,  is  the  majpr  com- 
mittee assignment  that  we  have. 

Ms.  WiGDOR.  Yes. 

Mr.  Weiss.  Again,  within  that  context  that  I  asked  as  to,  since 
you're  not  claiming  any  independent  research  or  stetistical  objec- 
tivity or  whatever,  why  your  conclusion  is  any  sounder  than  our^. 

Ms.  WiGDOR.  All  right 

Mr.  Weiss.  And  I  don't  know  what  ours  will  be.  I  know  what 
mine  is,  but  I  don't  kndw  what  the  committee's  will  be. 

Ms.  WiGDOR.  Let  me  approach  the  answer  differently.  Obviously, 
my  first  thought  was  ijpt  a  very  good  one.  My  first  reaction  to  your 
question  was  obviously  not  a  very  good  one.  I  think,  perhaps,  we 
can  get  a^better  answer  by  looking  at  the  functions  yon  are  trying 
to  make  in  policy.       |  | 

The  committee  is  trying,,  not  to  be  Congress  and  make  policy,  but 
to  evaluate  on  the  basis  of  scientific  evidence,  questions  about  test- 
ing and  then  suggest,  ^n  the  basis  of  their  knowledge  of  the  law, 
their  knowledge  of  govei^nment,  their  knowledge  of  the  society,  the 


sociologists,  possible  policy  alternatives  for  people  like  you,  policy- 
makers, to  think^about.  ^   ,  r 

Those  that  came  to  the  committee  were  experts.  Each  of  them 
representing  a  different  area  of  expertise  and  it  was  on  that  level 
that  they  talked.  It  was  on  that  level  that  they  gathered  and 
looked  at  information  and  then  came  to  the  conclusions.  I  think 
that  probably  is  the  fundamental  difference  between  their  group 
.  process  over  the  last  4  yeara  and  your  group  process^  over  the  same 
period  of  time.  .   t  i  i. 

Mr.  Weiss.' Well,  it's  also  possible  to  suggest,  and  again  I  do  not 
do  this  suggesting  ulterior  motive,  but  independence,  it's  also  possir 
ble  io  suggest  that  since  an  awful  lot  of  the  people  on  the  commit- 
tee have  had  or  continue  to  have  some  involvement  with  the  very 
field  that  is  being  questioned  and  explored,  whereas  our  people  are 
not,  to  that  extent,  involved,  that  we  perhaps  may  be  more  objec- 
tive about  it.  '  o  ^  .  1 

Mr,  GosEiN.  This  is  a  classic  problem  that  faces  every  single  com- 
mittee of  the  National  Academy  of  Sciences.  No  matter  what  con- 
troversial issue  we  are  addressing  and  there  are  several  issues 

One  is  how  you  separate  the  scientific  evidence,  the  knowledge 
*  base,  from  the  policy  consideration,  from  the  political  consider- 
ations, and  it  is  not  in  general  the  task  of  the  Academy  to  do  the 
job  of  the  Congress.  We  are  supposed  to  say,  what  do  we  know 

•  about  ^  problem  and  we  leave  the  political  judgments  to  those  per- 
sons elected  to  exei^cise  that  responsibility. 

It  is  also  always  a  problem  In  composing  it's  committees  to  find 
the  experts  that  are  botb  independent  and  expert  and  you  dSh  t  get 
to  be  expert  unless  you  are  involved  in  a  field-and,  therefore,  you " 
"  *  are  ho  longer  independent.  And  we  have  this  problem  -with  all 
Academy  committees  whether  we  are  looking  at  the  effect  of  flu- 
.orocafbdns  oh  the  ozone  layer:  Dow  Chemic€Ll  Co.  scientists  know 
more  about  fluorocarbons  then  anybody  else,  because  they  make 
them,  so  we.  may  want  somebpdy.like  that  on  a  committee  and  ysre 
certainly  wouldn't  have  wanted  to  compose  a  committee  on  ability 
testing  without  having  as  a  member  of  that  committee  some  people 

yiho  know  a^helLof  aJot_abpAt„tefitmg,^   ~t~^~-  xx:  

We  also  feel  that  it  is  very  important  to  try  to  balance  those 

•  kinds  of  expertise  with  many  other  kinds  and,  indeed  with  some  in- 
dividuals who  come  with  a  very  broad  perspective,  like  Bert  Mar- 
shall for  example,  and  so  that's  always  our  dilemma  and  we  try  to 
do  the  best  we  can  in  putting  together  a  committee  that  has  a  bai- 

•  ance  of  perspectives  and  Loan  only  leave  it  to  you  to  judge  from 
the  list  of  members  of  the  committee  and  from  the  report  itself 
when  it  appears  as  to  whether  we  have  done  a  reasonable  job. 

Mr.  Weiss.  The  suggestion  that  Doctor  Wigdor  made  as  to  the  sci- 
entilTc"hafure  of  the  testimony'  that  was  presented— I  think  that  s 
what  you  said— You  know,  w«  received  much  of  the  same  testimo- 
ny, I^uspect. 

Ms.  WiODOR.  No,  I  did  not.  ^  ^ 

Mr.  Weiss.  Well,  how  did  scientific  get  into  the  last  ansvver  that 
you  gaVe  us?  ,      '  ^, 

Ms  Wigdor.  Sorry,  I  meant  that  there  were  members  of  the  com- 
mittee who  were  qualified.  Statisticians,  for  example,  who  were 
qualified  to  do  analyses  of  tests  and  present  to  the  rest  of  the  com- 
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mittefe  who  did  not  have  the  quantitative  abilities  really  expert 
opinions  about  the  tests.  That's  what  I  mean  by  scientific.  There 
were  legal  scholars  who  were  in  a  position  to  present  to  the  other 
.  committees  who  did  not  have  their  expertise  expert  information  . 
about  the  requirements  of  law  or  whatever.  In  other  words,  each  o(/ 
these  people  oh  the  committee  had  some' kind  of  scientific  or  other 
expertise  with  which  he  could  bring  or  she  could  bring  to  the  prob-  . 
lems,  we  j^re  looking^at.  In  that  sense  I  meant  scientific  expertise. 

Mr.  Weiss.  You  know  frdm  observing  these  hearings  that  we  too 
had  some  scientific  testimony.  On  both  sides  of  the  issue,  I  might 
say,  and -many  times  those  people  were  in  diametric  oppostion  with 
one  another. 

Ms.  WiGDOR;  I  beg  your  pardon? 

Mr.  Weiss.  Pardon? 

Ms.  WiGDOR.  I  didn't  hear  your  last  question. 

Mr.  Weiss.  I  said  some  of  them  were  in  diametric  opposition  to 
one  another  and,  again,  I  don't  know  the  composition  of  your 
board.  I  don't  know  who  the  nxembers  of  that  committee  are,  but  I 
would  be  surprised  if  it  in  fact  included  people  who  were  very 
strongly  questioning  of  the  field  of  psychometrics  a^id  the  whole 
testing  area  and,  if,  in  fact  they  would-  come  up  with  the  kind  of 
conclusion  that  you  suggested.  That  is,  of  just  watching  aiid  let  it 
go  by  to  see  how  it  develops,  because  the  impression  that  we  got  in 
the  course  of  our  hearings  .was  that  there  really  is  a  veiy  serious 
amount  of  sOul  searching  going  on.in  the  field  at  this  point,  on  the 
part  of  people  who  have  spent  tlie  bulk  of  their  lives  in  the  field,  as 
to  whether  what  they  are  doing  .is  at  all  yalid,  whether  it's  con- 
structive, all  kinds  of  questions. 

Ms.  WiGDOR.  I.can  assure  you  that  within  the  membership  of  the 
,  committee,  the  opinion^^ranged  very  widely  as  to  the  value  of  tests. 
There  were  a  number  of  committee  members  who  considered  them 
extremely  valuable  for  selection, .for  assessment.  There  were  other 
Committee  members  who  thought  they  were  relatively  trivial  in  the 
grand  scheme  of  things. 

Mr.  Wbiss.  Somebody  who  said  they  were  postively  harmful? 

Ms.  WiGDOR.  Yes.  I'm  trying  to  remember  and  be  absolutely  ac- 
'curate.  There  were  comniittee  members  who- argued  that  position 
very  strongly.  I  think  what  the  committee  did  not  have  in  it's 
membership  were  people  who  were  essentially  advocates  and  I 
think  that  the  Agjidemy  tries  for  the  very  reasons  Dave  has  dis- 
cussing before,  to  avoid  that,  kind  of  committee  composition  because 
we  are  aiming  for  reports  that  are  dispassionate,  that  can  weigh 
and  balance  and  look  at  the  whole  situation. 

In  regard  to  the  second  part  of  your  question,  yes,  there  obvious- 
ly is,,  diametrically  opposed  opinion  offered  in  part  by  people  who 
6re  considered  experts,  in  part  by  laymen,  and  I  guess  the 
committee's  position,  instead  of  just  sitting  in  the  middle,  is  saying, 
look,  a  lot  of  these  questions  simply  cannot  be  answered  yet  and 
until  you  can  answer  them,  solution's  aren't^known. 

Mr.  GosuN.  Moreover,  I  don't  see  any  reason  why  our  committee 
and  your  committee  "can't  come  out  in  a  different  place.  You're  op- 
erating on  the  rationale  for  your  decision  may  include  some  things 
that  were  not  part  properly  of  the  rationale  for  our  committee  s 
proposal. 
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Mr.  Weiss.  All  J  was  asking  foj  was  whether  in  fact  there  Vvas 
any  reason  to  consider  your  cdnclusions  to  be  at  a  higher  level 
than  OCXS.  .  ^  ' 

Mr.  608UN.  At  a  different  level.  I  wouldn't  put  higher  pr  lower 
on  that. 

"   M^.  WiGDOR.  I  would  say  there's  certainly  reason  for  our  report 
.  tp  receive,  at  your  hands,  a  good  deal  of  serious  consideration.  I 
would  not  say  that  this,  our  report  should  be  the  only  or  one  of  the 
•  two  or  three  de^rmining  factors  in  your  decisions. 

Mr.  ]^Eiss.  I  guess  I  have  one  substantive  question.  I  thought 
that  proc^  was  important  to  go  into,  especially  since  we  don't 
have  the  report  itself  in  front  of  us. 
Ms.  WiGDOR.  Yes. 

Mr.  Weiss.  The  title  of  your  committee  is.  Committee  on  Ability 
^  Testing. 

Ms.  WiGDOR.  Yes. 

Mr.  Weiss.  And  we  have  had  some  exploration  from  time  to  time, 
not  as  to  the  word  ability,  but  as  to  the  word  aptitude  because 
that's  what  the  SAT,  the  A  in  the  SAT  is  aptitude,  and  I  think  in 
the  course  of  these  hearings,  we've  moved  at  least  some  extent  in 
redefining  what  is  meant  by  the  word  "aptitude,"  and  I  wonder 
how  you  defined  the  word  "ability." 

Ms.  WiGDOR.  That  name,  that  word  was  chosen,  thank  you,  that 
word  was  chosen  with  some  malice  aforethought  because  the  tradi- 
tional words,  "aptitude"  and  "achievement,  are  loaded  with  all 
sorts  of  baggage  that  destroys  rational  discussion  ^t  this  point. 
"Ability"  was  chosen  as  a  more  neutral  word  and,  in  a  sense,  an 
umbrella  word.  The  words  "aptitude"  and  "iachievement"  were 
thought  to  be,  originally  I  guess,  two  different  kinds  of  things.  One, 
native  ability  that  was  there  in  the  genes  and  the  other  from  what 
you  leayied  in  school.         .         •  ' 

The^mmittee's.  position  is  that  this  is  an  unnatural  distinction 
therefore,  it  uses  the  word  "ability"  it  uses  "achievement"  and  "ap- 
titude," it  couldn't  avoid  it  entirely.  It  tries  to  make  the  point  that 
these  are  words  that  talk  about  two  ends  of  the  continuum.  No 
knowledge  springs  full  blown  from  someone's  brain.  Np  knowledge 
is  only  a  pr(>^uct  of  experience.  Jt  is  a  product  of  environment  and 
the  brain  working  together  and  that's  what  we  mean  by  ability. 
Whatever  the  developed  ability  is  at  the  moment  of  testing  is  what 
we  are  talking  about.  It  comes  from  a  multitude  of  sources. 

,Mr.  Weiss.  Thank  you. 

Mr.  Erdahl. 

Mr.  Erdahl.  Thank  you,  Mr.  Chairman. 'Let  me.  Doctor  Wigdorr 
just  read  from  a  couple  observations  you  make  in  your  statement. 
From  these  I  will  have  a  question  and  another  observation, 
page  2  it  said:  "  ^  4' 

It  is  lurpriiing  to  learn,—  however,  that  the  great  mwority  of  undergraduate  in* 
•titutioni  arc  hot  very  iclective  and  that  teat  scores  GPA^s  arc  likely  to  present  bar- 
riers only  to  these  who  rank  low  among  high  school  graduates  and  to  that  small 
group  of  applicants  who  want  to  attend  the  most  selective  colleges  and  universities, 
for  the  most  part,  the  elite  private  schools. 

And  then  the  other  observaition  was  toward  the  end  of  your  state- 
ment on  page  10: 
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^  The  proposed  test  discloeure  bill  does*not  directly  influence  the  behavior  of  the 
actqal. decision  maker,  the  educational  institution,  and,  therefore,  will  not  necessar- 
ily have-^much  effect  oo  how  tests  are  used. 

I  understand  from  Chairman  Weiss'  perspective,  his  bill  does  not 
attempt  to  get  at  any  oi;e  or  group  of  testing  companies,  but  rather 
^  what  impact  the  tests  have  on  students.  Obviously,  the  bill  Would 
have  some  impact  on  testing  companies.  Til  ask  both  of  you,  what 
in  your  educated  judgment  is  the  ultimate  impact  on  the  student  or 
potential  students  to  a  university  or  institution  of  learning? 

Ms.  WiGDOR.  Of  full  disclosure? 

Mr.  Erdahl.  Yes,  right,  of  the  bill.  That's_what  I  mean,  the 
impact  of  the  bill. 

Mr.  GosLiN.  You're  getting  back  to  the  bill? 

Mr.  Erdahl.  Yes.  ^  ^ 

Mfe.  WiGDOR.  I  think,  you  know,  you  put  the  two  statements  to-, 
gether.  for  a  majority  of  applicants  in  undergraduate  institutions; 
disclosure  Ipjpbably  will  not  affect  their  educational  future.  They 
were  goingTo  be  accepted  anyhow. 

Mr.  Gosuj*.  Or  not  accepted.  ,\ 

Ms.  WioDOR,  Or  not  accepted  anyhow,  right.  No,  for  the  msgorify, 
they're.going  to.be  accepted.  _ 

For  the  minorities  at  the  two  ends — that  is,  the  students  who 
aspire  to  attond  a  highly  selective  school— I  mean  disclosure  comes 
after  the  fact.  I'm  not  sure,  I'm  not  sure  what  the  effect  would  be 
;  in  either,  for  either  of  the  groups  for  whofti  testing  might  make  a 
difference. 

If  the  assumptions  of  some  supporters^  perhaps  Mr.  Weiss,  I  don't 
know,  if  some  supporters  of  disclosure  are  correct,  if  the  assump- 
tions are  correct  that  test  quality  will  improve  because  of  disclo- 
sure, everybody  benefits,^  and  particularly  tho?**  for  whom  the  test 
score  is  a  real  criterion  of  admission. 

If  test  quality  declines,  I  guess  everybody  loses  a  little  bit. 

Mr.  GosuN.  The  more  a  test  taker  knows  about  the  requirements 
of  the  test  and  what  kinds  of  skills  he'll  be  required  to  demonstrate 
on  the  test,  the  better.  The  more  likelihood  that  mistakes  or  errors' 
•     can  be  corrected  or  there  is  an  appeal,  the  better. 

It  seems  unlikely  to-me  that  very  large  numbers  of  test  takers, 
very  large  proportions^  are  going  to  ask  for  their,  going  to  ask  Tor 
their  answers  and  full  copies  of  the  tests  and  so  on.  We  haven't 
seen  evidence  that  that   a 

Ms.  WiGDOR.  Well,  there  is — r 

Mr.  GosLiN  [continuing].  Is  widespread. 
.  -  Ms.  WiGDOR.  No;  there  is,  however,  some  interesting  evidence  on 
" that  Apparently  the  number  of  students  who  will  request  their 
test  forms  is  very  much  a  functioa  of  how  much  they  have  to  go 
through  to  request  them. 

Mr.  GosuN.  Like  everything  els^. 

Ms.  WiGDOR.  Right;  I  mean  if  you've  got  to  pay  your  $4.25  and 
write  a  letter,  not  many  are  going  to  request.  If  on  the  other  hand 
you  can  check  off,  when  you  walk  into  the  place,  more  are  going  to 
request.  So  that^s^  that  all  remains  to  be  seen.  That's  one  of  the 
questions  that  remains  to  be  seen  .p  Our  people  actually  are  going  tp 
•  ask  for  this  information.  If  they  do,  is  this  somehow  going  to 
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reduce  test  anxietv  for  the  next  generation  or  something.  It's  not 
•  obvious  that  it  will  have  any  dramatic  effect,  but  it  might  ^ 

Mr.  Erdahl,  ok.  Another  question  and  obviously  ydu  don  t  have 
to  answer,  but  for  reasons  that  thie  other  witness  is  not  here,  you 
might  not  wish  to  respond  to  this,  but  I  think  both  of  you  were 
here  when  the  previous  witness  t^ked  about  the  FTC  s  work  on 
testing.  Would  either  of  you  care  to  comment  on  that? 

Mb.  Wigdor.  Only  briefly  and  not  as  myself  being-an  expert.  I  ^ 
can  only  repeat  some  of  the  general  conclusions  that  the  committee 
drew  abbut  the  coaching  question.  .  v 

One,  they  were  not  convinced,  they  were  not  satisfied  with  tne 
kind  of  evidence  that  is  available  on  coaching.  The  research  studies 
are,  have  a  lot  of  problems.  The  FTC  data  analysis  had  some  prob- 
lems and  the  othere  do,  too.  It's  very  hard  to  get  comparable 
groups,,  some  of  whom  have  taken  a  test  and  some  of  whom  have 
not,  and  compare  scores.  From  a  scientist's  point  of  view,  the  data 
isn't  very  clean.  Therefore,  it's  sort  of  hard  to  make  any  accurate 
assessment  of  the  value  of  coaching. 

On  the  other  hand,  when  you  start  talking  about  long  numbers 
of  hours,  you're  talking  about  learning.  The  committee  realized 
that  there  is  a  problem  of  semantics  and  ultimately  came  to  th,e 
cohciusioh  that 'although  information  ii^  partial,  the  research  base 
is  hot  terribly  good.  It  would  be,  since  these  tests  are  so  wide- 
spread, it  would  be  useful  for  schools,  high  schools,  to  make  a 
modest  effort  to  inform  students,  coach  students  if  you  will,  on  test 
taking  techniques.  • 

I  mean  clearly  all  students  should  know  whether  or  not  on  a  test 
facing,  them  it  pays  to  guess.  Some  students  don  t  know  that.  So  the 
comiri'ttee.felt  that  it  would  be  important  for  high  schools  to  m^ 
sure  that  the  students  go  into  the  testing  situation  knowing  the 
basics  of  test  behavior  .  .     ,    i.  .  .     u   i  \u 

In  terms  of  any  longer  term  coaching  in  the  nigh  schools,  jne 
committee  felt  that  in  so  far  as  the  content  of  any  coaching  instruc- 
tion was  real  content  just  things  they  should  be  learning  anyhow, 
,  reading  and  writing  and  arithmetic,  fine,  you're  riot  going  to  lose 
anything.  On  the  other  hand,  if  it  m^es  a  reed  distortion  of  the 
high^school  curriculum,  it's  probably  not  a  very  good  idea  at  all. 

Mr.  Erdahl.  Interesting  observation.  It  coincides  with  •something 
we  heard  earlier  today  and  this  is  riot  an  official  definition,  but  I 
guess  mine.  If  you  study  for  4  or  5  hours  before  the  test  with  some 
special  people  it  might  be  coaching.  If  you  do  it  for  30,  40  hours,  it 
might  be  fpore  of  a  learning  experience.  I  agree  that  we  get  in  to  a 
.  queetion  of  semantics,  but  you  made  the  point  about  some  basic 
things.  I  hope  that  our  schools  would  stress  them^  whether  to  move 
along,  don't  skip,  if  you  don't  know— guecw,  these  thingis  that  I 
think  most  of  us  had  to  do  to  survive  tests. 

Ms.  WiODOR.  Sure,  arid  I  think  that  the  testing  companies  can 
also  corftribute  a  lot  by  making  that  very  information  much  more 
explicitly  available" to  test  takers  in  their  information  packet.^ 
There  is  no  reason  not  to  instruct  students  in  test  taking  te<:h-^ 
niqu^  then.  They  may  indeed  it  right  now.  I  don't  know.  They 

didn't  lised  to.  '       ,        i  rtu  • 

Mr.  Erdahl.  Thank  you  very  much  and  thank  you,  Mr.  Lhair- 

 man;—   ^ 
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Mn  Weiss.  Thank  you' 

On  the  question  of  how  important  it  is, since  the  majority  of  stu- 
dents get  into  their  college  of  the  first  choice,  in  any  event,^ar\d  it's  ' 
'  only  those  who  apply  to'the  elite  schools  wht>  might  pr  might  jiot  - 
be.  disadvantaged  by  not  bweing,  not  taking  the  coaching  courses  or 
not  haying  their  test  scbres  improved  by  the  minimal  number  of 
points,  that  would  in  fact— don't  you  think  that  that's  important  as 
to  whether  in  fact  someone  gets  mto  one  of  the  elite  schools  or  not 
if  ihat's  what  he  or  she  has  his  or  her  heart  set  on. 
/Ms.  WiGDOR.  It's  important  to  that  individual.  The  comrriittee 
^  vas  not  convinced  that  it's  socially  important  enough  tp  justify  or 
/require  legislation  and  I  think  the  committee  was  particularly 
bothered  by  two  things  that  are  present  in  the  movement  for  truth 
in  testing  or  test  disclosure. 

One,  there  seems  to  be  a  ^eat  hope  that^somehow  the  disadvan- 
taged, the  minority  student,  is  really  going  to  benefit  from  this  and 
then  this  other  thing,  the  privileged  student,  I  meail  th§^  students 
we're  talking  about  who  want  to  go  to  ihe  elite  schools  are^by  and 
large  the  privileged  members  of  our  society.  The  two  impulses  do,^ 
not  coincide  if  you  see  what  I  mean  and  I  think  the  subcommittee 
would  say-^notice  there  is  a  hesitation-^I  think  the  sulxiommittee 
would  say  that  the  fate:i?JLtM:Yery  privileg€fd  student  is  fairly  well 
taken  care  of  in  this  society  anyhow  and  probably  should  not,  that 
concern  proba^bly  should  not  be  the  basis  for  national  legislation. 

Mr.  Weiss.  I'm  ver/  rarely  identified  with  being  overly  concerned 
about  the  rights  of  the  ovetly  privileged,  but  I  must  tell  you  that  I 
would  be  concerned  if  in.  fact  we  adopted  policies  or  didn^t  adopt 
policies  because  they  only  affected  the  rights,  of  the  advantaged, 
and  I'm  not  sure  that  you'ye  really  thought  your  .position  through 
as  carefully  as  you  would  like  to. 

Ms.  WiGDOR.  That's  probably  .quite  true.  I'm  responding  .to  a 
question. 

Mr.  Weiss.  Yeah.  ,1,^ 
.  Ms.  WiGDOR.  And  I'm  on  the  spot  and  you  notice  I  hesitatetK 
Mr.  Weiss.  Yeah. 

Ms.  WiGDOR.  Nevertheless,  I  point  out  that  there  is  a  problem 
with  the  hbpes  of  many  that  truth  in  testing  is  going  to  help  the 
disadvantaged  and  the  question  you've  asked  about  what  

Mr.  Weiss.  As  a  matter  of  fact,  it  may  very  well  be  that- it's  the 
disadvantaged  minority  kid  who  wants  to  get  into  Harvard  or  Yale 
•  who  may  in  fact  be  the  beneficiary  of  the  additional  25  or  30  or  40 
points  which  will  make  the  difference  as  to  whether  he  or  »he  is 
cut  off  or  not  ^ 

Ms.  Wjgdor.  ok.  let  me  answer  your  question  a  better  way  then. 
I  am  now  thinking  through  the  report  and' through  the  chapter  and 
indeed  the  committee  would  have  given  you  a-different  answer  and 
that  is,  and  perhaps  this  is  one  of  the  more  important  points  of  this 
discussion  of  college  admissions.  That  is  that  no  test  score  should 
be  the  sole  factor  in  admissions  de^cision. 

Mr.  Weiss.  That's  true,  but  in  the  basis  of  your  research,  have 
you  in  fact  not  found  that  a  large  number  of  colleges  and  universi- 
ties use  the  test  scores  as  a  cut  off? 

Ms:  WiGDOR.  Yes.  And  that  is  to  be  recommended  against.  Yes, 
that  is  Kue. 
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^  * 

It's  usually  a  very  lovy  cut  off,  nevertheless,  we  recommended 
*  against  it's  use.  \  ,  .  ,* 

Mr.  GosuN.  It  depends  on  the  school,  obviously.  ^   .  ^  - 

Ms.  WiGDOR.  It  depends  on  the  school,  yes.  We  do  indeed  recom- 
mend against  the  use  of  scores,  .cut  off  points,  with  these  kinds  of 
tests  and  some  other  kinds  as  well.  Yes,  indeed. 

Mr  Weiss.  Well,  I  thank  you  very,  very  much  for  your  t^timo- 
ny  I  look  forward  to  "reading  the  full  text  of  the  rep«ort  and,  per- 
haps, we  will  have  you  back  another  time  when  we  have  the  bene-* 
fit  of  the  report  itself.  /  ,   ,  r      '  j 

Ms.  WiGDOR..  Thank  you,  and  I  hope  we  can  look  forward  to 
seeing  you  February  2.  ' 
.  Mr.  Weiss.  Well,  I  look  forward  to  it. 

Mr.  GoeuK.  Thank  you  very  much. 

Mr.  Weiss.  Mr.  Kaplan,  you  have  been  the  personification  ot  pa- 
tience* 

Mr.  Kaplan.  Inside,  not  so,  not  so  true.  ,    x     •  i. 

Mr.  Weiss.  Well,  I  very  much  appreciate  your  volunteering  to 
come  down,  responding  to  our  request  to  come  down.  Then  patient- 
ly sitting  through  everyone  else's  testimony  and,  without  objection, 
your  entire  statement  will  be  entered  into  the  record  and  you  may 
proceed  as  you  so  desire.  You  may  read  it  in  it's  entirety,  excerpt 
from  it,  summarize  it,  whatever  you  think  is  most  appropriate. 

[The  prepared  statement  of  Stanley  Kaplan  follows:] 
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P»wai«0,Statij«nt  or  Stanley  H.  Kaplan,  Founder,  Stanley  H.  Kaplan 
\  .IIDUCATIOKAL  Center 


I  apprccicl^^e  this  opportunity  to  speak  about  Ff.R.  166?. 

Permit  mc  to  introduce  my^self.     I  aii\  the  founder' of  .  the 

'»  •    \  • 
Stanley  H.  Kaplan  Educational  Center  and  have  dedicated  more  ^ 

\'  ' 

than  40  years  to  the , development  and  review  o/  academic 
skills  and  content  in  preparation  for  tests  at  the  , high 
school  and  colle^je  levels..  I  began  my  career  as  ao  educator 
long  before  most,,  starxiardized^  tests  were  even  a  gleam  in  the 
testraaker*s  eyes.. 

First  let  ne  say  that  I  support- the  L-asic  premi'se  of  ^  . 
H.p.  1662  —  that  the  public  (including  citizens,  educators, 
and  students)  should^  be  made  fully  aware  of  the  subject 
matter,  uses  and  procedures  in  which  standardized  tests  are 
developed  and  administered.     I  am  pleased  Lliat  H.R,  1662, 
while  suggesting  constructive  changes  xn  standardized  test 
procedurGw,  does  not  attacK  standairdized  tests  themselves. 
Standardized  tests  do  have  their* place  in  the  admissions 

« 

jjicture  —  a  very  important  j>lace.    Thei;  more  directly  test.  • 
the  skills  and  ubilities  that  are  needed  by  students  at  . 
higher  levels  o£  education.    One's  grade  point  average  is  an 
insufficient  criterion,  oy  itself,  to  evaluate  skills  and 
abilities.    Secondary  schools  and  colle.'^es  htwe  different 
standards,  and  grades  are  frequently  inflated.  Certainly 
standard i*zed  t^sts,  together  with  the  student's  GPA,  give  a 
more  accurate  picture  of  the  student's  ability  than  does 
either  tr.oasurc  independently.  % 

y 
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standardized  U-^^.ts  arc  inujortant  in  evaluatiiHj  the 

skills  ot  an  increasing  number  o£  adults ^ho  are  returning 

to  schopl  after  many  years.     StanS^^rdizod  test^,  SXso 'serve 

as  an  tljel^ent  devic<^  _for  motivating  studencs  to  sit  down 

for  serious  study.      |/hen  Jthe  Wirtz  report  wa§  xrelcased 

shc.wmg  the  steady  decline  in  SAV  scores,  .enrollments  in  my 

classes  showed  a  dramatic  increase  despite  the  decreasing 

importance  of  SAT  scores  in  college  admissions.  Parejits 

were  concerned  about  their  children 'ii  weak  math  and  vcpbal 

.skills  which- they  believed  might  impede  their  children'^ 

success  at  college..    -Standardized  tests  also  help  to  identify 

-underachievers  mciading  disadvantaged  students.    My  years 

of  oXpc^rxencc  as  an  educator  and  as  a  test^  pro\parer  have 

shown  me  ttiat  an  economically  and  socially  disadvantaged 

*  *  \ 

student  scoring  a  5S0  (on  a  200, to  800  scalrj)  ha|j  as  much 

potontia-l  as  a  student  born  with  a  golden  aducatiot^l  spoon 

in  his\mouth.  ^  ^ 

•  I  have  dealt  with. some  ot  the  benefits  of  standardized 
testing  because  there  art.  many  who  would  like  to  eliminate 
standardised  admissions  tests,  and  view  this  bill  as  H  first 
step  toward  the  eventual  elimination  of  all  standardizecT 
testing  as  a  means  of  ovaluatinc  students  for  pot^tsccondary 
school  admistjions/         "  •    *     .  ^ 

\ 

To  reiioat,  the  basic  premise  of  II. R.  166^  is  sound. 
I  believe,  however,  that  certain^ urovisions  in  the  bill  are 
.ill-advx:^ed  and.  unworkable.    One  of  thci>e  provisions,  -section 
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5,  requires  testin9  agencies  to  release  tc  the  test  subject 
a  copy  of  the  test  questions  along  with  an  answer  key  and  a 
copy  of  the  test  subject's  answers.    This  poses  a  number  of 
problems.    Test  construction  is  a  time-consuming  and  expensive 
process.     It  includes  writing  test  items  and  then  standardizing 
t».em  so  that  the  test  subject  can  be  properly  evaluated. 
The  nature  of  some  tests  restricts  the  number  of  test  items 
that  can  be  developed.    Accordingly,  valid  cests  cannot  bo 
produced  on  an  assembly  line  basis-     If  tests  are  to  be 
released  after  every. administirifcLion,  the  number  of  test 
administrations,  must  necessarily  ^decline  —  perhaps  to  zero. 
This  is  clearly  'borne  out  by  events  that  have  occurred  since 
the  Mew  York  State  Education  Act  took  effect.     Tor  exanplo, 
the  April  LSAT  exam  was  eliminated.    The  ORE  exam  in  New 
Vork  State  will  not  be  given  next  Apr;.!  or  June,  although  it 
will  bo  administered  throughout  the, rest  of  the  country. 

LSAT  and  GMAT  will  be  administered  in  June'  bn  a  Wednesday 
evening.    The  AAMC  has  obtained  an  injutiction  against  applying 
the  disclosure  provisions  of  the  New  York  law  to  the  MCAT. 
Stifall  volume  exams  such  as  the  VAT,  OCAT,  PCAT,  DAT  and 
College  Board  Achievement  Tests  were  not  administered  iri  Now 
York  State  until  a  series  of  amendments^  exempted  thejse  tests 
from  test  disclosure.     The  reasons  are  clear        tests,  cannot 
be  mass  produpod  at  will-. 

In/.vi^w  of  these  problems,  why  should  we  even  have  tast 
disclosure?    luoponcnts  of  test  disclosure  claim  that  there 
IS  a  need  to  rclccrsc  tost  jgucsLions  to  sLudcaLt»  &o  that  Lhey 
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will  not  have  to  pay  lar^je  sums  of  money  to  coaching  'chools. 
There  is  no  evidence  at  all  to-  support  tliis  proposition. 
Students  are  not*' attending  coaching  schools  to  obtain  test 
questions;  they  are  looking  for  academic  interaction  with  a 
teacher.     Students  are  looking  for  an  organized  commitment  ^ 
to  review  materials  they  may  liave  learned  years  .ago,  and  to 
improve  skills  that  were  never  fully  developed.     After  all, 
questions  of  the  type  that  appear  on  the  tests  have  been 
available  in  review  books  for  years. 

Releasing  test  questions  has,  instead  of  loading  to  the 
demise  of  coaching  schools,  encouraged  their  growth  —  with 
some  schools  c/en  advertising  they  have  the  released  questions 
After  all,  when  the  Regents  examinations  were  important  in"^ 
New  York  State,  I  had  thousands  of  students  l^teparincj  for 
these ^xami-natJLons  even  though  the  exams  were  loleased,  and 
^veil  though  I  myself  wrote  the  test  er.p  la  nations  in  the 
Barron's  Regents  Series.     The  CPA  examination  is  perhaps  the 
most  coaciied-for  examination;  yut  the  questions  are  released 
along  with  full  explanations.     As  I  had  predicted  in  a 
letter  to  Governor  Huga  Carey  before  the  New  York  Standardized 
Testing  Law  was  enacted,  my  enrollments  have  increased 
significantly  for  the  released-tests  —  LSAT,  GMAT,  GRE, 
and  SAT  —  l^iut  have  remained  at  a  plateau  for  other  tests. 


-"^See  attaciied  advertisement  from  the  New  York  Times  (p.  8)  . 
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In  adcULion  to  some  of  the  problems  I  have  with  tost 
disclosure,  I  am  concerned  that  some  of  the  scatistical 
correlations  the  bill  mandates  may  be  difficult  to  develop. 
How  cart  one  make  any  correlation  between  t^^st  scores  and 
success  xn  a  career?    After  all,  how  does  one  measure  success? 
How  can  one  draw  conclusions  about  the  extent  to  which  test 
preparation  courses  improve  test  scores?    There  are  literally 
thousands  of  programs  of  all  kinds  given  in  teacher's 
baseraentii,  in  community  centers  teaching  adult  education,  in 
high  schools,  and  in  colleges.     It  is  impossible  to  identify 
the  students  being  coached,  <jC  to  develop  a  statistically 
valid  means  of  measuring  the  amount  of  improvement  because _ 
of  coaching.     Besides,  even  if  conclusions  could  be  drawn 
about  the  extent  .to  which  test  preparation  courses  improve 
test  scores,  the  "poorer"  cram  courses  vwould  be  permitted  to 
take  a  "free  ride"  on  the  benefits  afforded  by  effective 
test  preparation  cooirses.    All  test  preparation  courses  are 
not  created  evjual.     Even  now,  ther6  are  "quack"  correspondence 
courses  that  are  using  the  results  of  the  FTC  investigation 
concerning  the  SAT  to  promote  other  test  preparation  courses  >• 
th^it  v^ere  not  eveOLStudied  by  the  FTC. 

Another  problem  I  have  with  II.R.'^-X662  is  that  the 
diyclui.urci>  introduce  a  number  of  ineijuiticy.     Ucguiring  the 
testing  agency  to  release  information  has  proven  to  be 
extraordinarily  costly,  and  has  already  been  reflected  in 
the  prices  paid  by  the  students  to  take  standardized ' tests . 
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It  IS  unfair  to  expect  tiic  economically  disadvanta^jed  student 
to  pay  these  increased  costs.     I  also  believe  it  is  unfair 
to  require  disclosure  on  high  volume  tests  while  exempting 
low  volume  tests  from  disclosure.    If  it  is  so  important  to 
see  the  test  questions,  why  deny  the  student  who  is  taking  a 
low  volume  test  this  "important"  opportunity? 

So  far  my  testimony  has  offered  only  criticisrrts  of 
various  provisions  in  the  proposed  legislation.     I  do, 
however,  have  some  suggestions^    In  section  4 (a) (b) ,  for 
example,  it  would  be' more  meaningfifl  to  determine  the 
.relationship  between  the  grade  point  average  of  students  and 
their  income,  ethnic,  sex,  and  handicapped  status  rather 
than  the  relationship  betweqh  these  demographic  factors  and 
a  standardized  test  score.    After  all,  it  is  the  CPA,  and 
the  achievement  level  through  high  school  and  college  that 
IS  stxll  the  si.jnif  leant  factor  in.  admissions .    A  standardized 
test  IS  sipiply  a  mirror  of  academic  achievement  in  school. 

With  regard  to  the  release  of  examfriuion  questions,  I 
have  found  in  my  talks  with  thousands  of  students  that  their 
chief  concern  revolved  around  the  correct  scoring  of  their 
examinations.     Their  interest  in  actually  seeing  and  gding 
over  the  quetitions  was  minimal.    After  all,  they  had  already 
taken  the  test.  *  I  have  at  times  offered  to  go  over  questions 
students  may  have  had  about  their  released  tests.     But  there 
have  been  very  .few  takers.    My  sugcjestion  is  that  testing 
organizations  be  required  to  send  each  test  subject  a  copy 


873 


875 

of  that  subject:,  answer  ond  a  copy  of  the  corrected 

answers  so  the  student  can  check  the  scoring.     I  do  not 
believe  that  tests  should  be  released  after  each  admxnistratxon, 
but  instead  once  in  every  four  administrations  and  to  every 
student  t>efore  he  6i  she  takes  the  test.     Releasing  tests 
once  in  every  four  administrations  would  lessen  the  pressures 
on  the  testing  agencies,  allov/  the  tests  to  be  given  more 
frequently,  ^nd  still  give  consumer  grotips  and  educators  an 
opportunity  to  judge  the  accuracy,  ambiguity  and  possible 
cultural  bias  of  the  questions. 

Finally,  I  would  like  to  say  bravo  to  section  2(a)(2) 
of  the  proposed  legislation.     I  agree  that  "there  is  a 
continuous  need  to  insure  equal  access  for  all  Americans  to 
educational  opportunities  of  hicjher  quality."    The  testing 
process,  however,  has  only  minor  relevance  to  the  equal 
access  of  educational  opportunity.     When  we  talk  about  equal 
dcces^s  we  should  emphasize  assistance  to  deteriorating 
schools  and  to  disadv^antaged  students  who  just  are  plain  not^ 
learning.     In  fact,  there  are  many  who  aren*t  even  aware 
that  equal  educational  opportunities  are  available.     We  must 
endeavor  to  provide  adequate  education  to.  all,  so  that 
evoryon9  can  fulfill  his  full  potential.    This  is  the  area 
in  which  wc  should  concentrate  our  energies.     This  is  where 
the  consumer  —  the  student  —  is  being  shortchanged.  Given 
equal  educational  opportunities  there  should  be  fewer 
inequities  as  far  as  testing  is  concerned. 
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STATEMENT  OF  STANLEY  H.  KAPLAN,  FOUNDER,  STANLEY  H. 
KAPLAN  EDUCAl^IONAL  CENTER 

Mr.  Kaplan.  Well,  I  appreciate  being  last  because  one  learns  a 
lot  from  theiprevious  speakers  and,  therefore,  I  sort  of  scrapped  my 
whole  official  presentation  that  we  submitted,  that  I  submitted, 
-  and  from  there  {  have  taken  some  notes.  It  follows  along  the  same 
lines^but  I  have  learned  a  lot  from  this  and  I  hope  that  you  may 
find  valuable^some  of  the  

Mr.  Weiss.  And^there's  no  fee  involved? 

Mr.  KaplaNv  So  I  appre^ate — I,  myself,  decided  to  come  here. 
When  I  was  at  the  National  Education  Association  convention  to 
which  I  was  invited,  in  Michigan,  to  speak  on  how  to  prepare  for 
the  SAT.  The  NEA  is  quite  opposed,  in  ^elieral,  to.  standardized 
testing  or  at  least  very  much  in  favor  of  the  release- ofjest  ques- 
tions, but  Congressperson  Chisholm,  in  a  speech,  she  was  talking^ 
about  this  truth-in-testing  if  you  want  to  call  it  that.  I  like  to  call  it 
standardized  testing  or  something  like  that  because  I  think  the 
former  is  a  sort  of  pejorative  appellation,  but  she  said  if  we  have 
this  bill  passed,  then  students  will  no  longer  have  tp  pay  $300  to  go 
to  coaching  schools  and  since  my  fee  is  about  $300,  I  figured  she 
was  talking  about  my  program.  Iliat's  the  reason  why  I  felt  Td  like 
to  present  some  of  my  opinions,  some  of  my  views,  because  I  have 
had  the  most  experience  directly,  I  hear  this  talk  about  coaching, 
the  effects  and  I  experience  this  with  students. 

Vd  like  to  tell  a  little  bit  about  myself.  Ym  the  founder  of  the 
Stanley  H.  Kaplan  Educational  Ctentera;,JVe,alffiaysJo ved io^^teach, 
from  high  school  on  when  I  was  paid  25  cents  an  hour  as  a  tutor, 
and  believe  me,  I  have  been  coaching  long  before  a  standardized 
test  was  a  gleam  in  a  testmaker's  eye.  These  tests  weren't  around 
and  I  don't  think  that  coaching  should  be  tainted.  It's  not  a  tainted 
word.  I  think  there  are  many,  many  beneficial  effects  of  coaching. 
Coaching  existed  long  before  the  SAT  or  the  others  came  about. 

I  today  meet  former  students  who  are  professionals  now,  doctors, 
lawyers,  who  might  have  dropped  out  of  high  school,  might  have 
dropped  out.  of  college  if  they  didn't  have  the  support  at  the  time. 
That's  why  when  you  have  coaching,  it's  not  unfair,  coaching  is  re- 
medial work.  It's  a  kind  of  supportive  work.  It  has  nothing  to  do 
with  admissions  testing  itsel|»-lt  will  always  be  here.  What  will  you 
do  if  the  standardized  testing  act  goes  through?  You'll  be  finished.  I 
say  there  will  always  be  a  need  for  coaching,  for^preparation  for 
tests,  for  remediation. 

I'd  like  to  say  first  of  all  that  the  basic  premises  of  this  H.R. 
6612,  is  it?  Is  that  the  right  number?  1662,  sorry. 

Mr.  Weiss.  We  change  the  numbers  every  few*  years  anyhow,  so 
it's  all  right.    '  -  ' 

Mr.  Kaplan.  The  premises  are  excellent  and  Fm  in  support  of^ 
many,  many  features  of  this  bill.  But, ,  obviously,  from  my  being 
here,  there  are  certain  features  I  objecfto,  from  experience. 

r  believe  it's  most  important  that  the  test  subject  be  made  aware 
of  the  uses  and  procedures  of  the  test.  Even  facts  about  coaching. 
Remove  the  mystery  of  the  test.  I  think  that's. great  because  there 
has  been  a  lot  of  misinformation  that  has  been  going  around.  , 
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I  have  a  copy  of  a  College  Board  bulletin  from  the-rl  must  have 
it  here  somewhere.  Yes,  from  the  1950's  and  this  is  from  the  ,Col- 
lege  Board  on  the  SAT.  "If  you  feel  you  need  coaching  or  tutoring 
aid,  get  it  well  in  advance  of  your  test  date.  Seek  the  aid  of  good 
teachers  who  will  help  you  to  analyze,  to  read  with  understanding,  . 
to  reason  through  problems,  to  look  for  implications,  and  so  to^th. 
"The  result  of  attempting  to  improve  your  scores  bV  practicing 
with  questions  is  not  worth  the  effort.  And  to  this.philosophy  I  to- 
tally agree  and  I  was  doing  this  for  many,  many  years. 

Then  in  the  1960's,  apparently  the  position  of  the  gollege  Board 
changed.  It  felt  that  coaching  didn't  help  and  when  T  was  pn  a  Na- 
tional Public  Radio  program  in,  the  l?70's,  1977,  I  believe.  Dr. 
Knowland  from  the  College  Board,  I  believe,  and  I  asked  him,  why 
the  change?  The  test  hadn't  changed.  Why  did  the  position  of  the 
College  Board  change?  And  he  said,  and  I  can  understand  it,  be- 
cause the  of  proliferation  of  cram  schools  and  which  werent 
having  much  of  an  effect.  The  result  wa^s  that  tlie  College  Board 
felt  that  they  ,  should  not  endorse  these  kind  of  programs  which 
would  cause  the  proliferation  of  the  coaching  schools,  of  cram 

'^^Then,  asTm  sure  you're  well  aware,  the  position  of  the  College 
Board  has  gradually  changed  in  the  late  1970^  and  the  1980  s  until  ^ 
"  now/in  the  bulletin  entitled  "Taking'the  SAT,"  which  is  issued  to 
every  student,  point  No.  3  states: 

.  Dcvelopmonl  ,.f  Uii-.-c  abilitics-tlio  abilitu-s  tested  by  the  SAT  i«  rdated  to  the 
tiiue  ami  effort  -s  >«"t-  Shoi  t-lerm  drills  and  crammmg  are  hkely  to  have  little  effcc  . 

■P'C1>»'"1"'"  ""'^  'levelops  .skills  and  abilities  can  have  gieater  effect. 

Tlmirthe  kind  of  thing  that  I  would  like  to  see  disclosed  be- 
cause it  certainlyjnakes  a  separation  between  cram  courses  and 
there  has  been  a  lot  of-4iscussion  about  this,^  and  long-range  coach- 
ing and  I  think  that's  importaqt.        -  \ 

Also  I  think  it's  important  thst^he  meaning  of  the  word  apti- 
tude" be  clarified.  It's  been  bandied  about^uite  a  bit  today.  Ihe 
American  Heritage  Dictionary  defines  aptitudTasonate  abilities  or 
developed  abilities.  They've  got  both  of  them  and  theyS-e.  hQt|,^^.^ 
the  same  definition.  .  .  .   ^.^l     .       j  r'''lr;V' 

I  have  suggested  many  times  that  the  A  in  SA-P  be  changed  frohi 
aptitude  to  assessment,  because  that's  what  the  bAl  is  really  . 
doing.  It's  assessing  your  abilities.  It's  not  pinpointing  you  as  being 
a  certain  kind  of  student  as  an  IQ  does  and  that  you  11  be  at  that 
level  for  the  rest  of  your  lives,  but  I  found  out,  in  my  talks  to  par- 
ents, in  radio  and  talk  shows,  that  many,  many  parents  and  stu- 
dents are  concerned  that  they  have  been  listed  or  blacklisted  as  a 
550,  400,  or  700,  that's  not  a  blacklisting,  of  course.  The  point  is  1 
don't  believe  that  the  SAT  should  be  a  label  and  the  ETS  has  gone 
along  with  that.  I've  had  many,  many  students  taking  the  LbAl 
and  the  GMAT,  the  GRF,  these  are  the  same  kind  of  tests;  test  the 
same  kind  of  skills  as  the  SAT;  they  come  to  me.  "I  did  very  poorly 
on  the -SAT.  What  does  this  mean?  Does  this  mean  I  won  t  do 
well'"  Again  they  have  that  label  andj've  said  that  its  only  an 
assessment.  My  reply  is,  "You  might  have  been  a  little  pipsqueak 
in  high  school,  never  read,  weren  t  motivated,  watched  television 
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all  the  time."  Suddenly  you  matured  and  I  say,  iDOst  of  you,  I  guar- 
antee if  you  took  the  SAT  again  your  score  would  be  much  higher 
because  you  have  improved.  An  improved  student  can  get  a  better 
score.  If  you  don't  improve,  if  your  skills  aren't  stronger,  then  you 
won't.    .      ^  ^ 

OK,  I  was  saying  I  felt  that  the  basic  premises  of  the  H.R.  1662 
are  excellent.  We  need  more  openness.  However,  Fm  very  happy  to 
see  that  this  bill  did  not  attack  standardized  tests  .per  se,  because 
tests  do^have  values. 

First  of  all,  the  tests  are  goal  oriented.  In  other  words,  they  test 
skills  that  are  specific  and  this  is  why  I  am  talkir^g,  for  exjwnple,  to 
many,  ,  many  deans  of  admission,  members  of  admission  committees 
at  various  professional  schools.  They've  said  tHat  these  tests  are  a 
better  prediction  of  success  in  the  first  year  of  law  school  or  medi- 
cal school,  than  the  grade  point  average.  After  all,  the  professional 
schools  go  to  the  testnvakers  ai^d  tell  them  the  kind  of  skills  they 
need  tested,  the  kind  of  skills  they  feel  will  be  most  helpful  in  the 
professional  schools.  The  testmakers  then  go  about  and  make  a  test 
to  test  these  skills  and  I  know  that  many  of  my  students  have  re- 
ported back  to  me  when  they  were  in  college,  whea  they  were  in 
,  law  school  or  medical  school  that  the  kind  of  skills  that  were  devel- 
\  oped  in  my  programs  were  very  helpful  later  on.  So  I'm  glad  to  see 
that  my  kind  of  programs  are  not  just  for  the  tests,  but  for  improv- 
ing the  skills  of  studente  tp  do  better  later  on. 
\S6  this  is  one  value  of  the  tests.  They  are  goal-orierited  and, 
therefore,  can  provide  some  more  Accurate  assessment  of  the  stu-  * 
derit  in  reference  to  where  he  is  headed. 

AlsQ,,  there  is  the  problem  of  grade  inflation.  Marks  can  be  way 
off  the  wall.  I  know  there  are  certain  colleges  in  California  where 
the  average  gra^ie  is  about' an  A-.  I  attended  a  workshop  at  an 
AMC  convention  where  there  was  a  discussion  on  admitting  high 
school  students  to  6-year  nriedical  programs  and  they  were  talking 
about  the  criteria,  the  criteria  they  heedeci  for  these  6-year  medical 
programs  and  everybody  mentioned  the  ACT  or  the  SAT  and  my 
question  was,  "What  about  the  gfade  point  average?  That's  the 
most  important  criterion"  and  they  said,  "Well,  everybody  comes  to 
us  with  perfect  averages  and  there  are  s^ill  three  times  as  many 
applying."  They  come  with  the  4.0's  and  there  are  still  thr(5e  tiynes 
as  many  applying  as  we  can  accept  so  what  can  we  do?  So,  there- 
fore, we  use  the  SAT  for  determination  for  a  decision. 

Of  course,  there  are  other  factors  too,  but  this  test  certainly,  to- 
gether with  the  GPA,  can  form  a  more  reliable  basis  for  decision 
than  either  one  alone.  Other  values  of  the  tests?  There -are  adults,- 
many  more  adults,  today  taking  these  examinationsJ[jKQUld  sa^ 
the  median  age  of  the  students  in  my  schools  is  ov/wlZorThei^g^e 
\.  parents,  mothers  who  want  to  go  back  to  professional  work.  Adults 
xwant  to  change  their  careers.  Now  you  can  tell  me,  how  accurate 
ckna  record,  an  academic  GPA  be,  when  the  academic  record  may 
be  iSkpr  20  years  old?  Therefore,  this  test  again,  can  give  some  idea 
of  where^the  adult  is  at  the  present  time. 

j^lso,  I  DeHeve  tests  are  a  very  motivational  device  for  learning.  I 
know,  I've  n^rd  many  times  from  parents  and  students:  Momny 
says  read.  The  ^Wld  watches  television.  Then  Mommy  says,  ""If  I 
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suggest  that  reading  because  it  will  be  on  the  SAT,  all  of  a  sudden 

they  start  reading.*'  ^  .  .   ..nrro  .  u  u  * 

The  Wirtz  report  which  was  issued,  I  believe,  in  197»,  told  about 
the  decline  of  SAT  scores.  With  that  report  came  an  immediate  in- 
crease an  enrollment  of  my  students,  a  tremendous  increase.  I  was 
.  wondering  why  until  I  realized  that  parent  weren't  interested  in 
SAT  scores  because-it  was  relatively  easy  to  get  into  most,  except 
the  most  competitive  schools.  It's  relatively  easy  to  get  into  college. 
The  SAT  scores  are  not  that  important.  Colleges  are  looking  for 
students.  But  what  the  parents  were  concerned  about  was  the  lack, 
the  weakness  of  the  math. and  verbal  skills  as  shown  by.the  Wirtz 
report  and,  therefore,  thev  were  worrying  about  how  their  children 
would  do  at  college,  not  about  a  SAT  score. 

Also,  I  believe  these  tests  can  identity  under-achievers.  There  are 
many  people  who  don't  work  at  their  real  potential.  They  are  bored 
at  high  ^liool.  I'm  talking  about  the  SAT  now.  And,  therefore, 
their  grade  point  average  may  be  below  what  it  really  should  be.  I 
know  the  SAT  has  provided  many  opportunities,  when  the  student 
did  well— to  allow  the  student  to  proceed  on  to  a  college.  When  I 
say  under  achievers,  I'd  like  to  address  the  fact  of  the  disadvan- 
taged student  because  many,  many  disadvantaged  students  may 
have  great  grade  point  averages,  but  so  many  colleges  distrust  the 
grade  point  averages  because  of  the  inflation  and  when  the  student ' 
does  better  or  does  reasonably  well,  then  the  SAT  is  an  excellent 
persuader  as  far  as  the  college  admissions  committees  are  con- 
cerned 

I  would  say,  very  strongly,  that  if  a  disadvantaged  student  from 
a  disadvantaged  background  can  achieve  say  a  500,  550  on  the  SAT 
or  on  the  LSAT,  even  below  a  500  on  the  LSAT,  then  that  student 
'  has  as  much  potential  as  an  advantaged  student  who  achieved  a 
700  and  was  also  born  with  an  educational  .golden  spoon  in  his 
moilth,  his  or  her  mouth.  ,  t>  i 

Also,  some  mention  was  made  of  the  test  validity  and  I  ve  spoken 
to  many  people,-  many  admissions  committee  members  and  I  would 
pose  this  question,  "Who  are  the  people  to  go  to  to  find  whether 
the  tests  are  valid?"  You  go  to  admissions  committees.  The  admis- 
sion committees  are  under*  no  compulsion  to  use  the  results  of  the 
tests,  if  the  tests  didn't  work  out  to  their  satisfaction.  They  can  im- 
mediately dispense  with  th"tese  tests.  .  ,  ,  t 
^  I  do  know,  for  example,  that  I— this  is  just  an  isolated  case— 1 
spoke  to  a  dean  of  a  dental  school  down  South.  The  school  was 
having  trouble  getting  students,  so  they  decided  to  lower  the  stand- 
ards for  the  DAT  and  most  of  those,  who  had  the  lower  standards, 
flunked  out  after  the  first  year.  So. apparently  these  tests  do  have 
some  validity,  but  of  course,  I'm  not  the  expert  in  terms  of  making 
scientific  investigations.  " 

The  reason  whv  I  have  been  talking  about  the  values  ot  these 
tests  is  because  there  are  many  people  who  argue  against  the  tests, 
who  would  like  to  see  the  tests  eliminated;  and  I  believe  that  these 
8§me  people  are  supporting  the  test  disclosure  provision  of  this  bill. 
Hopefully,  they  expect  that'the  weaknesses  or  the  increased  unre- 
liability of  the  tests  might  eventually  lead  to  what  they  hope  will 
happen,  namely,  the  elimination  of  standardized  admissions  tests. 
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I  do  know»  I  spoke  to  a  member  of  the  admissions  committee  at  a 
medical  school— I  know  the  AAMC  is  much  against  the  release  of 
the  tests  as  you  mentioned  before— -and  this  admissions  committee 
member  said  that  if  the  MCAT  isn't  given,  then  we'll  go  back  to 
the  students  that  are  coming  from  the  Ivy  League  school  types  be- 
cause their  grade  point  averages  are  much  more  credible  and,  of 
course,  then  we're  back  to  the  situation  of  the  1930's  and  the  early 
1940's  where  if  you  went  to  elitist  schools  you  had  a  much  better 
chance  of  getting  into  elitist  colleges  and  elitist  professional 
school^ 

Now  asJ  said,  there  are  many,  many  helpful  provisions  and  valu- 
able provisioris  in  the  bill,  but  I  believe  thei'e  are  some  that  are  un- 
sound and  even  unworkable. 

From  my  experience,  the  biggest  concern  that  students  have  had 
is  whether  they  were  scored  properly  or  improperly.  I  think  that's 
iinpoi;tant.  But  releasing  the  questions  of  the  test,  I  think  creates 
problems,  and  actually,  I  think  it's  almost  a  tempest  in  a  teapot. 
Because  I've  spoken  to  many  of  my  students  after  the  test— I've 
even  offered  to  have  them  bring  in  their  released  test  and  we^i  go 
over  it  with  them.  They  showed  no  interest.  After  all,  they've 
taken  the  test  already.  / 

Of  course,  one  might  say,  they  might  take  ^ it  over  again.  But 
most  are  not  interested.  And  for  example,  if  you  take  the  LSAT 
again,  then  for  most  law  schools,  they  take  the  average  of  both 
acores.  And  that!s  not  so  good.  And  it  would  be 'a  much  better 
idea— and  I'll  approach  that  in  a  moment — to  release  tests  before 
they  take,  the  examination.  I  don't  mean  the  test  they're  going  to 

take,  but  others.  '   

.But  I  still  think  it's  a  very,  very  difficult  procedure  in  terms  of 
mal^ng  these  tests.  I  knowJ[,.^yself,-in--making  up  my  tests— I 
have  a  large  staff.  I  make  up  materials  for  the^  test,  .tmd  I  don't 
have  to  standardize  them.  And  it's  still  a  tremendous,  tremendous 
problem.  ^ 

And  the  result,  of  course,  is  the  number  of  test  administrations 
decline,  and  in  some  cases  I'm  afraid  if  it's  implemented,  the 
number  of  test  administrations  for  certain  exams  may  decline  to 
zero.  Now,  what's  some  evidence  6f  this? 

The  April  LSAT  h^  been  eliminated.  The  ORE  in  New  York 
State  will  not  be  giyen  in  April  or  June.  .The  June  tests,  a  very 
popular  testing  date  for  the  LSAT  and  the  GMAT  test  day;  these 
tests  will  be  given  on  a  Wednesday  evening.  I  don't  know  how 
eager  you  would  be  to  take  a  test  on  a  Wednesday  evening  after 
you've,  worked  at  a  job  all  day.  Of  course  you'll  say,  well,  let  them 
take  it  another  time.  But  the  June  testing  date  lias  always  been  a 
very  popular  testing  date. 

The  MCAT.  as  you  mentioned,  is  not  subject  to  test  disclosure, 
because  of  an  injunction  in  New  York.  State.  But  I  do  know  that 
the  VAT  and  the  OCAT  and  PCAT  and  the  DAT  and  achievement 
t^ts  were  not  given  in  New  York  State  until  they  received  exemp- 
tions by  a  series  of  amendments.   .  ~  — 

Naw  why  did  they  do  this?  Why  didn't  they  give  the  tests?  Be- 
cause I  believe  they  felt  it  was  almost  impossible  and  incredibly  ex- 
pensive to  produce  these  tests.  And  thats  why  they  rather  would 
not  haye  given  them  in  New  York  State, 
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Now  of  course,  if  it's  made  a  national  law  and  the  testing  organi- 
zations have  to  release  the  tests.  J  suggest  they  might  only  be 
given^  perhaps,  once  a  year  if  they  find  that's  necessary.  But  I 
don't- believe  this  is  in  the  interest  of  the  students,  because  if  a  stu- 
dent gets  sick,  then  he  has  to  wait  another  year.  And  that's  not 
good.  ^  r 

Now  why  have  test  disclosure?  I'd  say  one  of  the  most  important 
reasons  for  having  -test  disclosure  was  the  statement  that  students 
would  no  longer  have  to  go  to.  coaching  schools  where  they  get  the 
questions  from  the  tests. 

Now  the  assumption  was  they  get  the  questions  from  ,me,  or  f^jdm 
coaching  schools.  But  they  could  also  get  the  questions  from  text- 
books for  $5.  I  have  a  stciff  make  lip  our  own  questions  and  I  be- 
lieve they're  of  a  little  better  caliber  than  the  ones  from  the  text 
books,  but  they're  available.  But  as  far  as  students  not  needing 
coaching  schools,  the  evidence  has  been—and  this  is  the  main  point 
^t^^^t^  to  get  at— has  been  quite  to  the  contrary. 

I  found  from  my  experience  that  students  aren't  interested  in 
questions.  They're  interested  in  learning  They're  interested  in  an 
efficient  way  of  organizing  the  study  materials,  reviewing  the  ma- 
terials. They're  interested  in  the  interaction  of  a  teacher,  not  just 
having  questions.  Now  someone  mentioned  that  the  students  will 
see  the  question  and  see  where  they  went  wrong.  I  doubt  very 
much  if  the  student  will  3ee  why  he  or  she  went  wrong,  because 
there's  just  a  key.  (B)  Why  is  it  B?  The  student  doesn't  know.  He 
knows  he  has  that  wrong>  but  he  doesn't  know  why  he  or  she  had 
that,  wrong.  And  there  are  no  explanations  inai  are  given- 
where  the  mistake  was  made. 

And  as  I  mentioned  before,  the  students  aren't  even  interested, 
"because  I  offered  that  class  after  they  got  the  test  back,  to  have  a 
workshop  to  find  out  wher^  they  went  wrong.  And  nobody  showed 
up. 

Now  I  mentioned  all  this  ,  in  a  letter  to  Governor  Hugh  Carey 
before  the  truth  and  testing  law  in  New  York  State  was  enacted.  I 
predicted  that  there  would  be  a  run  to  coaching  schools,  a  rush  to 
coaching  schools,  once  the  questions  were  available.  And  it  turned^ 
out  just  as  I  predicted. 

Now  how  did  I  know  this?  I  wadn^t  any  kind  of  ^seer  into  the 
future.  I  went  by  past  experience.  The  regents,  examinations  have 
,  always  been  released.  And  I  myself  was  the  author  in  16  titles  of 
the  Barron's  regents  series,  with  full  explanation.  And  when  re; 
gents  were  important  for  admission  to  the  New  York  State  schools 
in  the  1950's  and  1960's,  the  students  flooded  my  pt-ograms.  I  had 
thousands  preparing  for  the  regents  examinations,  even  though  all 
the  questions  were  published  with  full  explanations,  published  by 
me.* 

So  obviously,  there's  more  to  it.  They  need  a  commitment.  They 
need  the  interaction  with  teachers.  Take  the  CPA;  this  is  another 
reasoir  I  kn'few  this  would  happen.  The  CPA  is  the  most  coached-for 
test  that  I  know  of  in  the  country.  Almost  everybody  takes  the 
CPA  course.  An<lyet  all  the  questions  are  released  with  all  the  an- 
swers explained  completely,  and  yet  everybody  rushes  to  coaching 
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So  the  result  is,  Vih  glad  to  say,  that  enrollments  in  my  pro- 
grams for  the  released  tests,  the  LSAT,  the  GMAT,  the  SAT— did  I 
leave  one  o|it?  GRE,  I  don't  know  if  I  said  that— have  greatly  in- 
creased. But  the  ones  that  haven't  brjn  released,  have  stayed  at  a 
plateau.  The  DAT,  the  VAT,  the  MCAT— they've  stayed  about  the 
same. 

So  ^ou  would  think  it  would  be  to  my  interest  to  release  all  the 
Questions.  Unfortunately,  I'm  an  educator,  and  I  seriously  think 
that  the  reliability  of  the  test  will  be  compromised  and  the  stu- 
dents are  being  hurt,  and  I  think  the  best  approach  wotild  be  some 
kind  of  compromise  iii' terms  of  test  disclosure,  which  I'll  talk  about 
in  a  moment.  -  J 

So  anyhow, 'the  Wnole  effect  was  counterproductive.  In  fact,  I- 
have — and  I  think  iys  in  the  released  copy  to  you— a  copy  of  an  ad 
from  a  one  day  course  by  Bartons.  But  it's  not  the  Bartons  of  the 
Bartons  educational  series.  It's  another,  near  Brooklyn  College,  an^ 
other  Bartons  stoti  which  appatently  is  giving  a  program  for  the 
SAT.  And  here  is,/ in  a  highlighted  point,  ''Practice  and  leam  on 
actual  exams.  Our-fl  day  7-hour  program  is  deigned  to  significantly 
boost  your  SAT  score  this  fall.  TherSAT  is  probably  the  most  im- 
portant test  of  your  life.  Bartons,  the  people  who  know." 

Now,  obvious,  I'm  not  ttying  to  denigtate  any  patticulat  coach? 
ing  ptogtam,*  but  this  is  whete  I  think  the  FTG  teally  might  come 
in  handy.  Because  to  say  , that  in  a  1-day  T-hoiit  ptogtam  one  can 
teally  significantly  imptove  SAT  scotes,  I  think  is  a  fatce.  And  I 
know  that  thete  ate  .othet  cdttespohdence  coutses,  six  lessons  in 
math,  and  six  lessons  in%etbal,  $125  each;  $250  ibr  six  lessons 
that's  sent  thtough  the  mail. 

And  they  have  the  cheitzpah— let's  use  the  wotd— to  include  in  a 
comparison  of  theit  ptpgtam  with  my  ptogtam.  They  put,  ''Stanley 
H.  Kaplan's  ptogtam  is  this."  And  the  ptobleni  is  that  of  the  20 
points  they  point  about  the  Stanley  H.  Kaplan  pt^^m,  about  "21" 
of  them  ate  wtoiig.  So  this  is  whete  I  say  the  FTC  can  cettainiy 
cpme  in,  can  cettainiy  be  vety  useful.  So  that's,  I  think,  an  allusion 
to  the  difTetence  between  ctam  coutses  and  longet  coutses. 

By  the  way,  a  lot  of  talk  was  made  about  the  FTC.  Ths  FTC  in- 
vestigation statted  with  me.  I'm  glad  to  oay-^t  I'm  sorry  to  say— I 
don't  know  which  to  say— because  I  stated  in  an  ad  in  Boston  "Pte- 
pate  fot  the  SAT,"  and:  the  SAT,  ETSr^r  College  Bo^td.  I  should 
sav^-said  vou  teally  can!t  ptepate  fot  it.  And  obviously  I  sinc^tely 
felt  I  could.  I've  been  doing  it  fot  30  yeats.  ^ — 

So  the  tesult  was  an  investigation.  Now  I  still  disagtee  with  the^ 
results  of  even  the  Boston  FTC  tepott,.  which  said,  imptovements 
could  be  made,  and  the  FTC  Boston  tegion  tepott,  was  not  teleased. 
And  when  I* show  copies  of  it,  I  always  have  matked  on  it  in  vety 
big  lettets,  so  I  won't  be  considered  having  done  things  that  wete 
teally  not  ethical.  I  have  on  the  top  of  each  page,  "This  is  ftom  the 
Boston  tegional  oilice  tepott,  tejected  by  the  FTC  ib  Washington,  as 
seriously  flawed."  \ 

But  I  still  would  go  along  with  many  of  the  points  thete  in  the 
Boston  tepott  that  imptovements  in  the  SAT  can  go  up  to  50  points 
each.  If  means  100  points,  which  is  aboiit  what  I  find.  Although 
hete  in  Washington,  the  tepott  was  much  mote  diluted. 

Mr  '^"^^    -  .'^sx 
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Now  of  course,  these  are  the  statistics  tha*  I've  gathered.  Now  " 
the  college '  board  has  said,  that  my  statistics^  conie  from  students 
that  are  motivated.  And  I'll  plead  guilty  to.that;3ut  nonmotivated 
studenteidonVcome  to  me.  But  most  nonmotivated  students  really 
aren't  inlter^ted  in  college.  >         ^      ,i   r-  j  i.t.  \l 

Well,  ariyhow,  with  the  FTC  investigation,!  really  find  that  we 
need  a  lot  ixiore  inveitigatio^^in  terms  of  what  5AT  improvement 
can  be  made— and  this  i8^  imix)ftant— in  terms  of  seeing  that  false 
claims  are  not  made  by  test  preparation  organizations.  Because  1 
think  there  the  consumer  is  endangered.    '  ^ 

Now  what  are  some  of  the  inequities  that  I  believe  :ire  implicit 
in  this  bill?  Section  5.  First  of  all,  students  will  lose  the  opportuni 
ties  to  take  tests,  because  as  I  have  shown  before,  fewer  tests  are 
now  being  administered.  V      *  r  ^  ^    ti.  * 

Also  there  are  increased  costs  with  the  release  of  tests.  It  posts 
money  to  release  tests  and  therefore,  the  students  pay  more.  How 
of  course,  you'll  say,  well,  the  student  do^h't  have  to  request  the 
test,  and  then  he  doesn't  have  to  pay.  Unfortunately  this  isn  t  true 
all  the  time.  Because  tlje  LSAT  since,  I  believe,  the  spring  of  1981, 
now  makes  it  mandatory  for  everybody  to  get  nis  test  back,  wheth- 
er the  test  taker  wants  it  or  not.  And  the  cost  is  built  in.  It^used  to 
be  $15, 1  believe.  Now  it's  $20.*  ^     ,  ,    ,  ^      „       ^  , 

*So  therefore,  even  though  the  student  doesn.t  want  fo  see  his 
test  he  must  still  pay  the  additional  $5.  Also  if  the  committee  feels 
as  the  bill  purports  to  say-that  the  release  of  test  questions  is 
-^ry  important,  then  what  about  those  under  5,000  tests  where  the  ^ 
student  won't  see  the  questions?  ^tter  all,  you  can  t  play  it  both  ^ 
ways.  If  it's  important  for  tlje  students  to.  see  the  questions,  and  1 
know  there  are  practical  considerations  involved,  why  should  some 
people  be  punished,  just  because  they're  taking  a  t^  under  a  Q,000 
administration.  •  ,         t  .  •  i.  j  t  j  u 

Personally,^ as  I  said,  I  don't  think  they^e  being  punished.  I  don  t 
think  most  qf  them  wani  to  see  their  tests.  So  therefore,  k  don  t 
think'that's  much  of  an  argument. 
'    Mr.  Weiss.  Your  argument 

Mr.  Kaplan.  No,  mine.  Mine.  I'm  sorry. 

Mr.  Weiss.  Your  argument,  OK.   ,         ^.  ^  u  ^ 

Mr.  Kaplan.  I  appreciate  any  clarification -on  your  part.  But, 
what  are  my  suggestions?  One  suggestion  I  think  is  very  important, 
^nd  Fvve  been"  asking  this  for  years  and  years,,  is  that  the  student 
receive  the  official  answer  key  and  his  answer  key  because  ^most  of 
the  concerns  of  the  students  were  whether  they  mismarked  the 
grid.  Was  there  a  scoring  error?  Now  for  example,  iust  the  other 
day  someone  spoke  to  me  about  her  friend's  daughter  who  had 
failed  the. bar  exam.  And  she  was  very  conciemBd.  She  thought.she 
had  passed.  The  test  i^  not  released,  but  she  went  up  to  Albany  and 
saw  her  test  and  found  there  was  a  clerical  error,  and  she  dctuaily 
had  passed  with  flying  colors.  Now  obviously,  for  a  student  to  see  if 
he  or  she  is  scored  correctly,,  is  certainly,  certainly  necessary  and 

^'^Sow  how  about  students  seeing  a  test  before;  hfe  or  she  takes  the 
test?  I  think  that's  very  important.  But  I  don  t  believe,  every  test 
has  to  be-released  because  of  that.  My  suggestion  would 
lease  one  out  of  every  four  administrations.  And  the  student  be 


given  this  test  weeks  before,  not  after  the  test.  This  way  he'll  have 
time  to  prepare..  Now  the  students  see  the^test  only  after  the  fact. 
.In  fact,  although  the, college  boaYd  says  they  began  producing  a 
former  SAT  before  the  New  York  State  law,  I*think  the  fact  that 
the  New  York^State  law  was  implemented  and  that  there  was  more 
of  a  consciousness  of  what  admission  testing  was  all  about,  has 
really  accelerated  the  pace  of  disclosure  on  the  part  of  the  college 
board.  ^  \  , 

And  I  would  certainly  say— in  fact,  I  would  like  to  see  this  writ- 
ten into  law— that  every  high  school  be  mandated  to  administer 
one  of  these  tests  in  a  test-t^iking  situation  for  the  junior  class  or 
the;  senior  class,  because  just  to  give,  this  to  the  student  doesn't 
mean  anything. 

I  hold  cojties  for  students  who  had  taken  the  Junior  SAT,  and 
they  didn't'do  that  well.  They  are  now  with  me  to  prepare  for  the 
test  in,  the  fall  of  .the  senior  year,  and  usually  when  I  ask  how 
many  have  taken  this  released  test,  many  of  them  had  never  even 
seen  it,  and  most  of  them  who  had  seeif  it  didn't  bother  with  it.  So 
wherein  is  the  value? 

I  think  there  has  to  be  some  intercession  on  the  part  of  the 
school  systems  to  really  make  sure  that  they  know  what  the  test  is 
about.  What  the  directions  are  about.  How  to  pace»  when  to  guess, 
when  not  to  guess.  ThS  could  be  done  by  giving  the  test  under  the 
time  restrictions  with  the  pressures  of  an  actual  test,  with  people 
Jill  around,  and  then  going  over  the  test,  and  going  over  the  kinds 
of  pitfalls  the  students  fell  inta 

This,  I  think,„  makes  a  lot  of  sens^e.  Also  I  would  suggest  that 
when  you're,  talldrig  about  the  relationship  of  the  admission  test 
scores  with  income,  sex,  and  so  forth,  I  myself— it  is  my  opinion— 
that  it's  the  wrong  emphasis.  I  think  the  GPA  is 'a  much  more  im- 
portant factor  to  conaiMn  After  all,  test  scores  are  simply'  a  reflec- 
tion of  what  the  stuoent  has  learned  in  school.  I  certainly  believe 
that  if  one  reads  the  stktistics  you  find  that  if  you  get  a  750  you're 
in  this  economic  status,  if  you  get  a  600,  you  re  in  this  economic 
status>  if  you  get  a  400,  you  re  in  this  economic  status.  However,  if 
one  looked  at  the  grade  point  average,  uninflated  grade  pointed 
averages,  one  would  find  tne  same  thing..  These  are  beautiful  statis- 
tic^ about  :the. relationship  of  scores  and  dollars.  But  as  far  as  I'm 
concerned,  it's  a  red  herring.  I've  worked  with  disadvantaged  stu- 
dents, and  I  see  there's  a  direct  relation  Ijietween  achievement,  eco- 
nomic level,  and  parental  supervision. '  ^ 

Now'  a-lottQfjD^ntion  has  oeen  made  about  unfairness.  Of  course, 
all  througPi  life  there  is  quite  a  bit  of  unfairness^  and  I  agree.  How- 
ever, the  parents  always  want  the  best  for  their  children,  and  mil- 
lions are  Ibeing  sent  to  private  schools  Because  they're  .getting  a 
better  education.  They're  getting  better  msih  and  verbal  skills  so 
theyll  dabetter  on  the  SAT. 

E)oe8  anyone  thinlcthat  we  should  have  legislation  abolishing  pri- 
vate schools  to  remove  this  inequity  and  this 'unfairness?  You  men- 
tioned)  I^believe,, somebody  from  JSast  Harlem.  I  believe  his  name 
was  Patrick  Shields,  a  very  knowledgeable  gentleman.  He  has 
'.these  questions  available.  But  I  don't  know.  Representative  Weiss^ 
if  you're  awiare  of  the  fact  that  he  contacted  nie  and  we  gave  him  a 
program  at  no  charge.  A  program  in  preparation  for  the  SAT.  Of 
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course,  he  called  me  very  late  and  it  was  a  very  short  course  But 
at  least  they  received  some  kind  of  input  as  for  as -the  test-taking 
skills  and  as  far  as  basic  points  which  we  felt  would  be  very  imjpor- 

^In  Texas,  at  the  Health  Science  Center  in  San  Antonio,  they  re- 
ceived—this  is*  the  third  year  now— they  received  Federal  funding 
via  HUS,  to  take  about  50  disadvantaged  students  who  had  pretty 
good  grade  point  a,  3rage8— reasonably  good— but  pbor  MCAT 
scores  They  were  brought  to  San  Antonio,  and  they  were  paid  $100 
a  ^eek,  and  they  worked  at  tjhe  hospital,  to  see  if  this  fitted  in  with 
.their  plans.  They  also  worked  with  us  on  the  MCAT  s,  and  they 
have  to  attend.  ,  ^      ,  ^        ,  ^  . 

For  2  years,  the  results  have  been  pretty  good,  and  from  what  1 
understand,  their  performance  in  hiedical  school  is  also  pretty 
good 

See,  the  big  problem  is  opportunities.  This  is  where  I  say  bravo, 
bravo,  bravo,  to  one  of  the  points  of  the  bill  and  to  one  of  the  pur- 
poses of  the  bill  that  there  is  a  cdntinuous  need  to  assure  equal 
access  to  all  Americans— to  insure  equal  access  to  educational  op- 
portunities of  higher  quality.  But  test  disclosure  is  not  going  to  do 
this.  There  is  one  way  of  getting  equal  access  and  that's  to  expand 
the  opportunities,  expand  outreach  into  schools, 
r  I  go  to  medical  schools,  and  jthey  ask  me  do  I  know  any  minority 
members  who  might  apply.  They're  looking  for  them.  But  many 
minority  students  absolutely  have  no  kind  of  supportive  work,  no 
aivice,  no  ideas  of  the  opportunities.  The  minorities  don  t  have  this 
image  of  themselves  as  going  into  professions.  The  result  is  they 
dora  train- in  science,  for  example-at  the  high  school  level.  * 

And  if  some  do  go  to  the  colleges,  they  flui^k  out  the  first  year.  If 
you  Avish  evident  to  that,  I  meta  Dr.  William  Roth,  Will  Roth,  at 
the  AAMC  Conwntion  and  he  was  trying  to  work  with  some  mi- 
nority students  and  found  it  didn't  work  because  you  can  t  start 
from  scratch  at  the  college  level.  The  college  level  is  not  the  point 
where  remediation  starts.  It  should  start  much,  much  before. 

I  believe  this  Texas  experiment  is  working  out  veiy  well  with 
Federal  funding.  So  I  would  think  it's  very  important  that  the  Fed- 
eral Government  help. 

In  other  words,  if  test  preparation  helps,  I  believe  the  challenge 
is  to  see  that  everyone  has  the  opportunity  to  be  as  well  prepared 
as  possible  in  schools  that  haye  adequate  facilities  and  have  skilled, 
dedicated  and  well-paid  teachers. 

Thank  you  very  much.  ^  ,    ^    v  ,,  i. 

Mr  Weiss.  Mr.  Kaplan,  thank  you  very  much.  The  bells  have 
just  rung.  There's  a  vote  on  the  floor.  And  I  would  like,  if  it  s  con- 
venient for  you,  to  take  a  recess  for  about  45  minutes  and  then 
come  back  and  enuage  in  some  dialog  with  you.  If  your  schedule  is 
too  tight,  then  we'll  forgo  that  opportunity. 

But  if  your  schedule  allows,  that  would  be  very  worthwhile. 
What  plane  are  you  catching?  • 

Mr.  Kaplan.  I'll  have  to  see.  I'll  try  to  make— I  had  an  appoint- 
ment to  meet  someone,  a  very  important  appointment. 

Mr.  Weiss.  What  time?  «  ,  ,  , 

Mr  Kaplan.  But  this  is  more  important— 2  o  clctek. 

Mr.  Weiss.  Oh,  we'lLdPjhat.__  _    ^ 
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Mr.  Kaplan.  Because  I  would-^rto  me^  I  was  looking  forward  to 
the  other  way  around,  your  questions.  Because  that's  when  I  learn. 

1  don't  learn  from  what  Laay. 

,_Mr.  Weiss.  OK*  Then  Supposing  we  come  back  here  at— how 
about  1:30?  Is  that  all  right?  Then  perhaps  we  can  let  you  go  about 

2  o'clock  and  mayj[)e  you  11  i^atch  a  2:30  or  3  o'clock  shuttle  

Mr.  Kaplan.  I  can  re^ch  this  other— no,  the  j^ppointment's  here 

in   " 

Mr.  Wmss.  in  WasHirigton? 

Mr.  Kaplan;  Yes.  .  ^ 

Mr.  Weiss.  You'll  do  it? 

Mr.  Kaplan.'  rd  be  here  all  day  tomorrow  if  you  want  to  speak 
to-me.  /  , 

[Recess  for  45  ipinutes.] 
^-Mr.  WEiss.The  Subcommittee  on  Elementary  and  Secondary  and 
Vocational  Education  and  poet  Secondary  Education  will  come  to 
order,  and  we  will  resume  our  hearings  to  H.R.  1662.  Mr.  Kaplan 
has  been  good  enough  to  ac^just  his  schedule  so  that  he  could  be 
with  us  again  this  afternoon,  will  conclude  his  presentation,  and 
then  we  may  have  a  few  questions  to  ask  of  him.  Mr:  Kaplan. 
•  Mr.  Kaplan.  There  was  one  item  that  I  hadn't  referred  to  and 
that  was  in  terms  of  the  impossibility  of  really  finding  out  effects 
of  coaching  schools,  because  there  are  so  many  different  types  of 
coaching  schools. 

But  also  I  am  afraid  that  sometimes  when  coaching  is  approved 
on  one  level,  then,  everybody  gets  into  the  act.  :;^nd^cram  schools 
which  perform  notFimg  at  all  will  ride  on  the  Coiat^tairs  of  those 
whose  performances,  bave  really  upped  the  level  of  the  kind  of  im- 
provement you  can  get. 

For  example,  I  know  there's  an  outfit  in  California  that  adver- 
tises the  FTC  has  now  said  that  coaching  helps.  And  they're  pre- 
paring for  the  MCAT.  But  the  FTC  report  in  Boston  judged  only 
*he  LSAT  and  SAT  and  the  released  report  only  the  SAT.  People 
are  generalizing,  well,  if  you  can  prepare  for  the  SAT,  now  take  my 
Frugram  on  the  MCAT.  Because4he  FTC  has  given  the  approval  to 
all  kinds  of  coaching,  which,  of  course,  is  a  very— it'^s  a  very  dan- 
gerous thing  to  say,  and  I  think  it  serves  no  purpose  and  can  cause 
a  lot  of  damage,  because  not  all  coaching  courses  are  created  equal. 
There  are  good  ones  and  there  are  bad  ones,  and  there  are  quacks 
and  I  think  the  FTC,  as  I  said  before,  can  do  a  good' job  in  that 

Mr.,  Weiss.  Well,ihW  tell  me  hoNy  we  could  dral'with  that  prob- 
lem. HoW  can  you  really  prevent  preparatory  courses  or  coaching 
schools  which  don't  meet  your  standards  from  entering  the  field? 

Mr.  Kaplan.  Well,  I  couldn't  do  anything-  But  I  think  the  FTC 
could  put  up  a  series  of  guidelines,  in  terms  of  advertising  claims. 
Because  they  send  me  up  the  wall.  We  promise  ^ou  eveiytning  

Mr.  Weiss.  Well,  they  may  send  you  ,upthe  wall.  I  don't  think 
that  that's  one  of  Ihe  criteria  for  the  ^JTC  getting  into  the  act 
though. 

Mr.  Kaplan.  Well,  that's  it.  Because  one  cannot  claim  just  be- 
cause one  student  received  a  750 — obviously  the  implication  is  that 
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to  be— you  jcan^t  take  a  few  and  advertise  it— of  course,  it's  mis- 
leading as  f^r  as  the  consumer  is  concerned. 

All  rm  asking  is  that  there  should  be— talk  about  truth  in  testr 
ing.  Truth  inf^  advertising. 

Mr  Weiss.  \Right.     _   —  . 

Mr.  KaplaW.  Don't  mislead.  The  most  important  test  of  vour 
life— it  isn't  the  most  important  test  of  your  life,  and  you  shouldn't 
^uce  people  ^into  taking  the  course,  because  of  a  rash  statement 
"  te  that  which  is  cdmpletely  false.  , 
Ypu  know  that  the  new  chairman  of  the  FTC  doesn  t 
see  very  niuebJustification  for  the  FTC  getting  into  the  false  adver- 
tising area.  You'Ve-i^jad  about  that? 
Mr.  KAPLAN..ye8,  iVTrea^  about  that.  To  my  regret. 
Mr.  Weiss.  OK.  Go  ahead.        _  ^  ^ 

Mr. 'Kaplan.  Ifm  looking  for  anotH^letter  that  I  wanted  to  read, 
and  then  I'll  be  happy,  because  I  think  it^  ar-megtimportant— yes, 

here  it  is.         1  *  ^"^^^^^^--v^       ,rn  ' 

Because  there  seemed  to  be  a  lot  of  focus  on  the  unfairness^^at 
some  people  can  \afford  and  some  people  cannot  afford  these  pro-..^ 
grams.  And  I  just,  wanted  to  read  a  letter  of  which  I  think  tells  a 
lot  in  terms  of  what  coaching  courses  can  do,  and  what  a  test  can 
do  ' 

This  is  a  letter  from  the  Valley  Opportunity  Council  near  Spriig- 
field,  Mass.  We  gaye  a  prc«ram  for  the  .  SAT  during  the  summer  a  ■ 
year  ago,  1980.  rt's\dated  October  1,  1980.  I  just  wanted  to  r6gia  it  ^ 
rather  than  just  introduce  it  into  the  record,  because  I  think  what 
they  say  cai^be  vei^,  important: 

We  at  the  Health. Center  Careers  for  Minority  Students  Projects  support  your  ef- 
forts to  find  ways  to  increase  the  participation  of  low  income  and  minonty  students 
in  programs  which  provid*  students  with  test-taking  skills  and  review  of  fundamen- 
tal concepts  of  math  and  English.  It  has  been  our  experience  that  exposure  to.  this 
kind  of  a  program  is  yet  inother  avenue  by  which  the  educationally  unaware  stu- 
dent can  bl^n  tb  understand  the  process  of  upward  educational  mobility. 

All  too  often  these  studenU  whose  families  have  no  experience  in  post  secondary 
education,  fmd.themselves  unable  to  fulfill  career  dreams  because  they  re  unaware 
of  the  complexity  of  requirements  which  must  be  met  before  they  can  acquire  the 
formal  education  mandated  by  toda/s  highly  technical  occupations. 

The  steps,  toward  college  Which  the  middle  and  upper  class  students  Uke  for 
granted  as  they  pass  through  high  school,  remain  a  mystery  to  the  disadvantaged 
student.  In  fact,  the  middle  class  student  and  his.  or  her  family  is  becoming  more 
sophisticated  in  maneuvering  t^heir  way  through  the  college  entrance  maze. 

The  disadvantaged  student  is  expressing  no  comparable  enlightenment.  Like  a 
soccer  player  sudJenly  plaVinglfootball,  he  can't  possibly  score  until  he  learns  the 
rules.  I      \  ^ ' 

And  this  is  the  important  part:  - 

Teat  preparation  programs  provide  a  unique  opportunity  for  disadvantaged  stu- 
dents to  immerse  tnemselviwi  in\  ^  environment  whose  goal  is  colleee  entrance. 
They  begin  to  see  themselvH  in  a\  new  way.  They  begin  to  understand  the  challenge 
and  how  they  must  responc.  We  recognize  that  our  project  is  only  a  beginning  and 
are  anxious  to  involve 'as  many  other  r^wurces  as  the  student  requires.  The  test- 
taking  skill  development  is  *«rtainly  one  of  these  resources. 


And  that's  about  it. 

Mr.  Weiss.  Right.  Who  wrote  that  statement? 

Mr»  Kaplan.  Tliat  Was  written  a  Jane  B;  3aatz,  B-a-a-t-z.  She 
is  the  coordinator  for  this  opportunity  council. 

Mr.  Wkiss.  I  see.     I  i 
— Mf  -Kaplan.  Springneld,  Mass,  
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Mr.  Weiss.  Good.  Thank  you  very  much,  Mr.  Kaplan.  I  really  ap- 
preciate your  testimpny.  I'm  going  to  ask  you  some  basic  questions. 
Mr.  Kaplan.  Right. 

Mr.  Weiss.  And  if  you  will,  try  to  be  as  direct  in  yotir  responses 
as  you  can.  Sometimes  the  questions  may  not  lend  themselves  to 
being-^to  giving  brief  responses.  But  I  will  try  to  phrase  them  in 
such  a  way  that  you  can. 

Tell  me  how  your  SAT  Qourses  are  structured.  We  have  in  the 
record,  some  indication  as  to  how  your  preparatory  course  works. 

Mr.  Kaplan.  Right.  Well,  it's  basically_the  same  as_ the  other 
courses.  What  we  have  is,  for  the  SAT,  is  11  4-  to  5-hour  class  ses- 
sions held  once  a  week  for  about  10  or  11  we^ks.  And  in  that,  we 
give  the  basic  concepts.  We  review  the  basics  of  arithmetic—be- 
cause they've  had  it  before.  It's  a  matter  of  review.  We  don't  teach. 
We  reyiew:  We  go  over  the  basics  of  arithmetic,  algebra,  geometry. 
They  might  have  had  it,  but  forgotten.  Or  never  really  understood. 

And  each  time  we  test  them  to  make  sure,  one,  they've  under- 
stood the  concepts  that  we've  given  them,  plus  two,  theyVe  getting 
used  to  some  of  the  test-taking  techniques  and  pressures. 

But  then  I  compare  this  to  a  tennis  coach  who  gives  10  half  hour 
lessons.  And  what  does  the  tennis  coach  say?  He  says,  "Go  out  and 
.  practice." 

And  we  have  permanent  centers.  I  think  that's  a  very  essential 
part  of  any  kind  of — ^ 
Mr.  Weiss.  What  kind  of  centers? 

Mr.  Kaplan.  Permanent,  Permanent  centers.  In  other  words, 
they're  riot  just  hotel  rooms,  where  you  rent  hotel  rooms"  and  then 
disappear.    .  ^ 

Mr.  Weiss.  I  see.  Right, 

Mr.  Kaplan.  We  have  permanent  centers  with  facilities,  where 
the  students  can  work.  And  we  have,  what  I  call,  our  tiest-n-tape 
center.  The  test-and-tape  approach  where  they  can,  first  of  all, 
review  the  lessons  they  ve  had  in  class,  because  sometimes  they're 
afraid  to  ask  the  teacher  a  question.  Sometimes  they  want  to  hear 
it  at  their  own  pace. 

But  then  we  have  it  all  organized — and  this,  to  me,  is  the  crux  of 
it— based  uponi;  the  concepts  we've  taught  in  class,  we  have  a  whole 
series  of  tests  thai^we  made  up.  But  we  use  the  Socratic  method, 
not  just  give  an  answer  to  the  test.  Each  test  introduces  concepts 
and  goes  over  the  whole  procedure  on  which-the  concept  is  based, 
^and  the  procedure  by  which  you  analyze  and  think  it  out  and  get 
to  the  answer* 

Sp  it's  not  just  a  question  and  answer.  Sometimes  the  discussion 
may  take  1$  minutes  just  on  one  question.  That's  why  our  . cassettes 
sometimes  are  rather  lengthy.  But  in  this  way,  for  example,  in 
math  on  the  SAT,  you  can  take  1  question  and  make  up  what  I  call 
10  different  questions,  exactly  the  same  except  entirely  different.  If 
you  understand  the  concept,  you  learn  how  to  think  a  little  bit. 
And  I'm  not  trying  to  make  this  too  lengthy,  but  it  reminds  me  of 
a  student)  and  I  think  that's  very  important  what  she  said.  She 
said,  'Tou  know,  Mr.  Kaplan,  I  never  thought  of  thinking."  This 
happens  all  the  time.  Because  too  much  work  at  the  high  school, 
the  elementary  school,  unfortunately,  even  the  college,  is  a  matter 
of  memory.  And  these  tests  get  you  off  that  kick     memory,  and 
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get  you  starting  to  be  able  to  relate  to  cbncepts  and  to  reason 

we^have  about  250  to  300  additional  hours.  But  there  are 
menus  and  if  students  feel  weak  in  certain  areas,  tliey  can  select 
those  areas  in  which  they  feel  wieak.  And  this  is  the  basic  ap- 
proach. Students  can  begin  in  January— most  do— of  their  junior 
year.  They  take  the  tesi,  say,  in  May  or  perhaps  March.  And  m 
that  time,  they've  had  the  time  to  go  over  the  basic  lessons  and 
also  to  attend  our  test  and  tape  centera.  But  then  they  can  cpntin- 
ue  on.  Past  that  test-rthrough  the  summer,  many  of  them  take  it 
again  iti  the  fall.  So  they  continue  on.  In  fact,  many  take  it  beyond 
the  test  date.  In  fact,  I  met— and  this  was  a  most  vitalizing  experi-  - 
ence  to  me.  I  was  in  Columbus  visiting  one  of  my  centera,  wid  1 
met  a  youngster  who  was  applying  to  a  parochia^^  school  in  Ohio 
All  he  needed  was  about  a  550,  and  on  his  PSAT's  he  had  scored 
that  already.  But  he  felt  there  were  some  things  to  learn.  And  he 
scored  a  750  and  780  when  he  took  the  test  in  May.  Now  I  was 
there  in  June.  He  was  there.  I  said,  "Why  are  you  here?  He  said, 
"I  feel  I'm  still  learning."  .   ^.     .  ,  , 

And  that's  the  whole  basis  upon  what  my  organization  is^based. 
In  other  words,  not  for  the  test.  Of  course,  they  re  coming  for  the 
test.  But  to  improve  the  math  and  verbal  and  reasoning  skills.  And 
that  is  a  synopsis  of  what  ihy  program  is  like. 
Mr  Weiss.  How  about  the  lessons  in  how  to  take  a  test  itselt^ 
Mr  Kaplan  Well,  we  don't  have  lessons  in  how  to  take  the  test 
itself,'  per  se.  We're  constantly,  as  I  say,  we  give  teats  in  cla^. 
We're  constantly  going  over,  pacing  them,  telling  them  when  to 
guess,  when  mt  to  guess.  And  so  it's  constantly  gone  oyer,  in  tact,  ^ 
ndtjust  in  one  specificlesson.  „  iu»* 

Now,  of  coiii-se,  for  very,  very  cram  courses,  that  s  one  thing  that 
can  be  done.  As  I  mentioned  before  in  my  testimony,  that  s  some- 
thing that  schools  can  do,  is  to  give  a  sample  test  and  go  over  it. 
And  explain  the  procedures.  I  think  that  wiir  be  extremely  helpful. 
Mr  Wfeis^.  Now  how  long  have  you  been  giving  your  courses.' 
Mr.  Kaplan.  For  the  SAT? 

Mr.  Weiss.  Right.  .  _„„ 

,  Mr.  Kaplan.  Because  I've  been  tutoring  and  coaching  since  laae, 
for  the  SAT.  In  fact,  you  know  I  had  never  heard  of  these  tests.  A 
student  came  to  ine,  someone  I  was  coaching  for  the  school  sub- 
jects, and  said,  "Look.  We  have  to  take  an  examination  of  the 
SAT."  And  I  said,  "What's  the  SAT?"        ^      ^      -^     .  „  ^, 

And  when  they  showed  me  the  booklet,  I  realized  it  was  all  the.^s 
math  and  verbal  skills  I'd  been  teaching  all  along.  I  said.  Well,  I 
can  prepare  you  for  this."  And  so  then  it  began  to  mushroom— it  • 
was  the  same  test  for  all— so  instead  of  teaching  individually,  you 
could  have  groups  of  students?  ' 

And  word  of  mouth— in  fact,  I  didn't  advertise  until  1970.  The 
FTC  came  to  me  in  1974.  Before  that  I  didn't.  But  when  other  cram 
courses  came  about  which  I  felt  needed  an  addressing  to,  that  s 
when  I  began  to  advertise  to  show  the  students  had  a  choice  in 
terms  of  seleQtiQg  various  coaching  courses,  if  they  wanted  to. 
Mr  Weiss.  A*1  tell  me  again,  it  is  your„cpnclusion-that  -the-dif- 
?rence  .in  «^"rp',  hetween'somebody  who  takes  your  test,  takes  your 
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course,  and  those  who  bo  not,  is  what?  About  50  points?  Is  that 
what  you  said? 

Mr.  Kaplan.  The  average  improvement  is  50  points  in  the  math 
and  50  points  in  the  verbal.  And  interestingly  enough,  many  times 
the  verbal  improvement  is  more  than  the  math.  You  kno^,  talk 
about  cultural  bias,  one  would  think  that  the  verbal  would  be  more 
culturally  biasedjthan  the  math  is. 

AMk  yet  ftom  what  I  understand,  statistics  from  ETS  show  that, 
even  though  both.^scores  are  low,  the  math  is  lower  on  a  relative 
scale  than  the  verbal.  And  how  can  there  be  a  cultural  bias  as  far 
as  the  math  is  concerned?  That's  hard  for  me  to  see. 

Mr.  Weiss.  And  have  you  published  studies  In  this  field  as  to  the 
improvement  that  

Mr.  Kaplan.  The  FTC.  I  don't  publish  the  studies.  No.  But  I— in 
fact  we  have  about  a— I  ^uld  say  at  least  abojit  a  90-percent  re- 
sponse on  the  SAT.  It's  very  difficult  for  the  LSAT  and  for  the 
GRE,  because  students  are  niobile.  But  here,  they're  a£  home.  We 
can  talk  to  the  parents. 

And  we  get  about  a  90-percent  response.  And  our  average  im- 
provement has  been  about  100  points.  And  believe  it,  I've  heard  of 
some  coaching  courses  .keeping  records  and  the  poor  scores  are 
thrown  in  the  wastepaper  brisket.  The  good  scores,  they  keep.  I've 
heurd  this  from  advisers  in  terms  of  evaluation  of  programs.  And 
our  improvement  is  100  points  total. 

Mr.  Weiss.  Is  that— and  has  that  beeii  fairly  consistent  over  the 
years? 

MrV  Kaplan.'  Fairly  consistent.  Well,  I  wouldn't,  say  that.  It^ 
been  going  down.  I  would  say  in  the  1960's  the  improvement  was 
perhaps  175  points  altogether.  That's  because  students  were  more 
motivated  to  work. 

I  used  to  have  class  sessions;  something  like  32  class  sessions. 
Thajb  means  32  times  4—128  hours.  And  therefore,  you  could  have 
a  much  more  intensive  review  if  it  was  all  in  class.  But  the  stu- 
dentp.  aren't  willing  to  come  to  class  that  much.  The  SAT's  aren't 
fhdtdmportant. 

You  know,  for  the  LSAT,  . the  median  score  is  about  a  530,  above 
the  average.  For  the  ISAT,  the  median  score  in  the  math  is  about  a 
420,.  and  the  verbal  about  a  460.  Arid— or  maybe  the  other  way 
around.  But  the  point  is — one  of  the  reasons  I  think  is  that  people 
aren't  paying  much  attention  to  the  SAT.  And  therefore,  if  you 
don't  work  at  it,  you're  not  going  to  improve. 

I^r.  Weiss.  And  you  know,  there  have  been  suggestions  over  the 
coiinjie  of  the  years  that  courses,  such  as  yours,Jn  fact  have  gotten- 
some  of  the  questions  from  the  kids  who've  taken  the  examina- 
tions. Do  you  want  to  address  yourself  to  that  at  all?  As  to  whether 
you  utilize  any  of  the  test  questions  that  have  been  given  by  de- 
briefing the  kids  who  have  taken  them,  or  anything  of  that—— 

Mr.  Kaplan.  Let  me  say  this.Jptebxiefing~doe8n't-helprWe  get  an 
idea^oLthe  kinds  of  concepts  tKat  are  given.  But  I  know  this  was  in 
the  Boston  FTC  report,  and  there  was  one  organization  that  boast- 
ed—in fact,  whenever  they  went  to  talk  to  pre-law  societies,  that 
they  regularly  sent  in  people  to  take  these  examinations  to  get  the 
questions.  
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And  on  the  LSAT,  the  FTC  report  on  the  LSAT— this  is  the 
Boston  report.  They  were  at  the  Bpttom  of  the  list  in  temw  of  effec- 
tivenesB.  iSf  people  come  in  just  to  memorize  questions,  you  ve  got 
wxjblems.  And  my  course  is  not  based  upon  having  the  questions.  I 
dCKn't  see  any  kind  of  result,  unless  voii  have  the  exact  question. 
But  usually  it's  more  trouble  than— because  peqple  cannot,  when 
they  go  in,  they  cannot  remember  the  questions  ner  se,  unless  they 
steal  the  test.  The  result  is  their  impressions,  like  having  an  mi* 
preesion  of  elephant,  One  is  the  tail,  and  one  is  the— whatever.  The 
unnressions  of  the  questions  are  entirely  different, 
o  It  is  very,  very  difficult  to  memoriae  questions  just  as  they  are. 
So  therefore,  when  a  student  sees  a  question  that  is  very  much  Uie 
same  as  it  was  on  the  test,  ordinarily  the  student  says.  Well,  I 
don't  have  to  read  the  question.  There's  the  answer."  And  thats 

Some  students  have  come  to  me  and  said,  "You  know,  Mr. 
Kaplan,  the  exam  was  exactly  the  way— you  had  all  the  questions. 
These  students  are  going  to  get  the  460.  But  the  students  who  say* 
"Mr.  Kaplan,  you  know,  it  was  altogether  different."  These  are  the 
people  who  get  the  600i  Because  what  they  thought  was  the  same, 
rwfiy  wasn^  the  same.  The  former  had  learned  to  memorize,  not 
to  think.  '  \      ,  .     i  X  i 

And  I  tell  all  my  students  when  they  come  m  at  the  first  lesson, 
"If  you're  coming  here  to  think  you're  going  to  get.  the  questions, 
please  get  your  money  back  now.  We  teach  you  to  think,  to  under- 
stand, to  leanr^  fitftd  then  you'll  get  the  material." 

But  I  do  admit  that  if  there  are  any  new  x^oncepts  that  are  given 
on/ the  fests  and  tW  students  dome  to  us— we  don't  ask  them,  de- 
brief them,  "What  are  the  questions?  What  problems  did  you 

And  if  there  are  problems,  we  take  note  of , them,  and  tiierefore 
introduce  them  into  our  programs.  That's  not  the  same  thinjj.  I  m 
dead  set  against  questions  just  being  memorized  and  given  m  the 
course,  because  it's  a  fraud  as  fwr  as  the  student  is  concerned  to 
think  that  he's  going  to  be  able  to  do  that  well  because  of  it. 

Mr.  Wdss.  Do  you  have  any  idea  at  all  as  to  what  percentage  of 
the  people  who  take  the  SAT  elimination,  in  fart,  attend  a  formal 
preparatory  course,  such  as  your  school  or  any  of  the  other  schools 

^'Sfc^FLAN.  It  is  very  difficult.  That's  extremely  difficult  to,  be- 
cause there  are  so  many  teachers  in  the  basement  of  their  home. 
Mr.  Weiss.  Right.  OK.  .i.      .  • 

Mr.  KAPLANTThey  give  courses,  and  schools,  ttiey  pve  their  own 

S'  reparation.  I  know^'James  Madison  High  School  Md:  Lincoln  High 
chool  for  yearf  B^ere.fifiving  coaching  oours€^^         . .  ,  r  •  *  n- 
-^MfrWwMTDo  you  have  any  way  of  making  any  kmd  of  mtolU- 
gent  estimate  as  to  the  percentage  of  test  takers  of  the  professional 
teste?  LSAT  or  MCAT,  who  in  fart,  tiOie  preparatory  courses? 

Mr  Kaplan.  I  would  say  that's  much  highet,  because  it  s  much 
more  important.  And  I  would  say  perhaps— well,  perhaps  the 
MCATs,  that's,  you  know,  half.  .  .a*  oa  *t 
Perhaps  the  LSAT-it's  harder  though,  may^  10  to  20  percent  I 
don't  know.  You  see,  even  if  you  have  a  textbook,  I  mean,  that  s  a 
coaching  onirfie.  —  ^   -  
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Mr.  WEi88.  ,Riffht. 

Mr.  Kapian.  I  mean  you're  working  with  the  book. 
Mr.  Wnss.  Right 

Mr.  Kaplan.  And  some  people  can  work  with  the  book  much 
better  than  they  can  work  in  class.  So  to  estimate  how  many 
people  use  a  review  book,  I  don't  knpw.  But  it  must  be  a  great 
number.  / 

.  I  would  say  a  person  would/be  pretty  silly  to  go  into  the  test  cold. 
And  if  he^s  going  to  ^ooach  himself  by  means  of  review  book,  fine. 
But  to  take  the  test  cold,  I  think  is  certainly  a  very  inappropriate 
method  of  attack. 

Mr.'  Weiss.  We  had  testimony  both  at  the  beginning  of  these 
hearings  back  in  1979,  and  then  yesterday  from  Dr.  Cooper  who 
represents  the  MCAT.  , 

Mr.  Kaplan.  Yes. 

Mr.  Wxiss.  And  you  know,  they  just  developed  a  new  examina- 
tidn  which  they're  very  proud  of  . 
Mr,  Kaplan.  It's  not  that  new.  Since  1977. 
Mr.  Wkiss.  Right.  Well,  relatively  new. 
Mr.  Kaplan.  OK. 

Mr.  Wnss.  And  they're  very  proud  of  it.  Hnd  they  take  the  posi-' 
tion  that  because  the  test  focuses  on -a  particular  area  of  the  begin- 
ning coU^  course,  and  a  number  of  science  areas,  that  if  they 
were  to  disclose  thoee  examination  questions  and  answers,  that,  in 
fact,  they  would  irun  .out  of  questions  to  ask.  \ 

And  I  wonder  if  you  have  any  comment  on  that  at  all?  , 

Mr.  Kaplan.  Well  it's  very  oifficuli  to  give  a  denEite-answexLbut^ 
from  my  knowledge,  and  I  was  a  mi^or  at  science  in  college — in 
fact,  I  applied  to  medical  school,  but  being  the  tender  age  of  17,^1 
was  turned  down.  Also  my  name  W9S  Kaplan,  but  thats  another 
-story.  There  is  a  bulletin,  the  MCAT  bulletin' of  information,  and  it 
lists  a  series  of  all  the  topics  in  all  the  sciences,  biology,  chemistry, 
physics,  math.  And  they  list  the  topics  they're  going  to  ask.  And 
th^  promise  fon  a  stack  of  Bibles  it  will  be  only  tn^  topics. 

Iiierefore,  they^re  narrowing  themselves  down  to  a  very  limited 
area.  Of  this  is  good  information  for  the  students,  hecaviae  the  stu- 
dent knoii^  exactly  which  areas  to  go  over.  Iii  fact,  the  bulletin 
leaves  out  magnetism.  Why,  I  don't  know;.  But  a  student,  when  he 
sees  that  mijgnetism  isn't  included,  right  away  says,  '1  y^on%  study, 

review  maffnetjMa."  — — - 

— This'bothers  me.  I  teach  it  in  my  course  anyhow.  But  I  say,  our 
job  is  to  give  you  a  science  review.  And  so  it  won't  be^on  the  test. 
So  what?  You  learn  something.  Maybe  it'll  help  vpu  in  medical 
school.  Because  they  do  use  magnetism  principles  in  medical 
school,  too. 

Well,  the  point -is  that  because  the  basis  for  items  is  very  nar- 
rowed, I  can  see  Dr.  Cooper's  point  of  view.  But  I  cannot  see  Or. 
Cooper!i>point  of  view  of  not,  at  least,  releasing,  say,  a  test  every  2 
years.  The  bulletin  has  41  .sample  t^t,  but  it's  not  a  full  sample  test 
They  have  a  small  sample  test  of  about— there  wer^  300  questions 
ion  the  test,  and  they  have  a  small  sample  test  of  about  75  ques- 
*tions.  Now  the  bigger  one,  they  didn't  give  it  the  first  year.  But  the 
next  year,  they  released  a  bigger  test  of  203  questions.  
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And  I  asked  once  why  not  a  whole  teat  of  300  Questions.  They 
■aid  bebauae  we  don't  have  that  many  questions  to  release,  so  we 
can't  even.gi^  one  full  teat.  ,  ^  .  't         ,^  ,  xi. 

So  the  JUMC  must  reislly  be  convmced  that  they  can't  do  it  thw 
can't  even  release  enough  questions  for  one  complete  test.  Of 
course,  these  questions  are  standardized,  and^  some  are  very,  very 
BcqfAusticated,  and  they  might  be  very,  very  difficult  to  be  able  to 
put  those  4uestions  together.  ^-  a  ^ 

And  I  know  as  far  as  remembering  questions  of  those  kind  of 
teits,  forget  it  Because  if  you  try  to  iremeimber  th$m,  you  re  giving 
the  students  more  problems.  ^  j   *  u  j 

Mr.  Waua.  What  kind  of  experience  have  your  students  had  with 
the  MCAT?  ,  . 

Mr.  Kaflan.  I  would  say  very  good  expenence. 

BIr.  Wiiae.  OK.  .  .    ^      .         j,  • 

Mr.  Katlan.  Especially— the  mmonties  have  improved  very  sig- 
nificantly. They  experimented  in  Texas-^that  was  a  definite  scien- 
tific proposal,  because  here  you  had  the  students,  lliey  had  tdcen 
the  MCAT  once.  Ttey  took  my  program  over -the  summer,  about 
200  hourt.  And  they  took  the  test  again  after.  And  so  here  you 
haye  a  pretty  good  kind  of  evidence,  arid  it  did,  for  them,  produce  a 
■inlificarit  improvement. 

'  "Mr.^Wnas.  Canyou  quantify  it?  .    *  t  u 

Mr.  Kaplan.  Tne  improvement  was  something  about,  I  would 
say.  1.2  pointa  per  subject.  Something  like  that.  Not  as  much  as 
other  students,  because  remember,  these  are  disadvantaged  stu- 
dents who  have  had  poor  backgrounds  to  start  wiui. 

But  in  other  words,  the  percentiles  would  go  up,  say,  from  a  per- 
haps 20  or  30  percentile  to  maybe  a  50  or  60  percentile,  m  nwmy 
caaM.  Some  just  from  a  20  to  a  40.  Some  didn't  improve  at  all.  But 
the  fact  that  Dr.  Medina,  who  is  in  charge  of  the  program,  aaked 
for  its  coritinuation.for  another  2  years,  and  it  was  amtmued--tlu8 
is  the  third  time  we've  given  it.  I  was  jusf  told  yesterday  that  HHS 
had  given  them  another— granted  another  proposal  for  the  cwitmu- 
ation  of  another  3  ywws,  shows  it  must  be  some  positive  effect  of 

'**Si!^'KSLSo_that-as-fai-as-your-8chool"and~y6^ 
Concerned,  the  fact  that  the  MCArs  are  not  released  at  all  beyond 
that  one  sample  that  they  provide,  is  not  a— it  doesn  t  Imut  you  at 
all  in  being  able  to  instruct  your  students  in  the  subject  area  of  the 

Mr.  Kaflan.  That's  right.  Because,  in  fact,  I've  nevw  had  more 
help  from  the  AAMC,  because  they  have  thlat  whole  syllabus. 
B^ore  I  was  floundering.  There  may  be  some  botany.  Now  I  know 
exactly  which  areas  which  will  be  covered  bjr  the  test.  I  stiU 
expand  on  it.  But  they've  been  very  helpful.        \  ,  ^ 

Silt  you  see,  you  still  need  review.  Because  m  ma«h,  they  say,  ffo 
back  and  review  the  contents  of  a  second  year  algebra  textbook. 


Now  when  is  the  last  time  a  student  who's  in  his  ji^or  year  in 
college  bein  conversant  with  a  second  year  high  schdtd  algebra 

twrtbook?  ,       ^.         _  ^  \* 

And  a  good  student  can  study  on  his  own.  But  you  see,  iiitereet- 
ingly  enough,  we  have,  for  instance  in  Boston,  students  from^the 
very  preat^ous  schools,  such  as  Harvard  and  MIT  taking  imr 


899 


,  .895 

courses.  Why?  Because  everybody  admits  yotunust  review.  The 
AMC  in  its  Dookiet  sa}^  you  must  review:  Biit  students  find  that 
they  need  a  commitmenjb,  because  they  have  so  many-things  to  do; 
If  they  don't  enroll  in  a  course  they  really  won't  review.  Their  time 
is  very,  very,  very  constlrained.  And  therefore,  they  are  looking  for 
opportunities  of  having  an  efficient  means  o^  review.  And  our  pro- 
gram provides  that.  ( 

,  Mr.  Weiss.  Mr.  Kaplan,  we  have  to  break  again.  There's  a  vote 
on  the  floor.  We'll  be  back  in  10  minutes.  The  conmaittee  stands  in 


[Recess  for  30  mihut^, 

Mr.  Weiss.  Mr.  KaHn,  again,  the  committee  will  resume  hear* 
iiun  and,  again,  my  appreciation  to  you.  We  were  talking  about  the 
MCAT  and  your  capacity  to  teach  that  within  the  perimeters  of 
what  they  test,  even  though  they  have  not  disclosed  any  of  their 
examination  questiona  except  for  the  sample  t^  that  they  provide. 

Mr.  Kaplan.  The  sample  test  give  a  very  gdod  idea  of  what  it's 
about.  In  fact,  you  know,  the  first  exam  that  was  given,  we  did 
very  well  with  it  even'  though  it  was  an  entirely  new  test.  And  the 
samples  that  they  gave  were  an  excellent  guide  for  making  up 
questions.  We  have  a  large  staff  that's  continually  making  up  new 
questions,  based  upon  what  we  think  are  important. 

Mr.^  Weiss.  Have  you  had  occasion  from  time  to  time  to  review 
the  SAT  questions,  and  determine  what  percentage  of  them  address 
specific  sul^ects  and  what  percentage  of  them  really  are  reading 
comprehension? 

Mr.  KAplan.  Are  you  talking)  about  the  math  or  the  verbal? 
.Mr.WMSS.  Verbal. 

Mr.  Kaplan.  The  verbal?  Well,  as  far  as  I'm  concerned,  the  com- 
pletions are  a  short  form  of  reading  comprehension.  In  fact  the  an- 
alffies  are  really  another  form  of 'asking  the  vocabujaryqu^tions^ 

In  fact  the  SAT,  when  they  give  their  scores,  gives  a  suoecore  in 
the  vocabulary,  and  then  subscore  in  reading  comprehension.  So 
even  tholigh  there  are  four  types  of  verbal  questions,  there  are 
only  two, subflcores.  Do  you  follow  what  I  ipean? 

Mr.  Weiss.  Yes.' Yes,  I  do.  Do  indeed.  ^ 

Mr.  Kaplan.  So  percentage  wise,  I  mean,  reading  comprehension 
is  reading  comprehension.  I  don't  underatand  what  the  alterna- 
tives  

Mr.  Weiss.  It's  reading  comprehension,  rather  than  specific  sub- 
ject matter. 

Mr.  Kaplan.  Well,  no  subject  matter  whatsoever.  You  don't  have 
to  have  aiiy  previous  knowledge.  In  other  words,  the  ACT  some- 
times-gives  questions  in  their  reading  classes  based  upon  previous 
knowledge. 

Mr.  ¥^8S.  Right.! 

Mr.  Kaplan.  But  here,  you're  told  in  the  College  Board  direc- 
tions, that  all  information  is  obtainable  in  the  paragraphs  that 
you're  reading.  Did  I  make  that  clear? 

Mr.  Weiss.  Yes.  Yes,  you  have. 

Isothere  a  requirement  for  there  to  be  a  previous  knowledge  of 
English  grammar? 

Mr.  Kaplan.  Yes;  definitely.  Bmiuse  there's  one  section,  you 
know,  the*  writing  ability  section,  standard  written  English,  and 
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that  it  a  definite  iequirement-?you  certainly  haVe,to  know  a  vwb 
and  eufalact  agreement.  You  have  to  know  dangling  purticiplee  and 
•o^forthTiidi  t^^  ^        /  ^ 

llr.^iin.  Now  you  have  courBeer-you  have  claaeee  that  you 
give  armipd  the  oounl^  now.  b  that  right? 

Mr.  Kaflan.  That's  correct. 

Mr.  WimB.  How  many  locations? 

Mr.  Kaflan.  106.  .    '      . ,  ^      ^  n 

Mr.  Wins.  106  different  locations.  Anil  assume,  but  you  tell  me 
if  j!m  wrong,  that  you  have  different:^eUmic  compositions  m  your 
student  bques,  depending  on  where  those  locations  are. 

B4r.  Kafuah. JThat's  rifiii  ...      .1.    .1  u 

Mr.  Wnss*  Have  you.been  able  to  determine  either  through  any 
kind  of  formal  analysis  or  really  by  just  some  impressions  that  you 
have  as  to  variations  in  performance  of  the  students  from  vanous 
parts  ci  the  country  on  the  SATs?  „  .  .    ^    ^  ^i. 

Mr.  Kaflan.  I  don't  know  if  it's  a  matter  m  different  parts  of  the 
country.  I  do  know  it'ai  when  it  is  advantaged  and  disadvantaged. 
And  that's  in  all  parts  of  the  country. 

Mr  Wraw.  Expand  on  thatft  litUe-bi^-ifyw^  .  ^ 

Mr.  Kaflan.  Yes.  The  disadvantaged  students,  for  «amrfe,  just 
give  you  an  example  in  my  own  miheu  of  New  York  City.  The  stu- 
dents conie  in  with  a  very  limited  knowledge  of  math.  They  re  m 
their  junior  year  of  high  school  and  can't  handle  their  multiplica- 
tion tables.  They  can't  multiply  fractions.  They  don't  know  what 
decimals  are.  And  vet,  they're  supposed  to  take  an  SAT. 

I'm  not  saying,  I'm  not  using  this  in  any  derogatory  fashion  

Mr.  Wkss.  Yes,  right.  . 

Mr.  Kaplan.  I'm  Just  bemg  very  objective, 

Mr,  Wmss.  Rights  .    \  \      .    1     ^    ,  Vt 

Mr.  Kaflan.  in  vocabulanr,  their  vocabulary  is  almost  ml.  I  m 
not  talking  about  street  vocabulary.  I'm  talking— I  don  t  mean  that 
in  a  pejorative  sense  also,  but  the  common  vocabulary,  fine.  But  if 
you  take  a  word  like  "adamant",  you  mean  stubborn,  well,  they 
have  problems.  ^  ^, 

Mr.  WnsB.  What  was  the  word?  I'm  sorry. 

Mr.  Kaflan.  Adamant.  Adamant. 

Mr.  Wnss.  Adamant?  •    ,      ,^      .  i..  r  •  j 

Mr.  Kaflan.  Yes.  So  that's  a  word  one  doesn't  say  to  his  fnend, 
"I'm  adamant."  He'll  say,  'Tm  stubborn^' 
Mr.  Wnss.  Right. 

Mr.  Kaflan.  And  so  therefore,  obviously  if  you're  going  to  go  to 
college,  you  have  to  have  certainly  a  stronger  vocabulary  in  order 
to  be  able  to  read  and  you  have  to  have  a  lot  of  experience  m  terms 
of  reading  passage,  how  to  mt  inferences  from  the  passage,  how  to 
connect  idMS,  and  find  out  &e  ideas  that  are  being  presented. 

These  are  experiences  that,  unfortunately,  the  students  haven  t 
had— these  disadvsintaged  students,  because  they've  gotten  a  veipri 
very  inferior  education.  This  was  the  point  that— addressed  m 
terms  of  equaLopportunities.         ^    .  ,  ^  u 

The  big,  big  problem  is  reaching  out  I  beheve  very  much  the 
way  the  C^lic  Church  believei.  ''Give  me  a  chUd  from  1  to  6. 
and  I'll  hi^ve  him  for  the  rest— him  or  her,  for  the  rest  of  my  hfe. 
jpimr^'m  M  tf^mendous  amount  that  has  to  be  done  in  terms  of  a  dis^ 
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ciplined  kind  ot  education  and  a  tremendous  amount  of  assistance 
on  the  part  of  government  to  provide  these  opportunities. 

But  tnere  are:— still  there  are  other  minority  groups  who  aire  not 
disadvantaged,  and  they  perform  just  as  well.  I  ve  had  mahy— and 
I  freauently  ask-^I  see  a  black  studeift  who  scored  700  on  the 
Boards,  on  the  SAT,  and  I  say,  ''By  the  way,  what  do  your  folks 
do?"  "Well,  my  father  is  a  physician.  My  mother's  a  nurse."  What- 
ever. 

Family  participation,  family  encouragement,  is  entremely  impor- 
tant, i  cbn't  know  if  xou've  heard  of  the  Beasley  School  in  Chicago. 
That's  a  real  demoriiltfation/The  Beasley  School  in  ChicSj^  whelrfe- 
the  superintendent— she  was  oh  "60  Minutes"  once-^^dr  "If  God 
had  believed  in  permissiveness,  God  would  have  issued  to  Moses 
the  10  sunestions."  Which  I  think  is  very,  very  meaningful. 

It's  a  (usciplined,  oriented  kind  of  program.  Students  wear  uni* 
forms.  The  parents  have  to  sign  contracts  with  the  school  to  go 
oyer  the  hbmewdrk,  to  participate  in  the  homework,  and  attend 
PTAs.  And  if  ^they  don't,  the  children  are  dropped.  It's  a  very,  very 
successful  school.  ,  * 

The  trouble  is,  it  was  $5  million  federally  funded  project  and  it 
stops  at  the  eighth  grade.  What  happens  from  there  oh,  I  don't 
know.  But  to  me,  if  you  don't  give  the  disadvantaged  what  they  de- 
serve, then  we're  Roing  to  get— as  the  advantaged— :what  we  de 
serve  in  terms  of  tne  problems  later  on.  And  I  couldn't  feel  more 
strohgly  about  that. 

Mr.  Wnss.  Have  yoh  been  able  to  determine  whether  there  is  a 
difference  in  performance  on  either  part  of  the  SAT,  based  on  geog- 
ramy^that  is,  what  part  of  the  country  the  test  is  given?  Or  by 
gender?  ^  . 

Ir.  Kaplan.  No.  Neither  by  gender,  nor  race, 
ccept,  of  course,  J.'m  saying,  in  i^rms  of  disadvantaged.  ^ 
haven't  noticed^ariy  differenc».^Of-courBe,  I  can't--J 'haven't  i^ji?* 
lined  all  statistics  throughout  the  country,  but  I  visited  all  parts 
the  country,  talked  to  my.administratprs^  and  I've  asked  this 
bestion  *a  number  of  times. 

[And  of  course,  you  realize  I'm  going  on  the  basis  of  a  smaller 
lumber  of  statistics,  because  in  different  parts  of  the  country, 
there's  different, amount  of  interest  in  terms  of  prepariiig  for  the 
^AT.  This  ts  a  poiift  that  was  brought  out-*or  wasn  t  brought  out 
forcefully,  that  most  people  throughout  the  country  aren  t  inter- 
ted  in  the  SAT  on  the  A(^  as  far  as  the  performance,  ^because 
ihey're^just  used  as  sort  of'guidos.  You're  accepted  but  the  collie 
look  upon  it-^the  scores— as  guides  to  channel  you  once  you're  to 
Allege.  But  they're  not  used  for  adinissions  purposes. 

In  Ohio,  if  you  have  $400  in  cash,  you're  accepted.'  So  therefore, 
the  SAT,  since  the  standards  are  so  low,  except  tor  the  competitive 
colleges,  the  staihdards  are  very  minimal  and  therefore  Xne  SAT 
score  or  need  for  coaching  is  insignificant. 

Mr.  *WiiS8.  Do  you  find  that  the  students  Who  come  to  you  for 
the  most  part  go  for  the  more  competitive  colleges? 

Mr.  Kaplan.  T  would  say  there  are  some  that  come  to  us  just  be- 
cause of  thf»^  math  and  verbbi  skills.  But  I  would  say,  yes,  more  or 
less,  they  go  lor  the — not  the  very  competitive  colleges.  But  I  think 
part  of 'it  is  that  it's  a  combination  of  both. 
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The  fitrento  want  to  be  aikured  that  the  children  wiU^perfpnn  at 
coUegeTt  a  reiaonable  level  And  wi  SAT  wore  which  reade  out 
the^th  and  verbal  ikills,  %e  parents  feci  coaching  may  be  of 
hdp  in  givine^thia  kind  of  "reading.  '     ,  \ 

Mr.  WKM.  You  don't  reallVfeUeve  that  the  people  wh<^  go.  to 
ybiir  courMi  go  in  order  io  haVe  a  refresher  courae  m  the  wJjiKt 
matter,  rather  than  to  get  a  better  grade  on  the  SAT,  do  you?^ 
Mr.  Kaflan;  They  come  for  tdth.  For  both.      ^  ,  . 
Mr  WiMB.  Wouldn't  you  think  that  the  overwhelmmg  percent^ 
age,  people  who  come  to  take  yoiir  courses*  take  ifein  order  to  jm- 
^prove  thei^  chance  of  getting.a  higher  grade  in  the.course? 
Mr.  Kaflan.  I  would  say  so,  yesA 

Mr.  WsiSB.  I-would  think  so,      \  ,  /  „    .  4 

Mr.  KaMan.  But  Tm  just  saying  that  ail  the  parents  J  ve  neard,. 
.  say-  that  their  children  have  learned  a  lot.  And  thei«fora,  even 
theugh  they're  looking  for  a  bistterVscore,  they  realize-^its  been 
Hud  to  me  many,  many  times.  "We'rt  coming  here  to  get  a  maxi^ 
mum  SAT  score.  We  also  realiae  thit  our  *iid,  will  leani  a  lot 
based  upon  what  they've  heard  from  ottier  students. 

I  couldQ't  advertise,  "improve  your  liiath  and  yerbal^kato,  and 
tit  maSy  students.  l^Then  I  say,  "pre^  for  the  SAT>"  Uiey  aUi 
come.  But  whether  the?-  know  it  or  not,\ they're  getting  a  tremen- 
dous education  as  far  as  mcth  and  verbal  skills  are  concerned,  . .">o 
that's  the  deviceU  have  to  use.  That's  the  ^eyice. 
^  But  I'm  satisfied  as  an  educator  that  they  re  learmiig^spinetfcing. 
'  Mr.  WnsB.  That's  doing  well  by  doing  good  or  soniethmg;  right? , 

Mr.  Kaplan.  Something  like  that.        •  K 

Mr.  Wbw.  Right  listen,  I  really  very  much  appreciate  the  testi- 
mony that  you've  given  us..I  gueAs  one  final  question.  •  1 

How  did  you  feel  during  those  years,  which  were  untu  verv  re- 
cently, when  the  college  entrance  examination  .  board  iwople  kept 
on  saying,  nothing  you  can  da  by  way  of  prepturation  is^  going  to 
help  you.  That  you've  either  got  it  or  you  don  t  have  it.  And  don* 
bother  trying  to  prepare  forth*^  tests.        ™  .  .   ,^     »a  j  A 

Mr.  Kaplan,  f  kept  sr.ying,  "This  isn't  so.  This  isn  t  so.  And  A  . 
spokA  to:.adviser8.  Th?s  isn't  so.  fc  fact,  this  is  mteresting.  A^ 
liWyer,  after  the  'iSM  Donahue  Show"  about  let's  get  rid  ot  the  \ 
SATs,  a  lawyer  called  me  up  from  Washington  and  suggestedl  sue  \ 
the  ETS  because  of  all  the  studente  I  lost  over  the  years  who  be- 
Ueved  wliatm  had  naid,  that  you  CM't  prepare^   .      ^„  u.„„„ 

But  of  course,  I'm  not  concerned  about  that.  I  m^just  very  happv 
about  the  Fact  that  even  the  college  board  and  ETO  have  acknowl- 
edged the  fact  that  the  SAT  is  ri«t-#ell,  I  don't  think  they  reaUv 
m<Mnt  it  to  be  a  te^  of  innate  aptitude.  But  they  hayfc  acknowl- 
edged the  fact  that  it  is  an  achievement  type  of  test,  and  therefore, 
ihat  you  can  be  helped.  And  a  long-range  program  cap  help,  while 
cram  courses,  most  likely,  won  t. 

And  J  certainly  subscribe  to  that.  But  someone  here  asked  me, 
.  don't  you  provide  financial  aid"  Suppose  you  can  t  afford  it?  Be-  ^ 
cause  this  is  unfairness.  And  we  try  to  go  to  aU  the  ad.viserB 
throuAout  the  country,  "elementary,  high  school,  and  av  coUege 
leveland  professiopal  school  level,  letting  them  know  that  if  a  stu- 
is  disadvantaged,  and  cannot  afford  the  program.  I  don  t  mean 
reluctant  to  pay,  but  cannot  afford  to  pay— if  we  get  the  documen- 
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tation  of  the  school,  we  will  provide  the  service  even  though  they 
cati!t  pay.-  • 

Mr.  Weiss.  And  isn't  it  also  somewhat  ironic  that  the  FTC  stud- 
ies were  precipitated  by  a  question  as  to  whether  vour  claims  were 
valid  or  not  as  to  whether,  in  fact,  you  were  able  to  help  people 
prepare  Yor  those  tests?  And  it  ended  up  being 
whether  the  college  entrance  examina,tion  board,  and  ETS,  Was 
bcmg  accurate  in  its  representation  that  in  fact  you  couldn't  pre- 
pare for  it? 

Mr.  Kaplan.  Sometimes,  you  know-^this  is  interesting  that  I'm 
suspicious  that  that's  what  they— the. FTC— had  in^ their  mind 
originally.  TTiat  \hey  knew  that  my  work  was,  you  know— that  my 
programs  were  producing  results.  And  this  was  sort  of  a  indirect 
way  at  showing  that  the  claims  of  the  testing  service  weren't  neces- 
sarily what  they  professed  to  be:  ^ 
•So Tm  not  siirer —    /  , 

Mr.  Wsiss.  You're  re^y  an  optimist  at  heart,  aren't  you? 

Mr.  Kaplan.  Well,  I/do  know  that  Arthur  Levine  resigned  right* 
after  aud  he  became  t^e  lawyer  f(  r  NEA;  National  Educational  As- 
sociation. And  he's  a^  strong  supporter,  antitesting  supporter.  So 
^  again^  I  don't  know  ;What  the  orignal  purposes  were.  But  some- 
where along  the  lin0,  as  the  invemgation  went  along,  I  felt  they 
weren't  targeting  mei  They  were  targeting  the  testing  services. 

Mr.  Weiss.  That's /how  it  worked  it? 

Mr.  Kaplan.  But  that's— well,  I  think,  you  know,  it  worked  out 
at  the  end.      .  L 
Mr.  Wejss.  RighV.  .  ^    .  , 

Ml .  Kapi2/^.  But  I  think  all  along,  I  kept  getting  a  feeling  that 
that's— that  ^as  t)ie  target. 

^  Mr.  Weiss.  You  carry  your  shield  of  innocence.  And  apparently, 
it's  worked  very  well. 

Mr.  Kaplan.  Well,  I  don't  think  it^s  a  matter  of  shield  of  inno- 
cence. I  think  it  was  a  "matter  of  confidence  that  knowing  what  I 
was  doing,  and^I  had  fi)tll  confidence  in  knowing  the  outcome.  Be- 
cause I  couldn't  hav^  existed  for  40  years.  You  can  fool  some  of  the 
people  all  the  time  and-so-forth  

But  until  1970, 1  h£^iiever  advertised  at  all.  It  was  all  by  word 
of  mouth.  It  was  only  after  1970,  as  I  said,  before  this  came  about. 
So  I  don't  think  that  more  than  100,000  people  over  the  years  can 
be.  wrong.  And  it's  . a  very  satisfying  thing  as  far  as  I'm  concerned. 

Mr.  Weiss.  Well,  again,  I'm  grateful  to  you  for  coming  down,  for 
spending  all  of  this  time  with  us.  And  I'm.  sure  that  if  we  ever  have 
need  of  calling  on  your  knowledge  and  wisdom  and  expertise,  that 
you  will.make  yourself*available  to  us. 

Mr.  KA^lXn:  Have  satchel,  will  travel. 

Mr,  Weiss.  Thank  you  voiy  puch.    '  <> 

I  understand  that  Mr.  Messick  had  to  leave,  but  that  Mr.  Good- 
ling  has  indicated  that  he  will  submit  questions  to  Mr.  Messick  Jn- 
^ting,  and  those  questions  and  answers  will  be  then  be  included 
within  the  record. 

The  hearing  now  stands  recessed,  subject  to  call  of  the  Chair. 

[Whereupon  the  hearing  was  recessed  subject  to  call  of  the 
Chair.]  .  t 

'  [Material  submitted  for  inclusion  in  the  record  Tbllows:] 
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PftVAKiD  BrMtuwHT  or  Amociahon  or  Amuican  Pubushkbs,  Inc. 


This  statonent  is  submitted  ort  behalf  of  the  Test  Conmittee  of  the  • 
Association  of  Anerican  Publishers  (AAP).   AAP»  which  is  the  general  association 
of  book  publishers  in  the*  United  States,  includes  rwng  its  members  companies 
from  the  standardized  testing  community.   Several  companies,  however^  while 
members  of  the  :AAP  Test  Conmittee,  are  not  members  of  our  association;  namely, 
Harcourt  Br.ace  Jovanovich'  and  Science  Research  Associates. 

While  several  of  our  members  provide  tests  for  college  entry,  most  of 
our  members  are  the  source  of  tests  which  are  used  in  elementary  and  secondary 
schools  or  by  private  enterprise  for  hiring  and  promotion.    Our  concern, 
therefore,  encompasses  both  the  Weiss  and  Gibbons  bills  pending,  before  this 
committee  —  especially  as  they  may  be  combined  —  and  our  testimony 
consequently  deals  with  each  of  these  measures  in  some  detail. 
«  '  jh.— 

Before  commenting  on  specific  provisions  of  each  bill,  we  shoald  like 
to  make 'Some  general  observations.  -  ' 

Pending  Legislation  Oiscrininates  Against  Smaller  Companies 

Jjie  Commissioner  of  Education  of  the  State  of  New  York,  Hon.  Gordon 
Anbach>  in  his  October  16,  1979  report  stated  that  some  20  of  26  admissvon  tests 
.whkn  h^d^been  available  in  New  York  in  1979  would  be  withdrawn  from  use  in  the 
Stite  in  1980.    It  is  interesting  to^note  in  this  regard  that  the  tests  which 
hive  been'the  spotlighted  targets  of  criticism      tests  from  the  Educational 
Testing  Service  (ETS)  and  American  College  Testing. |ACT) ,  the-^iants  in  the 
field      would  continue.   But  other  tests,  the  products  of  smaller  companies  and 
administered  In  less-than-carload  lots,  were  the  ones  being  withdrawn. 

While  the  New  York  State  stafute  has  since  been  amended  so"tfr»tthe 
tests  furnished  by  the  smaller  companies  can  su?:vive,  no  similar  effort  ha^been 
made  to  alter  the  pending  legislation.   Much  hak  been  said  at  these  hearJftgs^ 
about  the  shortco^nlngs  of  ETS  and  its  Scholastic  Aptitude  Test  (SAT)  aniUioW  the 
pending  legislation  is  needed  to  correct  their  alleged  abuses,  but  the  fact  is 
that  the  Weiss  bill,  as  experience  with  the  1979  New  York  statue  after  which  It 
is  modeled  indicates,  will  permit  ETS  to  continue  its  operations  at  the  expense 
of  its  smaller;  profit-making  competitors.    It  brings  to  mind  the  Old  Mac 
Sennett  silent  comedies  where  the  custard  pie  was  aimed  at  one  individual  but 
hit. another.    It  is  the  smaller  companies  which  are  getting  the  custard  pie  in 
the  face. 

This  unconcern  for  the  fate  of  the  smaller  tests  wss  most  recently 
pointed  up  in  the  November  4  testimony  of  Mary  Ann  Austen,  Counsel  to  New  York 
St^t§  Senator  Kenneth  P.  LaValle,  the  sponsor  of  New  York  State's 
Truth-in-Testing  Law.    When  asked  about  tests  which  were  no  longer  being  given 
in  N*w  York  State,  Mrs.  Austen,  who  had  previously  discoursed  on  the  "success" 
of  the  state  staftute,  said: 

There  are  a  few  /small  test%7  that  have  not  come  back  * 
for  one  reason  or  another.    It's  —  it's  not  within  my  * 
knowledge  at  this  point  to  know  if  in  fact  they're 
given  anywhere  else  anymore.   They  may  just  not  exist 
anymore.    In  any  case,  the  slack  has  been  picked  up  by 
other  tests. 

In  other  words,  the  New  York  sponsors  of  truth-in-testing  legislation 
have  never  really  bothered  to  find  out  about  the  smaller  tests  which  were 
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displaced  by  their  )aw.   But  never  mind,  the  big  boys  have  taken  over. 

Section  5  (b)  of  the  Weiss  bill  does  exempt  tests  given  to  less  than 
S,000  persons  from  the  provisions  of  Section  S.  ,  However,  two  things  must  be 
noted  in  this  regard.   First,  Sec,  5  (b)  applies  to  orily  one  provision  — 
Section  5  —  of  the  Weiss  bill;  smaller  companies  are  still  covered  by  the  other 
parts.   Second,  ft  should  be  emphasized  that  tiie  5,000  national  exemption 
exteoded  by  Weiss  is  the  same  as  the  exemption  contained  in  ^he  amended  New  York 
bill  for  that  one  state  alone.    In  swnmary,  the  5,000  Weiss  exception  is  of 
little  meaning^ and  effect.  ^  ' 

In'^'additfon  to  ignoring  the  improvements  which  were  mad^  in  tfie  New 
,York  State  law  to  keep  the  smaller  companies  from  being  Unduly  penalized,  the 
Weiss  bill  has  added  other  refinements  of  its  own  ijot  contained  in  the  New  York 
statute  which  are  inimical  to  the  smaller  test  makers.   One  of  these.  Sec.  4  (a) 
(1)  (B),  fequires  filing  with  the  Secretary  of  Education  a  copy  of  the  contract 
wheriJ  one  test  agency  produces  .or  develops  a  test  which  is  sponsored  or 
adninistered  by  another  agency.   Another,  Sec.  7,  requires  filing  with  the 
Secretary  the  dollar  amount  of  fees  received  for  each  test  program,  the  total 
amount  of  revenue  received  from  each  test  program,  expenses  of  the  test  agency 
by  test  program,  overhead  expenses  of  the  test  agency  and  other  proprietary 
information. 

It  has  never  been  demonstrated  how  consumers  will  be  helped  by  these 
provisions  requiring^ disclosure  of  proprietary  data.   The  argument  has  been  made 
that  since  public  utilities  reveal  this  information,  our  testing  companies 
should  be  held  to  the  same  standard.    I  guess  that  would  be  fine  if  testing 
companies,  like  publ.ic  utilities,  were  under  the  law  also  guaranteed  a  profit. 

A  Double  Standard 

It  is  unfortunate  that  the  proponents  of  "truth-in- testing" 
legislation  have  not  seen  fit  to  advocate  similar  standards  for  the  Federal 
establishment  itself.    The  Gibbons  bill,  HR  1312,  for  example,  requires  that  job 
entry  examinations  meet  certain  prescribed  requirements.    It  seems  strange  that 
the  Congress  should  impose  these  requirements  upon  the  private  sector  --^ 
requirements  which  for  the  most  part  have  not  undergone  trial  --  without  first 
imposing  them^upon  tests  given  by  the  Federal  government  itselr. 

If  the  testing  practices  to  be  imposed  by  the  pending  legislation  are, 
in  fact,  important  to  protect  "the  rights  of  individuals  and  the  national 
interests'*  and  "to  protect  the  public  Interest"*  it  seems  only  proper  that  the 
very  first  step  should  be  taken  by  the  Federal  government  itself  in  the 
interests. of  the  many  individuals  talcing  civil  service  examinations  each  year, 
as  well  as  the  many  who  ta!;e  armed  service  examinations. 

In  this  connection,  we  would  also  like  to  invite  the  Corrmittee's 
attention  to  Sec,  3  of  the  Privacy  Act  of  1974  (PL  93-579)  which  added  a  new 
Sec.  522a  to  Title  V  of  the  U»S.  Code.    Subsection  (k)  -  "Spec,ific  Exemptions" 
—  of  thdt  section  permits  an  agency  head  to  "exempt  any  system  of  records 
within  that  agency"  from  certain  disclosure  and  access  requirements  of  the 
.statute.    The  law  includes  among  these  exemptions  the  following: 

(6)  testing  or  examination  materials  used  solely 
i  to  determine  individual  qualifications  for  appointment 

.  or  promotion  in  the  Federal  service,  the  disclosure  of         ,  — 
1  which  would  compromise  the  objectivity  or  fairhess  of 

I  the  testing  or  examination-process; 

So; what  we  ^ee  here  i&  fioX  only  that  th'e  Congress  is  reluctant  to  apply 
soicalled  truth-in-testing  standards  to  the  Federal  establishment,  but  it  has 
enacted  legislation  to  exempt  Federal  agencies  specifically  from  such  a 
requirement.   At  the  very  least,  one  would  expect  that  the  proponents  of 
truih-in-testing  would  ask  for  repeal  of  this  provision. 


*S^e  Sec.  3  of  HR  1312  and  Sec,  2  of  1662  • 
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Legislation  Does  Not  Deal  With  a  Principal  Problem 

 — - — ^^^^-^ndardi  zed-Testing—  ^  


The  "NAACP  Report  on'Minority  Testing'',  published  by  the  NAACP  Special 
Contribution  Fund,  stated  that  "^it  cannot  be  over-emphasiied  that  the 
qualifications  of  the  examiner  or  test  user  are  equal  to,  U  not  more  important 
than,  the  tests  which  are  used,  since  even  the  best  instrument  in  the  hands  of 
unqualified  users  can  lead  to  disastrous  results."   He  agree.  Unfortunately, 
thi's  principal  issue  is  not  touched  by  either  of  the  bills  pending  before-this 
committee.   Here  Is  an  area  where  consumers  of  tests  can  be  helped  without 
imposing  Federal  controls  or  running  the  Janger  of  restricting  academic 
freedoms.    It  is  a  field  ripe  for  positive  effort. 

The  MP  Test  Committee ^takes  some  pride  'in  pointing  out  that  one  of 
the  positive  recommendations  we  have  made  in  this  area  was  enacted  into  law  — 
Sec.  503(b)(4)  of  the  Education  Amendments  of  1980  (PL  96-374)  authorized 
teacher  centers  to  provide  training  to  familiarize  teachers  with  developments  i 
testing  «&  well  as  in  curVfculum  development  and  educational  research. 
Unfortunately,  the  effect  of  this  provision  could  well  be  diluted  by  the 
Education-Consolidation  and  Improvement  Act  of  198HTitle  V-D  of  PL  97-35) 
which  consolidates  the  teacher  .center  program. 

What  we  stress  here,  however,  is  that  if  the  Congress -wishes  to 
protect  the  consumers  of  tests,  it  must  deal  with  the  area  which  the  NAACP 
report  emphasized  as  "equal  to,  if  not  more  important  than,  the  tests  which  are 
used";  nwely,  the  qualifications  of  the  test  examiner  or  test  user.  These 
hearings  can  never  be  considered  complete  until  this  question  is  adequately 
.dealt  *<ith.    Not  to  do  so  is  to  perform  a  disservice  o  those  who  are  said  to  be 
the  objects  of  the  pending  legislation's  concern. 

An  Unresolved  Issue 


After  enactment  of  the  New  York  State  law,  after  ^.whicTtnc  Weiss  Mil 
is  generally  patterned ,7-the  American  Association  of  Medical  .Colleges  challenged 
the  constitutionality,  of  the  law^in  the  Federal  District  Court  in.Rochester, 
^N.Y.  with  respect  to  property  rights  of  the  Association  in  the  medical 
examination.  ,  ,  ' 

A  Federal  district  judge  issued  a  temporary  injunction  against 
enforcement  of  the  requirements  of  the  law.   The  AAMC  also  argued  that  the  New 
York  law  requirements  violate  the  Copyright  Act  with  respect  to  the  medical 
admissions^st.   Until  these  issues  are  resolved,  the  Cojiwittee  should  refrain 
from  moving  on  the  pending  leji slat ion. 

HR  1312  (Gibbons -Bill) 

There  follows  some  coffimeats  on  specific  provisions  of  the  Truth  in 
Testing  Act  of  I98I  (HR  13i2)  int/jkhjfed  on  January  27,  1981  by  Representative 
Gibbons: 

1.  

"test".    This  couid  present  — .  _ 

For  example,  is  a  persqn  interviewed  by  a  personnel  director  or  a  college 
admissions  officer  being  subjected  to  a  "test"? 
s 


.  Sec.  2(3)  includes  oral  Examinations  within  the  definition  of 
is  couid  present  difficulties  both  in  enforcement  and  definition. 


~  "?."Se'c."^ffl  defines  "test  score"  as  a  numerical  wlue.  8esideri:he_ 
obvious  cwnpjicatlons  with -respect  to  oral  examinations.  Is  it  the  intent  of 
this  legislation  to  mandate  that  all  procedures  be  reduced  to  numerical  values? 
This  would  seem  to  preclude  a  simple  "pass-fail"  or  other  non-numerical  scores. 
On  the  face  of  it,  this  provision  would  seem  both  to  b,e  unwarranted  given  the 
current  statements  of  need  and  to  have  the  potential  for  unanticipated 
consequences  at  variance  with  the  central  purpose  of  providing  information  and 
insuring  equitable  treatment,  ^ 

*■ 

3.  Sec.  2(5)  includes  in  the  definition , of  "persons"  the  term 
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"societies".   Does  this  include  labor  unions?  Does  this  bill  govern  tests  for 
^admittance_intoJabqr.unlons»^especially-,when_^uch.*(!rojXtance_j:oattois_^^^^ 
into  an  occupation? 

4.  Sec.  6  raises  questions  as  to  who  specifically  shall  be  required  to 
furnish  the  Information  required  in  subsections  (b)  and  {c).  Admissions 
procedures  to  institutions  of  higher  learning^and^o  occupations  are 
represented,  in  practice,  by  a  variety  of  arrangements  between  agencies  which 
produce  tests  and  the  institutions,  organizations  and  commerical  concerns  who 
use  these  tests.    In  the  area  of  occupational  admissions,  the  test  producer 
usually  is  not  directly  or  indirectly  involved  in  the  actual  administration  of 
an  exOTination  and  thus  would  not  be  in  a  position  to  comply  with  all  the 
disclosure^l^ovisions  of  this  section. 

5.  Sec.  6  (a)(1)  and  (2).    It  is  not  clear  what  is  meant  by  a  ^ 
"detailed"  description. 

6.  Sec.  6  (a)(3).   The  term  "reliability"  has  not  been  defined.  Given 
the  number  of  interpr nit ions  of  this  concept  as  it  currently  applies  to  tests, 
it  should  be  more  thoroughly  examined.   Further,  the  Cownittee  should  note  that 
when  an  exenination  is  prepared  for  a  particular  purpose,  reliability 
Information  may  not  be  available  prior  to  the  administration  of  the  examination. 

7.  Sec.  6  (b)(2).   T^e  requirement  that  individuals  be  "ranked"  in 
relation  to.jDther  individuals  Is  inconsistent  wfth  Section  6  (c)  which  prohibits 
grading  of  tests  of  knowledge  or  achievement  on  the  basis  of  the  score 
distribution  of  exaninees.   Ranking  individuals  By  total  test  performance  may 
also  be  contrary  to  the  logic  ou  which  the  test  was  constr uc t ed  a nd  J n\conf  1 
with  currently  accefitedjan)Cfidut:es--of-c^  as  elements  in  the 

 overali^proti le ^character (ring  an  examinee.  ^ 

8.  Sec.  6  (b)(3)  requires  that  the  testing  agency  specify  cut-off 
scores  for  admission  to  institutions  of  higher  education  or  occupations.  This 
is  unreasonable  both  from  a  technical  viewpoint  and  in  terms  of  a  testing 
agency's  capability  to  fulfill  the  requirement;  Such  cut-offs  are  generally 
unknown  to  the  testing  agency  ih  both  academic  admissions  and  occupatl^pnal 
testing  programs.   Decisions  on  cut-off  scores  are  under  the  control  of  the 
admitting  or  hiring  institution  and  would  logically  change  with  changing  levels 
of  achievement  or  aptitude,  size  of  the  examinee  population,  and  available  jobs 
or  space.   The  use  of  single  cut-off  scores  is  discouraged  by  the  testing 
agencies  based  on  their  potential  misjse  as  a  mechanistic  way  of  using  test 
information.   The  use  of  cut-off  scores  would  also  tend  to  minimize  the  use  of 
other  criteria  and  would  be  detrimental  to  considerations  placed  on  criteria 

.,ojLher  than  test  results  contained  in  the  totality  of  a  potential  entrant's 
i^i-'*  abilUies. 

When  applied  In  the  occupational  testing  area,  the  use  of  cut-off 
scores  would  also  tend  to  lead  to  a  situation  In  which  no  differential 
decisions,  based  on  test  perforinance,  could  be  made  above  the  cut-off  score.  In 
the  long  run  this  situation  could  eventuate  in  rando«i  hiring  of  minimally 
qualified  individuals  rather  than  the  hiring  of  those  deemed  best  qualified. 

9.  Sec.  6  (b)(4)  should  be  deleted  becausq^  the  term  "further 
information"  is  unclear. 

 _40t  -5eC"-6"{  c)   -In-^ddlt-ion-^to -the-conf-l^ct-hetween-thls-sccUoo-and- 
Section^e  (b)(2),  this  section  also  calls  for  the  differential  treatment  of  the 
scores  obtained  from  achievement  tests  and  aptitude  tests.   Such  differential 
treatment  implies  a  distinction  in  theory  between  the  way  two  types  of  test  are 
treated  that  is  not  in  agreement  with  current  professional  thinking  in  testing 
methodology.   The  requirement  that  no  test  which  measures  knowledge  or 
achievement  shall  be  graded  on  the  basis  of  the  distribution  of  scores  of  othf^r 
test  subjects  also  assumes  a  static. lcv»!l  of  ability  in  our^populatlon  over 
time,  and/or  a  static  capacity  across  institutions  to  accept  admissions  or  hire 
applicants.   Both  assumptions  are  neither  desirable  nor  supportable.  Further, 
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if  such  a  requirement  were^ promulgated  in  occupationat  testing,  U  ^"1^  «sume 
4tie -e"sten«-of-a-def  inU-fve^is^ef-miftM^ 


Such  definitive  lists  do  not  currently  exist  and  their  absence  would,  we 
believe,  lead  to  pressures  at  the  federal  level  to  mandate  what  such  a  list 
WHild  include;       in  effect,  a  federal  specification  of  miniwun  job  entry 
skills^;   This^Au^d  clearly  be  a  violation  of  both  institutional  and  state 
prero9ativeS' and  should  be  avoided. 

11   Sec  8.   The  effective  date  of  an  act  such  as  this  should  be  no 
earlier  than't^J^TTTionths  after  enactment  to  P^J^ide  adequate  time  (i)  for  the 
promulgation  of  the  final  regulations  and  (b)  subsequent  alteration  of  test 
materials  in  order  to  comply  with  the  law. 

-In  swim^ry,  we  feel  ertactmcnt  of  HR  1312  would  result  in  a  myriad  of 
foreseen  and  unforeseen. consequences  and  would  present  dilemmas  of  enforcement 
«nd  compliance. 

HR  1662  (Weiss  Bill) 

There  follows  some  comments  on  specific  provisions  of  the  "ucation 
Testing  Act  of  1981  (HR  1662)  introdu<Sd  on  February  4,  1981  by  Representative 
Meiss  and  others: 


I.  Sec.  3  (a)M  calls  for  j)roviding  th.fiJLfisi-SUbiecUw4t^ 
^j^UMonrtetweerr^mtrs^of^^  "Success"  in  a  career  J^yj"*!.^*^* 
realization  that  the  presentation  of  corre  at  ons  to   «  ,  ^ 


realization  mat  ine  present-irion  or  uunc.-u.u..^  r;;;*^--; 
to  communicate  information  that  the  test  subject  can  understand,  the  Committee 
should  note  that  meaningful  correlations  between  test  scores  '"^^ /J|[«r  ^""ess 
are  almost  never  available  due  to  the  difficulty  of  defining  what  is  meant  by 
"career  success".   This  provision,  if  implemented  ^^r  occupational  test^^ 
would  mandate  determining  "success"  in  a  career  for  which  admittance  is  sought. 
Uouid  this  require  that  each  profession  or  occupation  be^tested  or  reviewed  over 
the  years  throughout  the  career  span  in  some  measurable  form  so  a  correlation 
would  be  generated  between  that  score  |pd  an  individual's  test  "ore?  Thi^ 
provision  is  unclear  and  unehforceable^fn  the  present  context  of  occupational 
admissions  testing. 

2.  Sec.  3  (a)(4)(B)  requires  the  comparison  of  test  "ores  by  income 
group.   Information  necessary  for  this  analysis  if  not  routinelv  avai  able  would 
fequire  much  more  paper  work,  would  potentially  be  l'^*^*^  as  an  nvasio^^^^ 
privacy,  and^would  probably  generate  more  misunderstandings  about  the  tests. 

3  Sec  3  (a)(4)(C)  requires  the  expression  as  a  percentage  of  the 
improvement 'in  test  scbres  as  a  result  of  a  test  preparation  course  The 
information  to  form  such  a  statistic  is  not  .likely^to  be  available  to  the  test 
producer  sufficient  for  any  meaningful  interpretation  to  be^made  and  would 
depeliral^ost  entirely  on  the  contSnt  of  a  specific  test  preparation  course  when 
compared  to  a  specific  teSt. 

4  Sec.  a  (a)(9)  refers  to  "handicapped  test  subjects",  a  term  which 
is  not  defined.  The^Co^ittee  will  .recall  the  diffjcuUies  that  en^ed  b« 

of  the  lack  of  a  e^ear  definition  of  "handicapped"  in  Sec.  504  of  the  Vocational 
Sehabil nation  Ac^of  1973  (PL  93-122).   That  43,word  section  eventually 
resulted  in  some  26  pages  of  regulations. 


 5  Sec  4  (a)Tryr0Tnw"rcan  see  no  reason  why  any  propr it?Mr7  testing 

company  shoild  bi  obiigited  to  reveal  to  Us  cfPetitors.  the  terms  of  c^ 
with  its  customers.    This  is  an  invasion  of  privacy  and  Pj?^^ 
company  complying  with  this  provision  at  a  distinct  competitive  d  sadvanU^^ 
This  provision  is  not  in  the  New  York  State  statute  or  in  any  of  ^he  testing 
bills  proposed  tn  the  states,  and  does  not  belong   "/J^  J'  J^^ 

provision  is  also  violative  of  the  spirit,  if  not  the  letter  of  the  Privacy  Act 
of  1974  (PL  93-579). 

6.  Sec.  5  presents  particular  problems  for  projprietary  test 


ERIC 


*  909 


905 


publishers.    These  Jtests,  wh«n  used  for  admittance  into  an  occupation,  are 

frequently  administergd  by  it^dividual  companies  to  detgrmine  elioibilitv  for  

emplo>rocnt  by  the  company  itself.    They  are  administered  frequently,.,usual1y 
many  times  during  a, year,  and  usually  to  a  group  of  no  more  than  several  dozen 
applicants.   As  a  matter  of  fact,  these  tests  are  quite  often  sold  in  quantities 
that  rarely  exceed  1,500  co^^ies  to  an  individual  purchaser  for  use  over  a  period  ^ 
of  time. 

We  see  two  problems,  if  disclosure  of  test  questions  and  answers  are 
mandated  in  the  occupational  testing  area.   First,  the  security  of  the  test,  for 
the  purchasing  company's  purposes,  would  be  breached.    It  would  be  unfeasible 
and  uneco/tofflical      and,  considering  the  quantities,  a  great  bother  to  the 
customers      to  substitute  a  new  test  to  be  given  within  a  month  or  so  and  to 
repeat  that  procedure  again  and  again  throughout  the  year.    Beyond  financial  and 
administrative  considerations,  it  is  also  highly  probable  that  no  such 
replacement  tests  would  be  available  because  the  cost  of  test  development  and 


data  gathering  to  support  reliability  and  validity  would  increase  to  the  point 
where,  it  would  not  be  financially  viable  to  continue  the  publication  of 
occupational  admission  te^ts.   Secondly,  the  tests  in  question  are  copyrighted 
1662,.  if  applied  to  occupational  entry  test?ng,.wo\ild  force  the  test—  — 
publisher  to,  in  effect, -give  away  his  copyrighted  material  substantially  befor 
the  expiration  of  its  useful  life.   The  entire,  issue  of  test  copyright  should  Jjfe, 
thoroughly  explored  by  the  Committee.  / 

We  Strongly  joppose  any  applications  of  Section  5  to  proprietary  \ 
occupational  entry  tests.  \^ 

7.  Sec.  5  (b)  is  a  mischievous  provision.    It  has  been  iterated  time 
and  again  at  the  hearings  that  HR  166^  contains  an  exemption  for  small  tests. 
However,  Section  5  (b)  only  exempts  small  tests  from  the  provisions  of  Section  5 
alone,  not  fran  the  other  provisions  of  the  bill.    In  addition,  an  exemption  for 
5,000  nationally,  as  is  pointed  out  elsewhere  In  this  testimony,  is  the  same  as 
the  exemption  given  for  one  state  alone.  New  Yorkv  Any. rational -exemption 
should, be  applied  to  the  entire  bill  and  should  be  a  national-level,  not  a 
state-leve),  figure. 

8.  Sec.  7  (2).  wfth  respect  to  paragraph  (A),  (B),  (C)  and  (0),  this, 
information  is  not  available  to  proprietary  testing  agencies.  It  should  also  be 
noted  that  these  mandatory  provisions  are  not  in  the  New  York  State  law. 

9.  Sec.  7  (2)(F)  would  oblige  testing  agencies  to  reveal  their  revenue 
from  each  testing  prograrr.    This  is  proprietary  information  which  would  only 
serve  the  purpose  of  informing  competitive  companies  and  would  place  the 
reporting  company  at  a  competitive  disadvantage.    This  provision  is  violative  of 
the  spirit,  if  not  the  letter,  of  the  Privacy  Act  of  1974  (PL  93-579).  Also, 
this  provision  is  not  in  the  New  York  statute  of  in  any  of  the  bills  proposed  in 
the  states  and  does  not  belong  in  any  Federal  law. 

10.  Sec.  7  (2)(G)  al$o  mandates  the  release  of  proprietary  information 
which  would  only  be  to  the  advantage  of  the  competitors  of  the  company  providing 
it  and  which  would  place  it  at  a  competitive  disadvatage.  Jhis  provision  is  not 
in  the  New  York  statute  or  in  any  of  the  bills  introduced' «h  the  states  and  also 
does  not  belong  in  any  Federal  law. 

11.  Sec.  8  (a)  is  inconsistent  with  Sectibn  431  of  the  General 

enactjuept  of  legislation,  the  CpmRtissioner  of  Education  must  submit  to  Congress 
a  sch'edule  shoeing  when  it  is  planned  to  promulgate  final  regulations.   These  . 
final  regulations  must  be  issued  within  180, days  after  the  submission  of  the 
schedule.    It  should  be  noted  that  the  Office  of  Education  has  difficulty 
complying  with  this  provision, 

12.  If  HR  1662  is  enacted,  the  effective  date  should  be  no  earlier 
than  twelve  months  after  enactment  to  provide  for  promulgation  of  the  final 
regulations  and  subsequent  alteration  of  test  materials  to  comply  with  the  law. 
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SiVwe  HR  1662  contains  «aJor  provisions  which  ire  not  in  the  New  York statute, 
it  canoot  bt  ar9u«d  that  as-a-rtsulVo^-cwipVy^ft^ith  the  Mew  York  Uw  ttstlm 
•Oencies  will  have  no  need  for  additional  time  to  prepare  for  compliance  with  « 
Federal  statute. 

In  addition,  we  should  like  to  append  to  our  testifiqny  *  brief  study 
•the  Heiss  Bill  and  the  New  York  State  Law"?  which  outlines  some  principal 
differences  between  the  Weiss>bm  and  the  New  York  law  after  which  it  Is 
ostensibly  patterned. 


Publishers  of  standardized  tests  develop  scales  and  norms  for  their 
tests.   These  result  from  the  national  standardizations  tf^at  publishers  conduct. 
In  contrast,  derivative  nbnus  are  norms  for  a  locally-constructed  test  that  has, 
been  equated  In  some  way  to  the  publisher's  test  so  that  the  publisher's  scales 
aiwJ. norms  can  be  used  for  the  locally-constructed  test. 

Because  of  the  close  relationship  of  this  issue  with  some  of  the 
discussions  at  these  hearings,  we  should  like  to  include^as  part  of  our 
testimony  the  brief  AAP  "Statement  of  Position  on  Derivative  Norc.s".  (Attachment 


There  are  those  who  would  wish  to  abolish  all  standardized  testing. 
National  Education  Association  Resolution  77-67  states:   "The  National  Education 
Association  strongly  encourages  the  elimination  of  group  standardized 
Intelligence,  aptitude,  and  achievement  tests."  On  the  other  side  of  the  coin, 
we  are  reminded  that  Irwin  Polishook,  Vice  President  of  the  American  Federation 
of  Teachers,  asserted  that  Vfhile  testing^has  some  flaws,  abolishing  standasiized 
testing  would  be  "an  emotional  and  damaging  strategy"  that  would  "deprive  us  of 
a  valuable  education  tool,  to  which  there  Is  no  alteniative ."  That  is  sound 


Position  on  Derivative  Norms 


Conclusion 


advice. 
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m.  wEiss-BiiL  Awu  m  Htw  mi  state  lavt 


According  to  Rep.  ^iss,  his  bm,  the  Education*!  Testing  Act'of  1981,  is 
Modeled  after  the  1979  New  York  State  statute.   In  this  co^nnection,  the  following  is 
worthy  opfott: 

1.  Pwiile  the  New  York  statute  has  been  amended  twice  since  its  enactment  to 
conform^ith  the  experience  gained  in  aAninistering  it,  the  Weiss  bill  has  remained 
unchanged  since  it  was  first  introduced  in  July  of  1979. 

(a)  As  originally^enacted,  the  New  York  law  had  eight  sections.   Five  Of 
these  eight  sections  have  been  amended.   These  sections  comprise  the  substance  of  the 
law  and  deal  with  definitions,  background  reports  and  statistical  data,  disclosure 

of' test  contents,  notice,  and  disclosure  of  test  scores.  The  three  unamended  sections 
each  consist  of  a  single  two-line  sentence  and  are  concerned  with  regulations, 
violations  and  severability^ 

(b)  Two  new  sections  were  added  to  the  New^York  law  by  amendments,  providing 
for  (i)  special  adnini strati ons  of  tests  for  religious  observers,  and  (ii)  creation 

of.  a  six-person  advisory  coimittee. 

2.  The)re  are  some  major  differences  between  the  Weiss  bill  and  the  New  York 
statute  wherein  the  Weiss  bill  goes  beyond  the  New  York  law  in  its  application 
and  severity,  as  follows: 

(a)  Sec.  3  (a)(3)  of  the  Weiss.bill  calls  for  the  test  agency  to  provide 
the  correlation  "between  test  scores  and  success  in  the  career  for  which  admission  is 
sought".   There  is  no  similar  provision  in  the  New  York  law*. 

(b)  Sec.  3  (a)(4)(B)  of  the  Weiss  bill  calls  for  the  test  agency  .to  compare 
scores  by  income  groups.   No  similar  Iprovision  is  in  the  Hew  York  law*.  ^ 

Sec.  3  (a)(4)(C)  of  the  Weiss  bill  requires  the  test  agency  to  reporf 
."the-extent  tp  which  test  preparation  courses  improve  test  subjects'  scores  on  average,  . 
expressed  as  k  percentage".  'Ho  similar 'provision  is  in  the  New  York  law*. 

(d)  Sec.  4  (a)(l)(8)  of  the  Weiss  bill  requires  test  agencies  to  reveal 
proprietary  information,  in  this  case  contacts  with  other  test  agencies.   No  similar 
provision  1$  in  the  New  York  law*.. 

(e)  Sec.  5  (b)  of  the  Weiss  bill  exempts  tests  administered  to  less  than 
5,000  person  in  a  test  year.   The  New  York  statute  is  much  more  coroplex.   Very  simply 
stated,. tests  adninistered  to  less  than  5,000  persons  must  only  be  disclosed  every 

.three  years.    The  Wetss  exemption  applies  to^Sec,  5  only, 

(f)  'Sec.  7  of  the  Wei^s  bill  requires  the  submission  of  proprietary 
information  including  the  revenues  and  expenses  of  the  test  agency  for  each  covered 
test  program.   No  similar  provision  is  in  the  New  York  statute.  . 

(g)  Sec,  8  (b)  of  the  Weiss  bill  provides-for  a  civil  penalty  of  not  to 
exceed  $2,000  of  each  violation.   This  is  four  times  the  $500  penalty  provided  by 
Me  New  York  law. 


*  «  No  similar  provision  in  the  California  statute. 


908 


STATEMENT  OF  POSITION  ON  DERIVATIVE  NORMS 

This  statement  has  been  prepared  by  the  rocrobers  of 
the  Test  Connnlttee  of  the  School  Division  of  the  Association 
of  American  Publishers  (V^),*  which  includes  most  of  the 
.     major  publishers  of  nationally-normed  test  instruments. 

.    .  •         _ .       _ .  _  ^ 
The  Test  committee  of  the  School-DtYision  of  the 

Association  of  American  Publishers  believes  it  is  important 

to  explain  some  of  the  -legal  and  psychometric  concerns  arising 

from  the  preparation  and  use  by  others  of  norms  derived  from 

copyrighted  nationally  standardized  tests. 

Background  of  Standardized  Testing 

It  is  well  known  that  the  development  and  publication 
of  a  standardized  test  is  both  complex  and  expensive. 
Sophisticated  psychometric  skills  are  required  to  prepare 
an 'instrument  whose  components  are  so  interdependent:  item 
content,  response  devices,  technical  analysis  and  norming. 

The  integrity,  accuracy^  and  usefulness  of  a  standardized 
test  depend  upon  the  quality  of  expertise  used  in  its  cons-  • 
truction  and  the  interrelationship. of  its  parts.  Functionally, 
no  aspect  of  the  test  can  be  viewed  separately  from  the  entirety 
of  its  use.    A  test's  norms  are  as  integral  to  the  testing 
instrument  as  are  its  test  item  /.    The  ^information  which 
norms  convey  is  only  valid  to  the  degree  that  the  test  itself 
is  valid  .and  has  been  administered  under    proper  control. 

*The  Association  of  American  Publishers,  Iric.  is  the  major 
national  association  of  publishers  of  ^fneral  books,  text- 
--b<>ok»-^-Uducationai-materials^nJ:heJjo^^^^  


o  913. 
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Standardiza^tion  is  achieved  by  admintst^ring  a  ff<»ir>f:ain  sgfe 


oif  test  instruments  under  carefully  prescribed  and  controlled 
conditions;  it  is  not  a  '*by-product"  of  testing  but  at  once 
Its  means  and  its  end. 

Standardization  for  major  achievement  and  aptitude 
\ tests  is  a  huge  undertaking,  requiring  extensive  research, 
Retailed  documentation^  and  the  cooperation  of  large  numbers 
of  students,  teachers,  and  administrators.    Two  important 
functions  of  a  standardization  program  are  to  yield  a  s^t 
of  norms  based  on  the  performance  of  a^  sample  of  school 
population  and  to  yield  sufficient  information  to  Judge  the 
^dequac;^  of  the  selected  sample.    It  is  not  unusual  fop 
hubnjdreds  of  "thousands  of  children  to  be  tested  in  order  to 
obtain  the  samples  needed  for  the  norming  process.  The 
publisher's    investment  'in  a  standardization  for  a  major 
tesl  isA,  very  large  part  of  the  total  cost  of  developing 


the  I  test,  t{ie  answer  instrtiments  and  accompanying  technical 
dati.  \ 
psychometric  Concerns 


j  RecentW  there  has  been  a  trend  toward  equating 

tests  developed  at^s^e  local  or  state  level  to  nationally 
nomed  tests.  From  al\  psychometric  standpoint,  publishers 
have  several  concerns. \ 

)  When  a  publish^  prepares  norms  for  ±t^  own  tests, 

^    ^  i\  : 

it  represents  that  a  studfert^'s  standing  is  based  on  a  large 
representative  sampling  of  results;  the  publisher  of  derivative 

\  . 
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norns  represents  thet  A  student  obtaining  a  given  raw  score 


on  a  local  test  would  have  achieved  a  certain  national,  norm 

standing  if  that  local  >test  had  bejin  nopmed  nationally > 

The  use  of  derived  norms  with  local  tests  also  implies  that 

tho  local  test  is  the  psychometrt^;?.^lvalent  of  the  standardized 

test,  i,,e»,  in  overall  quality  of  content  and  design  and 

In  coverage  of  specific  skill  areas  and  levels. 

In  fact,  to  properly  equate  one  test  to  another,  . 
the  two  tests  must  match  each  other  in  both  content^ and  levels 
of  difficulty  of  test  item  sequence* '  Furthermore,  both*tests 
Kust  have  a  sufficient  and.  comparable  spread  of  ability  over 
the  entire  range  being  tested  to  ensure  valid  results. 

We  do  not  ;lebate  the  quality  or  usefulnej^s  of  local 
tests.    We  do  beiieve  sufficient  evidence  exists  to  justify 
our  view  that  any  assumptions  or  representations  that  a  local 
test  using  derivative  norms  is  the  equivalent  of  the  national ly- 
normed  and  copyrighted  test  to  wfircft  it  was  equated  are  unfair 
to  students,  the  educational  community,  ahd-finall^,  to  test 
publishers. 


■ 


The  harrt  to  students  when  derivative  norms  or 

itTt 


invalid  is  obvious.      i^ducational  decisions  about  ktudents 
may  be  made  on  the  , basis  of  fallacious  information.^  Similarly! 
€he  reputation  of  the  test  publisher '^.national  nor^s,  and 
o^  necessity  its  testing  instruments,  can  be  comprbmised 
by  the  use  of  invalid  derivative  norms.  Therefore, 
we  believe  publishers  have  both  a  vested  and_^  / 
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proper  imtcrest  in  assuring  that  locally  or  state-developed 
tests  meet  established  research  design  standards  before 
their  norms  are  used  for  equating  purposes.         .  . 

Legality     «  *  .  '  "  . 

— -  ' 

Converting  local  t^st  scores^ to  the  national' 
normative  data  ovmed  by  the  standardized  test  publisheV.  is 
not  undesirable  but  the.  local  or  state  test  developer  should 
remember  the  normative  data  are  not  in  the  public  domain. 
Tl>ey  are  thp  property  of  its  publisher  and  the  norms  them- 
selves are  copyrightable  under  copyright  law.    Local  test 
programs  should  hot  misappropriate  !the  publisher's  substantial 
Investment  of  time,  money,  and  expertise  expended,  in  the 
standard!  zatjlon^-process , 

The  unlicensed  copying  of  national  testing  norms 
developed  by  individual  publishers  is  a  violation  of  copyright 
law.    Unlawful  copying  can  occur  v^enever  the  data  are  copied 
without  the  publisher's  permission,  for  the  purpose  of 
creating  a  derivative  norm,  whecher  the  copying  Is  done  by 
hand,  by    photocopying    or  by  some  other  niethpd.    Also,  under 
the  copyright  law,  inputting  normative  data  into  a  computer 
entiils  copying  and  therefore  violates  the  publisher's  copy- 
right unless  explicit  permission  has  b^^ert  obtained. 

Still  another  kind  of  copyright  infringement  occurs 
when  a  copyrighted  work  is  revised  or  recast  without  the 
publisher's  permission  so  that  a  ''derivative"  work  is  created. 
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i         .         '  . 

Therefore,  i^-preparation  of      local  test  involv^es  the 
unlicensed  use  of  a  publisher's  national  norms,       err  ate 
derivative  norms,  then  an  unlawful  '^derivative  work'*  results.* 
Court  decisions  protect  the  rights  of  pubVishsrs 


in  test' materials.    For  instance,  a  test  publisher •  s^opyright 
•irt  its  answer  media  was  upheld  in  the  case  of  Harcourt  Brace 
6  World  v;  Graphic  Controls  Corp.,  329  F;.Supp.  517  (S.^.^N.Y. 
1971).    The  publication^ of  solutions  to  test  questions  Was 
held  to  be  an  infringement  of  the  publisher's  copyright  in 
the-  questions  in  Addison-W^sley  Publisninq  Co.  v.  Brown, 
223  F.  Supp.  ^19  (E.D.N.Y.  1963*),,  as  the  court -concluded 
'ihat  the  product  of  t^e  publisher/ s  "original  and  |seful 
effort"  had  been  unfairly  used  by  the  defendants-. 


•>Derxv'atlve  Works:    Under  §101  of  the  Cofi/right  A^*-  of  1976, 
the  copyright  proprietor  has  cer^iain  exclusive  rfights  to 
dts^  intellectual  property,  including  the  right  t!o  prepare 
derivative  works:  *     '  , 

A  "derivative  work',*  is  a  work  based  upon  one  or  rrorc 
preexisting  works »  such  as  a  translation,  musical  arrange 
ment,  dramatization,  fictionalization.  motion  picture 
version,  sound  recordino,  art  reprofl-  tion.  abridgment, 
condensation,  or  any  other  form  In  v^^.^rch  a  work  may 
b«  recast!  transformed,  or  adapted.    A  work  consisting 
of  editorial  revisidns.  annotations,  elaborations,  or 
other  modifications  which,  as  a  whole  represent  an 
original /work  of  authorship,  is  a  ^'derivative  work. 


/  ^ 
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Just  as  the  more  tests  differ,  the  less  reliable 
is  the  use  of  derived  norms  i  the  mo^re  similar  a  local  test 
-  is  to  a  standardized^  test,  the  greater  is  the  likelihood 
of  copyright  inf rlngement.  of  the  test  itself.    Verbatim  copying 
is« not  necessary  for  infringement  of  copyright  of  a  t»^t. 
Addison~Weslcy  Publishing  Co.  v,  Wown»  supVa . 

•     As  a  legal  matter,  the  linkage  of  the  name  and 
reputation  of'  the  national  test  to  tests  of  others  raises 
serious  questions  .of  trademark  infringement  and  unfair 
competition  ^Under  Section  43  of  the  Lanham  Act^^See,  e.g. , 
Coca-Cola  Co.  v.  Gemini  Rising.  Inc,  346  F.Supp.  1183 

L  ^  '      *  '  ' 

(E.D.M.Y.  19)72);  Dallas  Cowboys  Cheerleaders.  Inc.  v.  Pussycat 

I    ^  •  \  . 

Cinema,  Ltd.i,  457  F.Supp. t  366  (S.D.N.Y.),  aff 'd,  .604  F.2<1 

;  !>.     *    .  \ 
200  (2nd  Cir.  1979).  \ 

In  summary,^ we  consider  that  local  ahd  state  test 

developers  have  a  professional  and  legal  responsibility  to 

publishers*  tests  and  related  normative  data.  Arrangements 

for  proper  legal  ind  psychometric  safeguards  for  both  ^developers 

and  publishers  exists  ir.  the  form  of  licensing  arrangements 

to  ensure  proper  use  ai^d  application  of  publishers'  norms. 

Further  information  may  be  obtained  by  writing  to  the 

^Association  of  American  Publishers  at  J3ne  Park  Avenue,  New 

York,  NY  10016,  or  t.he  individual  test  publisher. 


\ 
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Prbparkb  Statimknt  or  Timothy  J.  Muris,  Director,  Bureau  of  Consumer 
Protection,  Federal  Trade  Commission 

(The  views  expressed  are  those  of  a  member  of  the  staff  of  the  Federal  Trade  Com- 
miation.  and  do  not-necessarily  represent  the  views  of  the  Commission  or  of  any  in- 
dividual Commissioner.)  .       .         .  ,      ,        ,  '  j  »   n,o 

Mr.  Chairman  and  Members  of  the  Subcommittees:  I  am^pleased  to  provide  the 
views  of  the  Federal  Trade  Commission  staff  regarding  the  possible  ^nefito  of 
Sing  for  standarfized  admission  tests.  My  remarks  represent  the  v.eWs  of  the 
•UfT  of  the  Bureau  ofiConsumer  Protection,  and  do  not-necessarily  represent  those 
of  the  Commission  or  of  any  individual  Commissioner.  ,^ 

Bemuse  I  aMumed  my  duties  as  Director  &f  the  Bureau  oT Consumer  Protection 
on  October  5,  1981,  my  involvement  with  theissuM  before 'you  began  only  recentlv. 
T^ecCm-iSion's  staff,  however,  hasbeen  interested 

inif  for  standardized  admission  tests.for  some  time.  In  particular;  our  Boston  Region- 
al Office  recently  concluded  an  investigation  that  focused/ primarily  on  roaching  for 
the  Scholastic  Aptitude  Test  ("SAT').  As  you  know,  that^tes  is  used  to  evaluate  ap- 
plicants for  admission  to  hundreds  of  colleges  and  universities  across  thf  country 
each  year.  The  staff  initiated  its  invesUgation.  to  determine  whether  cpmmem^ 
coaching  schools  Were  making  deceptive  or  unfair  claims  regarding  the  effectiveness 
of  their  test  preparation -courses.  For  example,  some  coaching  schools  claimed  an 
'  ability  to  raise,  students'  scores  on  the  SAT  by  as  m  as  100  points.  At  the  Mme 
time/however,  the  Educational  Testing  Service  ("ET^^'),  which  Prepares  the  SAT, 
maintained  that  coaching  would  do  little  to  improve  a  students  test  performance^ 
To  help  determine  the  accuracy  of  these  conflicting  ilaims,  the  Commission  s  staff 
undertook  a  statistical  evaluation  of  the  effectivenMS  of  two  coaching  schools  that 
offered  programs  for  the  SAT.  This  research  indicatfl  that  coaching  at  one  of  the 
two  schools  raised  the  SAT  scores  of  its  students  by  an  average  oi  apprmteb^ 
twenty-five  points  each  on  the  mathematical  and  vferbal  sections  of  the  test.  This 
finding,  led  the  staff  of  theJBoetoa  Regional  Office  to  review  other  research  on  the 
qu«ition  or  coaching  for  the  SAT.  The  staff  found  t^at  arrowing  number  of  studies 
Save  shown  that  stSdents  can  significantly  improv^' their  SAT  scores  through  coach- 

\IjnTSht  of  this  evidencs,  the  staff  reviewed  th^  descriptive  materials  about  the 
SATnhat  Irs,  the  testmaker.  and  College  Board  the  sponsor  of  the  test,  provided 
to  studentTaTld-^JiieatorSr-AltKough  the  Rarsh  criticisms  of  coaching  levi^  in  mate- 
rials distributed  in  the  late  sixties  had  been  modified  in  recent  yeara,  the  staff  found 
that  even  the  later  materials  did  not  appear  to  recognize  the  possibility  of  meaning- 
ful  score  gains  through  coachine  At  the  directio;i  of  the  CommissiQ-n  these  concerns 
wbre  rai^d  with  and  College  Board.  College  Board  responded  by  submitting 
1980-81  descriptive  materials  that  included  d  new  message  to  students,  providing  a 
^ore  comprehensive  explanation  of  the  possible  benefits  of  different  forms  of  coach- 

'"a  more  detailed  discussion  of  the  research  reviewed  by  the  staff,  and  of  the  need 
for  improved  disclusures  to  students  and  educators  concerning  the  benefits  of  coach- 
ng,  is  contained  in  the  Steff  Report  entitled  "Coaching  for  Standarized  Admission 
TMt "  A  copy  of  that  Report  is  a^nded  to  this  statement.  As  the  Report  notes,  the 
emphases  that  colleges  and  unive'i^ties  place  on  SAT  scores  lends  great  significance 
tb  disclosure  of  information  regarding  the  benefits  of  coaching  for  standardi^d 
tests.  Students  cannot  make  informed  choices  regarding  special  preparation  unless 
they  know,  that  such  preparation'  c^n  affect  their  scores  materially  Si^miLyly.if 
hieh  schoo  8,  colleges,  and  universities  do  not  know  of  the  benefits  of  coaching,  they 
may  place  Undue  emphasis  on  sten&ardized  admission  tests  and  may  err  advising 
students  to\forego  s^jial  preparation  for  [the  admission  test.  In  addition,  both  stu- 
dent^ and  IducltorTc^ulf  benefit  from  /information  about  which  of  the  various 
forms  Of  coaching  are  most  effective  for  students.  j„  j:,^  „j„:. 

aS  the  foregoing  summary  indicates,  the  investigation  of  standardized  admis- 
siontsts  focused  on  assuring  that  organizations  involved  >"iHf^"d«/dized J^tir^ 
industry  disclose  to  students  and  edScat^rs  the  polentiaLbeWfits  of  coaching.  Of 
course,  the  conclusion  that  coaching  can  mateerially  affect  studente  scores  on 
standardized  tests  also  raise?  sigriificSnt  issues  of  educational  policy.  For  example, 
the  SUff  Report  notes  that  the  meanik  of  a  test/designed  to  measure  skills  devel- 
oped 0"er  a  Ufetime  of  learning  is  uncUr,  if  seores  can  be  meaningfully  improved 
iiVfew  weeks  or  months.  The  Report  ^  notes  that  although  coaching  can  materi- 
ally affect  scores,  it  may  not  be  equally  kVailable'to  all  students.  .  . 
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tht  Commiwion  referred  theie  educational  policy  iftuee  to  the^Depar'  nent  of  JSdu- 
catibn,  the  agency  with  special  expertise  in  this  field.  These  issues  also  merit  serious 
8tudy^b3rthe  Subcommittee  and  by  the  Ck)ngreBe.  c  . 

Thank  you.  •  ^ 


•    *.  ThlNational  PTA, 

'  \  Washington,  B.C.,  November  IS,  1981. 

Mr.  Buddy  Blakky,  v 
.  Subcommittee  on  Poettecondary  Education, 
Cannon^  Hout  Office  Building,  Ym$hing(pn,  D.C 

Dkae  Miu  Blakky:  I  have  encl^eed  five  copies  of  a  statement  that  the  National 
PTA  is  very  eager  to  submit  for  the  record  on  H.R.  1662,  ''The  Educational  Testing 
Act  of  1981."  Our  office  has  spoken  to  Mark  Pinaky,  of  Congressman  Weiss'  staff 
and  it  is  our  understanding  that  sending  you  this  letter  is  the  proper  procedure  for 
submitting  such  a  statement. 

If  there  \»  a  problem,  or  if  you  would  like  us  to  submit  more  copies  of  the  state- 
ment, please  no.tify  me., 
V     Thank  you  very  much  for  your  help. 
Sincerely, 

SUANNE  RUDLEY, 

'  Policy  Analyst, 
Office  of  Government  Relations. 

PxxPAREO  Statement  or  the  National  Congress  of  Parents  and  Teachers 

Mr,  Chairman  and  members  of  the  subcommittee,  we  wish  to  thank  you  for  the 
opportunity  to  submit  teatimony  on  H.R.  1662,  the  Educational  Testing  act  of  1981. 
The  National  Congreas  of  Parents  and  Teachers  (PTA),  an  organization  of  over  6 
million  members,  is  deeply  concerned  about  the  testing.issue. 

The  PTA  endorses  the  Educational  Testing  Act  as  an  important  step  in  providing 
students,  parents  and  educators  with  more  information  Mbout  standardized  tests. 
The  PTA's  support  for  this  legislation  is  not  to  be  construed  as  opposition  to  testing, 
but  rather,  viewed  as  a  concern  that  the  public  be  better  .informed  of  the  nature, 
purposes,  uses,  and  limitations  of  standardized  testing.  The  PTA  feels  that  the  pro- 
posed legislation  ensures  the  proper  use  of  tests  by  requiring  testmg  companies  to 
disclose  information  which  will  help  reduce  misunderstandings  and  avoid  misuse. 

We  would  like  to  comment  briefly  on  the  major  concerns  of  parents  and  teachers 
which  have  prompted  the  F^A  to  endorse  this  legislation: 

(1)  Accountability  in  the  testing  process 

From  early  childhood  through  entry  into  professional  schoob  or  jobs,  standardized 
tests  make  significant  judgments  about  our  children.  Yet  no  portion  of  the  public 
school  system  is  less  understood  than  the  fk^  about  standardized  tests,  their  assets 
\   and  the  t  limitations.  The  National  PTA  is  deeply  concerned  that  testing  programs 
\  are  be  ng  authorized  without  any  brpad'^public  discussion  of  the  issues.  As  parents 
\  and  teachers,  we  feel  it  is  important  to  achieve  a  greater  degree  of  accountability  in 
\  the  testing  process,  yet  such  a  review  of  pubhc  discussion  is  difficult  because  of  the 
\ security  that  surrounds  these  tests. 

\  Due  to  the  mask  of  "security,"  the  public  has  been  unable  to  dispassionately 
isvaluate  the  claims  of  test  makers.  Information  about  the  tests  and  the  testing  prec- 
ipe is  minimal  andgis  rarely  shared  "after  the  fact"  with  t^ose  most  intimately  con- 
cerned; students  and  their  famUies.  These  tests  serve  as  gatekeepers  to  the  future 
for  our  children  by  developing  patterns  of  expectation  by  teachers  and  school  sys- 
tems that  often  are  totally  unrelated  to  a  child's  true  capabilities.  Because  the 
•  po^er  to  test  is  the  power  to  influence  curriculuni,  there  is  a  tendency  to  reinforce 
curriculum  patterns  that  respond  only  to  the  ultimate  goal  of  ''looking  good"  on  the 
national  tests. 

Ah\evaluation  of  aiMSssment  Requires  a  great  deal  more  information  than  is  now 
available  to  parenU  and  students.  TKe  barrier,  of  "security"  now^keeps  us  at  arms 
length  from  the  process.  That  is  why  we  look  to  lemslatipn  like  H.R.  1662  as  a  way 
of  Dot  c^ly  accomplishing  specific  improvements,  but  as  a  method  of  providing  us 
with. more  information  about  the  testing  process  and  use  of  the  testing  results  which 
shape  children's  lives. 

ERIC     \  920. 
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(B)  The  Pufjxm  of  Uetting:  To  improve  children  *$  education 

For  years,  expert,  have  told  ui  that  there  are  flawf  iii  ^he  present  nom^refe^ 
enced  rtandiirdSedte.ting  proces.  and  that  we  inuit  uae  it  be<»usr  it  w  all  we 
have."  Aa  parents,  we  are  no  longer  convinced  of  that  arffumeni,  wid  insist  that 
standardized  tests  be  used  to  complement,  the  educational  process,  not  dictate  a 
child's  educational  future.  Testing  must  be  responsive  to  the  major  goal  of  •  Pubhc 
schwl  wstem-the  improvement  of  the  education  of  children.  We  are  happjr  to  note 
•  that  many  school  systems  are  moving  toward  testing  systems  more  in  keeping  with 
SSa  goak.  Children  are  being  tested  in  every  cl«sroom  hot  so  much  to  fompare , 
Sem  with  other  children  in  distant  school  systems,  but  to  determme  whether  they 
Sr^Teaming  in  accord  with  the  objectives  of  each  local  school  system,  and  to  deter- 
mine the  efTectivene«i  of  the  system  itselfin  implementing  these  goals. 

(S)  The  alternative  of  national  sampling 

Sampling  on  a  national  basis  may  be  all  that  is  necessaiy  t<>  P«;?;^ff_^^^»"3^ 
national  comparisons.  But  nationwide  tests  are  not  adequate  substitutes  for  careful 
kSl  ^mints,  since  the  approximatelv  16,000  local  school  distncte  produce  a  ya- 
ri^y  of  local  educational  objf^ivee,  and  aifferent  timetables  at  which  specific  skills 
are  emphasized.  Unless  we  are  planning  to  move  into  a  national  curriculum,  thwe 
differences  of  timing  and  emphasis  will  continue  to  exist  A  child  should  not  be  pe^ 
nalized  because  a  local  school  system  has  chosen  a  different  sequence  than  the  test 
maker.  Nor  should  these  important  determinations  pass  froip  the  hands  ot  local 
•chool  boards  who  are  accountable  to  their  communities  to  the  hands  of  test  produc- 
ers who  are  not  accountable  at  all.  * 
'     (4)  A  balance  between  teaching  and  testing  .         ^  .,. 

Is-more  time  being  used  in  a  classroom  for  "testing"  than  "teaching  As  pubhc 
achno]  students  return  to  classes  they  can  expect  to  take  more  tests  than  ever 
befon^,  which  leads  to  Questions  such  as:  (a)  Is  this  an  effective  use  of  the  P;.ofeMion. 
al  edul^tor's  time?  (b)  Is  this  the  most  productive  use  of  a  child's  limited  classroom 
time?  and,  (c)  Are  there  ways  we  could  get  the  answers  we  need  without  turther 
disrupting  the  already  fragmented  school  day? 
•(5)  Testing  on  what  has  been  taught 

The  PTA  advocates  that  children  be  tested  on  what  they  have  been  taught  We 
need  the  results  of  such  tests  to  know  whether  the  system  or  the  child  is  responsible 
when  learning  does  not  proceed  at  an  expected  rate  or  in  a  certain  pattern.  This  i^ 
essential  if  there  is  to  be  any  accountabflity  of  local  schools  and  if  toting  is  to^be 
used  as  a  developmental  tool  so  that  a  teacher  can  specifically  pinpoint  the  next 
appropriate  steps  for  each  youngster. 
(S)  Test  development 

(a)  Parents  and  teachers  are  concerned  about  who  participates  in  test  construction 
and  the  basis  on  which  these  people  are  chosen.  This  information  would  be  useful  in 
understanding  the  way  in  which  teists  are  constructed,         ,  ,  -  . ,  , 

(b)  It  is  critical  to  know  what  tests  purport  to  measure  so  that  judgments  are  con- 
fined  only  to  what  is  measured.  Testing  companies  repdrt  that  they  are  blamel^ 
for  the  misuses  of  test  results,  yet  there  are  often  conflicting  points  of  view  among 
j2h(!ol  s^t^SS  abSift  what  Uit  results  indicate  and  What  information  can  be 
cleaned  from  the  test  scores.  If  it  is  mandatory  for  test  mariufacturers  to  define  the 
Krt!!^  ofThe  te^^  and  teachers  will  be  better  able  to  restrict  the  use  of 
such  data  to  the  purposes  for  which  they  were  intended. 

(c)  There  is  an  information  void  on  how  standarized  tests  address  the  unique  test- 
ing  needs  of  handicapped  and  disadvantaged  youth. 

(7)  Test  usage  1  j  u  u 

(a)  We  desperately  need  information  on  how  tests  are  used^  when  and  by  whom. 
Discussion  is  necessary  to  determine  how  selective  we  hav^  been  in  accepting  a 
whole  range  of  testing  to  which  we  subject  children.^  i  m^Mure 

(b)  Multiple  choice  or  ^ihort  answer  types  of  questions  limit  the  ability  to  mew^^^^ 
a  full  range  of  skills.  For  example,  the  abihty  to  write  well,  to  organize  and  transfer 
thouffhU  to  paper,  requires  testinff  of  a  written  ••mple»  yet  for  many  years  we  have 
testeS  writing  skills  by  multiple  cLice  questions.  Why?  Because  it  is  ^^^^^J.^^^^^^- 
We  reduce  writing  to  the  rote  priciples  of  grammar  spelling  and  punctuat^^ 
then  wonder  why  children's  wr  ting  skills  have  deteriorated.  We  must  recognize 
that  mSs  of  testing  must.rely  on  criteria  other  than  ''what  the  computer  can 
efficiently  score." 
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(B)  The  raponMibility  amqciaUd  with  letting 
There  is  no  clear  indication  of  who  is  reeponsible  when  national  tests  backfire  or 
.  are  miaused.  At  present,  gome  problems  are  caught  by  random  spotting,  other  are 
suspected  and  only  verified  when  a  test  taker  has  been  able  to  review  the  disclosed 
test  questions.  Is  the  test  maker  responsible?  Is  the  school  responsible?  Or,  is  it  only 
the  student  user?  . 

^  Certainly,  tests  are  only  one  measure  of  a  person's  ability^  but  because  they  are  so 
broadljMised,  the  significant  questions  about  their  effect  and  reliability  must  be 
thorough  aired  and  other  potential  measurement  techniques  carefully  considered. 

As  parents  and  educators,  yte  support  the  principles  of  H.R  1662  as  a  means  for 
requiring  the  disclosure  of  information  which  will  address  the  eif^t  concert  just 
raised  and  we  feel  that  the  following  are  hallznarks,  of  .the  legislation:  ^ 

(a)  The  bill  provides  for  the  standard  error  of  measurement  to  be  shariea  not  only 
with  teachers,  but  with  test  takers  and^  their  parents.  Many  parentsjwill,-for  the 
first  time,  be  aware  of  the^broi^^  evident  iiT'Siese  scores,  even 
though  life  and  eareer^deosiohs  are  being  made  of  the  basis  of  a  few  points. 

(b)  The  legislation  includes  protections  to  the  right  of  privacy  j^family  and  test 
taken  in  ensuring  that  research  will  be  limited  to  data  which  ^aure  not  personally 
identifiable,  unless  approved  by  the  test  taker. 

(c)  The  bill  mandates  the  release  to  test  takers  of  their  actual  test  questions  and 
answers  within  a  reasonable  period  following  the  tests.  Also  important  is  a  proce- 
dure for  review  of  a  challenged  test  score  within  a  reasonable  time  frame.  We  are 
hopeful  that  the  section  which  will  require  a  description  of  special  services  to  ac- 
commodate handicapped  students  will  allow  schools  to  deal  more  eff(»ctively  with 
the  needs  of  such  students  for  differentiated  testing.  We  are  finding,  for  example, 

^  that  many  itudents  with  writing  difficulties  can  be  tested  appropriately  by  oral 
tests.  To  try  to  force  written  tests  on  such  youngsters  is  cruel  and  unproductive. 
In  closing,  we  would  like  to  emphasize  several  points: 

(1)  Charges  have  been  made  that  these  proposed  changes  will  dramatically  in- 
crease the  cost  of  testing  and  damage  test  makers'  ability  to  compile  ,  quality  test 
questions.  This  would  be  a  poor  excuse  for  maintaining  a  system  of  testing/  which  is 

^failing  under  serious  challenge.  Schools  and  families  now  spend  over  a  quarter  bil- 
lion dollars  a  year  on  testing,  and  the  appropriate  question  might  well  be  "are  we 
buying  instruments  that  tell  us  what  we  need  tQ  know?  We  cannot  evaluate  the 
changes  that  may  be  necessary  unless  we  can  review  what  the  true  costs  of  the  pres- 
ent system  coyer. 

(2)  Testing,  is  a  large  private  for-profit  industry  which  has  a  tremendous  impact  on 
a  public  phenomenon-^education.  The  public  has  a  right  to  scrutinize  this  industry 
and  to  hold  it  accountable. 

(3)  ,  Parents,  teachers,  and  students  should  be  able  to  review  tests  and  testing  ma- 
terials to  ensure  that  they  are  understandable,  lliis  is  particularly  important  for 
tests  like  the  SAT  and  the  accompanying  disclosure  form.  There  is  evidence  to  indi- 
cate that  the  present  method  for  requesting  a  copy  of  the  SAT  and  scored  answer 
sheet  is  confusing  students  and  is  causing  a  low  request  rate  for  this  information. 

(4)  There  should  be  further  study  as  to  the  effects  of  coaching  on  test  scores.  If 
coaching  has  a  significant  effect,  this  should  be  acknowledged,  and  those  who  use 
test  scores  as  an  important  indicator  of  ability  should  be  informed. 

(5)  The  National  PTA  does  not  seek  an  end  to  testing.  But  we  are  seriously  con- 
cerned that  the  present  degree  of  the  art  of  assessment  is  far  less  precise  than  we 
have  been  led  to  believe.  We  feel  the  questions  about  our  present  testing  methods 
will  not  be  put  to  rest  until  parents  and  teachers  are  able  to  make  decisions  based 
on  much  more  information  than  is  now  available,  to  us.  That  is  why  this  legislation 
is  so  important.  We  seek  the  information  that  will  give  all  of  us  tlependable  data  to 
help  determine  the  course  of  our  public  schools  and  the  appropriate  direction  for 
our  children.  The  National  PTA  stands  te^'ly  to  participate  in  any  reasonable  effort 
to  reach'that  goal. 


\ 

\ 
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fkAMMIM*  MW«tTV> 
tUMlMTAMV,  »fe««**A«y  AN* 
««<ATt«N«CMV<AT>ON 

iHTMAf*  vCSQWAtff 

COMMfXT(COr< 
_^*»«KW*  juiwoAirr*  


M  i;it 

M«vlc  0»rK€  Utnj^u 


Ulaj^tjlncton,         20515  ,  

.No\7ember  16,  1981 


>f«  »«/T«]  <;<«*««  aTMrt 
y«wi.rtM<«A.y*M«  i>4#i 

r««rOr«><(  ftyi^awa* 


Dr.  Samuel  Me;t<3ick  ^ 
Vice  President  and 

Distinguished  Hi;:;parch  Scientist 
Educational  Tosting  Service 
Princeton,  New  Jersey  08S41 

Dear  Dr.  Messick: 

Since  you  are  a  recognized,  export  in  the  area 
of  "coaching"  tor  standarized  teiits,  I  hnve  several 
questions  which  I  would  like  you  to  ao<lress  for  the 
hearing  recoxd  <>n  the  educational  TeiAing  Act  of  1981. 
i  would  appreciate  your  prompt  reply. 

U)     X--^  tno  Fix:  coaching  study  seriously 

iKwd  and,  if  so,  how.*    ir*  il  possible 
to  uso  the  V:^  firtdings  in  a  tochnicaily 
sound  way  to  isitimate  tlio  benefits  of 
^  coaching  and.  if  not,  why  not? 

(2)  Is  It  possible  to  estimate  tho  benefits  of 
coaching  for  the  SAT  from  other  coaching 
studies  and,  if  so,  what  are  the  likely 
score  improvements  attributable  ,to  coach- 

f  ing?  ,  . 

(3)  Since  SAT  score  improvements  associated 
with  coaching  seem  to  increase  as  student 
time  and  effort  devoted  to  coaching  in- 
crease, would  it  not  follow  that  students 
.ohould  be  coached  for  as  long  as  necessary 
to  attain  the  desired  score  level? 


(4)     If  coaching  can  improve  SAT  scores  over 

and  above  the  experiential  growth  that  may 
occur  anyv/ay  without  the  coaching  program, 
are  thertj,  not  important  issues  of  equity  in 
the  access  to  coaching  programs? 

Your  cooperation  is  appreciated. 

Sincerely  yours. 


William  F.  Goodling 
Member  of  Congress 
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EDUCATlONAt.  TESTING  SBRVICB  PRINCETON.  N.J.  08641 


.    S*mu»ilA^Hk  November  30,  19«1 

VKim$)Oe\t  KM  KtfCAJtOf 


Tt)e  Honorable  William      Goodllng  2 
Hcua*  of  Repreaentatlvea 
LoQi^rth  Rouse  Off Ice-Bulldlnjc. 
tjoom  17b 

Haahlnxton,  DC  20515 

Dear  Congreaanan  Good ling r  '  * 

In  Connection  vlth.the  hearings  on  the  Kducatlonal  Teatlng  Act  of  1981, 
X  appreciate  the  opportunity  to  anaver  for  the  record  the  four  questions 
addreaaad  to  ne  in  jrour  letter  of  November  16:  ~ 

(1)  '  la  the  FTC  coaching  study  aerlbusly  f laved  and.  If  so,  how? 
.  la  It  poaalble  to  use  the  FTC  findings  In  a  technically 
<aound  way to  eatlmate  the  benefits  of  coaching  and,  1^  not, 
why  not?^ 

The  FTC  coaching  study  Is  seriously  flawed  by  virtue  of  employing  a 
research  deaign  that  cannot  control  for  selection  bias  or  self-selection 
bias.    Selection  bias  refers  to  any  systematic  differences  between  the 
coached 'and  uncoached  students  selected  for  study  that  may  affect  SAT 
p«rformance  —  In^ addition  to  tfie  fact  that  one  group  was  coached  and  the 
other  was  not.    Tf  these  systaMitlc  group  differences  result  from  student 
choice  of  the  coaching  prof ram  rather  then  fron  experimenter  choice  of  the 
student,  Chey  are  called  se'XfH^elcctlon  Thus,  In  the  absence  of 

appropriate  controls,  certain  personal  factors  characteristic  of  students^ 
attending  a  particular  coaching  program,  such  as  their  motivation  or  career 
aspirations,  may  be  responsible,  aC  least  ,^.n  part,  for  subseauent  SAT 
performance  that  appears  to  be  the  result  of  the  coaching  experience. 

The  standard  prescription  for  avoiding  selection  biaa  is  an  experimental 
design  entailing  random  assignment  of  students  to  coaching  treatment  groups 
and  noncoachlng  control  groups,  for  only  with  random  assignment  can 
coaching  effects  be  presumed  to  be  'Independent  of  prior  status  on  any  of  a 
host  of  personal  or  background  characteristics.    The  FTC  coaching  study  did 
not  employ  random  assignment  but,  rather,  comoared  atudents  attending  two 
selected  coaching  schools  with  uncoached  students  (selected  from  College 
Board  test  files)  who  took  the  SAT  during  the  same  time  period  In  the  same 
geographical  area.    In  the  absence  of  randomimtlon,  tnere  Is  an  inevitable 
equivocality  In  the  Interpretatl^hvof  these  results  becauae  some  unmeasured 
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personal  ch«r«cteti«tlc«  might  h«ve  influenced  both  the  studentr*  dfirf*"*"^*  

to  participate  in  the  ^f^i;;hfnff  r^»f^i^^i»-^*^->**-tJip{  r  *llh«»qll»n^  <;at  p^rfnrtw'ng^, 
■wdiJi  wbulU  leiiil    to  inflate  the  coaching  program's  apparent  effectiveness. 

Vhen  demographic  and  perfonal  characteristics  of  the  coached  and  un- 
coached  groupi  in  the  FTC  study  were  contrasted,  it  was  found  that  the 
coached  group  vas  significantly  higher  than  the  uncoached  group  in  h^igh 
school  class  rank,  parental  incone,  most  recent  English  grades,  most  recent 
math  grade a,  and  number  of  yeara.of  math  taken.    In  addition,  the  coached 
group  included  significantly  more  nonpublic  school  students  than  the- 
uncoached  group.    Although  appropriate  statistical  adjuatments  were  made 
for  these  and  other  preexisting  group  differences  for  which  measures  were 
available >  there  isrho  way  to  take  Into  account  unmeasured  factors  also 
likely  to  differentiate  the  groups,  such  as  student  motivation  or  level  of 
parental  education.    In  the  absence  of  random  assignment  of  students  to  - 
coached  and  uncoached  groups  and  eapeciallv  in  view  of  the  large  and 
•xtenalve  differences  confounded  In  the  nonrandomized  groups  ultimately 
analyzed  In  the  FTC  study,  any  score  effects  derived  from  these  Jata  must 
be  interpreted  as-eombined  coachinR/self-selection  effects.    In  theabsence 
of  random .assignment,  thete  Is  no  technically  sound  way  to  disentangle  the 
effects  of  coaching  from  the  effects  of  self-selection  In  the  FfC  study, 
but  some  rough  estimates  of  the  likely  proportion  of  each  might  be  obtained 
by  contrasting  the  FTC  results  with  the  findings  of  all  otiier  SAT  coaching 
studies,  some  of  which  employed  random  assignment.    This  approach  Is 
discussed  Un  the  response  to  the  next  question. 

(2)    Is  ic  possible  to  estimate  the  benefits  of  coaching  for 
the  SAT  from  other  coaching  studies  and,  if  so,  what  are 
the  likely  score  improvements  attributable  to  coaching? 

The  FTC  CoscMng  study  is  not  unique  In  being  seriously  flawed  —  all  of 
the  av;»ilable  studies  of  coaching  for  the  SAT  are  flawed  In  one  way  or  another. 
Most  of  the  studies  were  subject  to  the  Influence  of  selection  bias  discussed 
in  KiiSponse  to  ^uestlop  (1),  which  severely  comp^roraises  Interpretations  as 
to  the  source  or  detpminants.  of  score  effects  —  in  particular  whether  they 
may  be  unequivocally  attributed  to  coaching  experiences  as  opposed  to  personal 
or  background  characteristics  of  the  (self-)  selected  students.    In  this 
regard,  some  of  the  studies  Involved  control  groups  pf  uncoached  students 
attending  different  Schools  from  those  of  the  coached  s!.udents  or  else  drawn 
from  ocher  extrinsic  sources  such  as  test-score  files,  thereby  confounding 
coaching  effects  with  differential  school  effects  and  numerous  self- 
selection  factors.  '  In  some  other  studies,  control  groups  of  uncoached  students 
were  specially  constituted  to  match  available  samples  of  commercially  coached 
students  on  a  number  of  variables,  but  this  still  allows  systematic  differences 
between  the  groups  on  unmatched  variables.    Another  defect  common  to  several 
studies  is  an  unfortunate  reliance  on  small  samples  of  coached  students,  which 
result*  in  imprecise  estimates  of  score  effects  and  a  reduced  likelihood  that 
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nr«l  effect*  will  be  detected  «■  itatlitlcally  «l|oilflc«nt.    Moreover,  ln»te«d 
,  of  u«lnR  «  regular  SAT  «diilnli.t ration,  ■one  atudlei  Invoked  unreellitlc 
•motivational  condltiona  by  adminiatcring  ■apecial  SAT  that  did  not  count-on 
tht  college  admiaaions  record,  lihich  very  likely  introduced  biaaes  in  the 
•atliiated.aliea  pf  acore  effecta.    Unfortunately,  the  three  a,tudiea  uaing 
random  atalgnment  alao  employed  special  SAT  adminiatratidna  irfiich,  precisely 
because  they  did  not  count,  were  probably  viewed  to  aone  degree >aa  practice 
taata,  thereby  eliciting  laaa  motivation  and  effort  than  would  a^  real  SAT 
adfldniatration,  especially  for  the  uncoached  control  ftudeota.    Finally,  and 
by  far  the  aoat  troubleaone  from  the  atandpoint  of  eatiwting  and  interpreting 
coaching  effecta,  ao«e  atudlea  utilized  no. control  groupa  at  all.  However, 
although  the  available  atudies  of  coaching  for  the  SAT  ara  methodologically 
flawed  In  one  way  or  another,  the  varloua  defecta  entail  sufficiently  divergent 
lflq>llcationr  that  any  regularities  or  lawful  consistencies  cutting  acroaa 
theae  atudiea  would  nonetheless  be  compelling. 

Indeed,  a  particularly  striking  regularity  was  obaerved  cutting  across  all 
of  these  studies  ^  naii^ly,  a  remarkably  high  rank-order  correlation, 
upwards  of  .7,  between  the  obtained. aize  of  score  effecta  aaaociated  with 
coaching  and  the  amount  of  student icortuct  time  involved  In  the  coaching 
program.    That  is,  the  greater  the  student  time  and  eCfort  devoted  to  coaching, 
the  larger  were  the  aaaociated  score  improvements  over  those  obtaitied  by 
uncoached  control  atudenta.    However,  thi?  relationship  was  distinctly  non- 
linear, indicating  marked  diminishing  returns  in  coaching  effects,  especially 
for  SAT-Verbal.    THarHs,  eachv additional  increaae  in  score  effects  associated 
with  coaching  appeared  to  require  geometrically  incfeaaing  amounts  of  student 
time  and  affort. 

*  By  fitting  mathematical  models  to  this  nonlinear  relationahip,  it  ia 
poaaible  to  eatimate  the  average  coaching  effecta  likely  to  be  aaaociated 
irlth  coaching  programa  of  different  durationa.    According  to  these  models, 
an  average  of  10  SAT  score  points  (on  a  score  scale  ranging  from  200  to  800 
points)  would  be  expected  to  be  associated  with  about  12  hours  of  Verbal 
(ioichiiig  or  about  8  hours  of  Math  coaching;  ati  average  of  20  score  points 
woOld  be  associated  with  about  57  houra  of  Verbal  coaching  or  about  19  houra 
of  Math  coaching;  an  average  of  30  ppints  with  about  260  houra  of  Verbal 
or  45  houra  of  Math  coaching;  and,  an  average  of .40  pointa  with  about  1185 
houra  of  Verbal  or  107  houra  of  Math  coaching.    Of  courae,  theae  figures  are 
not  resulta  of  any  actual  coaching  program  —  rather,  they  are  theoretical 
eatimatea  of  average  score  gaina  that  might  be  expected  consistent  with 
avaiUble  data.    Mevertheleaa,  theae  figurea  may  be  helpful  to  our  thinking 
about  aome  of  the  issues  aaaociated  with  coaching.    They  suggeat,  for  example, 
that  the  time  required  for  motivated  students  to  achieve  average  score 
increases  much  greater  than  20  to  30. pointa  over  the  experiential  growth 
they  vould  have  attained  without  any  coaching  rapidly  approachea  that  of  full- 
time  sphooling,  especially  for  Verbal. 
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(3)    Since  SAT  score  Inprovenents  M«ocUted  vlth  coaching  seen  to 
increase  as  student  tiae  and  effort  devoted  to  coaching 
increase »  would  it  not  follov  that  students  should  be  coached 
for  as  long  as  necessary  to  attain  the  desired,  score  level? 

As  discussed  In.  response  to  question  (2),  the  relation^ip-between  student 
tlAe  and  effort  devoted  to  coaching  and  the  associated  coaching  effects  is 
distinctly  nonlinear,  indicating  laarked  diminishing  returns  in  score  improve- 
ments attributable  to  coaching.    Although  in  principle  it  wight  be  possible 
under  these  circumstances  to  coach  students  for  as  long  as  necessary  to 
attain  the  desired  score  level,  in  practicie  the  time  required  would  become 
unrea^isti'cally  long*    According' to  the  raatheiaatical.nodels  *^lt  to  the  ^ 
available  SAT- coaching  data,  a  Verbal  coaching  program  260  hours  long  would 
be  associated  with  an  average  coaching  effect  of (30  SAT-V  score  points  over 
and  above  what  comparable  students  would  have  l^a^ned  during  the  sane  testing 
interval  without  coaching,  while  a  Verbal  pxOSram  1185  hours  long  would  be 
needed  tu  achieve  an  average  score  effect  of  ^0  SAT-V  points.  ,  Thus,' for 
motivated  students  to  attain- an  additional  30  tp  AO  SAT-V  sco^e  points  on 
the  average  through  coaching,  somewhere  between  a  third  of  a  school  year  to 
more  than  an  entire  school  year  would  need^to.  9e^devojteii„fullrLUme_3olely 
to  Verbal  coaching.    To  be  sure,  greater  score  \effects  are  observed  for 
SAT-Math,  but  107  hours  of  Math  coaching  would  ?>e  associated  with  AO  SAT-M 
points  and  254  hours  with  50  SATtK  points,  which  still  approach  a  full-time 
commitment  to  Math  coaching  for  about  a  third  of^  the  school  year.  Moreover, 
the  available  coaching  research  suggests  that  score  gains  much  greater  than 
about  10  or  20  points  depend  increasingly  on  geniiine  skill  development  as 
opposed  to  Improved  test  wlseness.    This  implies  that  the  verbal  and  quantita- 
clve  comprehension  and  reasoning  skills  measured  by  the  SAT  —  if  they  are  to 
be  systematically  developed  as  abilities  facilitatJlve  of  school  and  college 
performance  —  might  be  better  developed  not  by  special  coach InR^ programs 
over  the  short  run,  but  rather  over  the  long  run  by  regular  school  instruction 
that  integrates  the  development  of  thought  with  the  development  of  knowledge. 

(A)    If  coaching  can  Improve  SAT  scores  over  and  above  the  experiential 
growth  that  may  occur  anyway  without  the  coaching  program,  are 
there  not  important  issues  of  equity  in  X^^  access  to  coaching 
programs? 

If  coaching  were  to  substantially  increase  test  scopes  without  correspond- 
ingly improving  the  skills  and  abilities  measured  by  tlie  test,  there  would  be 
important  Implications  for  testing  practice.    Such  an  outcome  would  imoly 
that  the  test  or  the  testing  experience  entails  unintended  sources  of 
difficulty  that  can  be  at  least  partially  overcome  by  special  preparation  — 
anxiety  over  being  evaluated,  for  instance,  or  unfamiliarity  j^ith  item  formats 
or  test-taking  strategies.    This  s.uggeits  —  even  Chough  the  available  studies 
find  only  small  average  effects.  If  any,  associated  with  coaching  programs 
stressing  test  familiorization  and  practice  as  opposed  to  skill  development  — 
that  In  the  interest  of  equity  all  test  candidates  should  have  an  opportunity 
to  familiarize  themselves  with  appropriate  test  formats  and  to  practice 
recotnnended  test-taking  strategies.    Such  familiarization  might  be  accomplished, 


for  txaarlt,  through  th«  <llllR#nt  vui*  of  practice  t«iti  and  «dvl«ory  iiu|.t«ri«l« 
•lallar  to  Uiom  routiiMlr  dlstri6ut!td  br  th*  College  Board  for  the  SATr 
ls9iMs.of  e^lty  of  ccceat  to  such  teet-^leeneee. coaching  prograns  and 
wterlals  Imcom  la|>oreanC  to  tfie  eictent  that  atudent  differences  in  test- 
taking  akllla  yar  —-influence  teat  jscorea* 

On  the  other  hand,  if  score  lncr«s«a^, attributable  to  coaching  represwit 
coMtnaurate  laproveaents  in  the  ver|b«l  and  mathetiatical  abilities  neasured 
by  the  SAT,  thro  there  would  be  iapottant  implications  for  educational 
practica  and  social  policy, >  If  coaching  techniques  for  fostering  ability 
dvVclopMQt  could  be 'specified  that  vera  not  an  integral  part  of  the  regular 
school  experience,  then  the  issue  of  jequity  of  access  to  special  coaching 
progTM  arises^    It  is  unfortunate  .that  iMm  of  the  studies  of  coaching  that 
'  have  been  conducted  to  date  (including  the  FTC  study)  ve re  not  focussed 
carefully  enough  on  the.  content  of  coaching  programs,  and  hov  they  are  liVe 
and  unlike  ordinary  sctiool .Instruction,    The  SAT  ^Masures  the  current  level 
of  developed  scholastic  abilitiea  facilitative  of  academic  learning.  Whether 
this  currant  level  of  developed  abilities  derives  in  part  from  special 
.coaching  progress  pointed  toward  ii4>roved  test  performiance  or  from  regular 
~  educational  prograas  pointed  toward  improyed  school  performance,  or  from 
extensive  experiential  learning  in  nonschool  settings  —  that  is,  from 
coaching  or  instruction  or  experience  —  is  indistinf(uishable  to  the  SAT. 
Thua,  the  Issue  of  equity  of  access  to  coaching  programa  that  are  effective 
by  virtue  of  ability  divelopntent.  If  such  could  be  identified,  is  similar  to 
the  Issue  of  equity  of  access  to  effective  school  programs  or  effective  life 
experiences »  for  they  each  have  similar  consequences  for  test  scores*  Such 
ability-enhancing  coaching  programs  raise  important  equity  issues  of  educational 
access,  to  be  sure,  but  they  are  not  new  equity  issues  nor  are  they  unique  to 
coaching «    These  are  issues  that  many  educators  are  paying  close  attention  to. 

r^hopa  these  responses  are  helpfuX  to  your  deliberations,  and' I  greatly  ^ 

appraclate .the  oppc4;tunity  to  contribute  them*    For  the  record,  I  am  alsd   

auNilttlng  three  publications  in  which  these  issues  are  discussed  in  greater 
detail  in  the  context  of  available  scientific  evidence*    The  publications  are 
entitled;  '  (1)  The  Effectiveness  of  Coaching  for  the  SAT;  (2)  Time  and  Method 
in  Coaching  for  the  SAT;  ai^d,  (3)  Xssuee  of  Effectiveness  and  Equity  in  the 
Coaching  Controversy*    I  am  also  appending  a  brief  resume  of  my  credentials 
as  an  expert  in  the  field  of  educational  and  psychological  measurement. 

Again,  thank  you  for  thir  privilege  of  participating  in  the  hearing  process* 

Sincerely  .yours, 

^  Samuel  Messlck 

Vice  President  for  Research 
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Preface 


This  report  examines  evidence  and  arguments  about  the  effec- 
tiveness of  coaching  for  the  saV.  It  views  the  issue  as  being  much 
morc'compiicated  than  the  simplistic  question  of  whether  coach- 
ing works  or  not.  Coaching  in  and  of  itself  is  not  autbniaticaUy  to 
bc'cithcr  rejected  or  encouraged;  U  has  to  be  analyzed  and  evalu- 

^atcd— it  matters  what  materials  and  practices  arc  involved,  at 
v/hat  costin  student  tifne  and  resources,  and  with  what  effect  on 
student  skills  arid-attitudes  as  well  as  test  scores. 

Tbe  sAt  measures  developed  abilities  of  verbal  and  mathemati- 
cal reasoning  and  comprehension  that  are  acquired  gradually  over 
many  years  of  experience  and  use  in  both  schodl  and  rionschool 
settings.  By  virtue  of  this  gradual  development,  these  intellective 
skills  are  relatively  difficult  to  improve  markedly  tHrouj^h  brief- 
courses  of  intervention  in  the  final  yeaf  or  two  of  high  ^chool 
when  the  sat  is  typically  taken.  Since  these  abilities  are  les^rned 
in  manifold  ways  through  both  instruction  and  experience,  one 
would  expect  high  quality  instruction  over  extended  periods  of 
time  to  improve  them  and^hence  to  increase  sat  scores.  Indeed, 
score  gain  across  the  high  school  years  is  the  typical  pattern  ex- 
hibited by  students  taking  the  sat.  Since  coaching  at  its  best  is  a 
form  of  teaching,  the  key  questions  are  whether  the  coaching  ex- 
perience is  of  sufficient  quality  and  sufficient  duration  to  yie1d^ 
significant  skill  improvement  as  well  as  score  improvement  over 
and^above  the  experiential  growth  that  would  have  occurred  re- 
gardless of  the  coaching  program.  If  significant  improvement  re- 
quires relatively  large  amounts  of  student  time  devoted  to  coach- 
ing, then  the  ifroblem  becomes  expanded  to  include  questions  of 

,  the  difference  between  coaching  and  instruction  and  of  the  in- 
strumental role, of  comprehension  and  reasoning  skills  in  school 
lear^iing  as  well  as  their  status  as  explicit  objectives  of  school 

'  learning.  ^        '  ' 

.  Thus  the  issue  is  not  lust  whether  cpaching  works  or^not,  but 
'  how  much  student  time  devoted  to  what  kinds  of  coachmg  expc- , 
rienpes  yield  what  level  of  score  improvements  in  comparison 
wiTn  the  level  of  experiential  growth  occurring  without  those 
coaching  experiences.  Moreover,  since  students  with  different 
personal  and  background  characteristics  often  exhibit  different 
performance  characteristics  and  probably  even  learn  in  different 
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ways,  we  should  be  alert  to  thz  possibility  that  coaching  pro- 
grams; like  other  forms  of  teaching;  may  have  differential  effects 
for  differerit^kinds  of  students^ 

The  second.printing  of  this/rep|ort  incorporates  the  changes  pre- 
viously noted  on  an  errata  sheet  prepared  after  the  first^printing. 

Many  individuals  have  contributed  to  this  effort.  We  would 
like  to  thank  Thomas  Donlonl  Garlie  porehand;  and  Winton 
Manning  for  their  careful  revie^  of  the  manuscript;  Nathaniel 
Hartshorne  for  his  editorial  compients;  Rex  Jackson  and  Stephen 
Ivens  for  their  helpful  suggestions  on  the  presentation  of  argu- 
ments /and  of  summary  data;  Lloyd  Bond;  Robei[t  Glaser;  and 
Robert  Linn  for  their  advice  on  research  and  policy  implications; 
and;  Anthony  Bryk  for  his  comments  on  one  of  the  applicatioijls  of 
the  growth  model  included  in  thk  f irst,printing  of  this  report  Spe- 
cial thanks  go  to  John  Tukey  for  piis  general  review  of  the  an^ysis 
and  its  ramifications  and;  in  particular;  for  his  gentle  insistence 
that  student  contact  time  in  some  way  or  other  holds  the  key  to 


understanding  coaching  effects. 


Samuel  Messicl 
Princeton;  I^e^  Jersey 


929 


I 


Overview 


This  report  presents  a  critique  and  xeanalysis  of  the  Pederal  T.ade 
Commission's  (ftc)  study  of  commercial  coaching  for  the  Scho- 
lastic Aptitude  Telst  (sat).  The  ftc  study  is  one  of  the  Jargest  stud- 
ies of  coaching  ever  done  and  one  of  the  few  studies  of  commer- 
c  al  coaching  extant,  so  it  merits  careful  examination.  But  it  is 
not  the  only  coaching  study-  ever  done  nor  is  it  free  from  prob- 
lems of  design,  so  it  should  be  examined  in  the  context  oj[  prior 
findings.  ,  -  "  .  ' 

Theiifst  jiart  of  the  report  summarizes  the  major  results  of  ear- 
lier studies  in  a  way  that  draws  special  attention  to  the  strengths 
and  limitations  gf  t,he  various  study  designs.  One  of  the  most  im- 
portant these  design  features  is  random  assignment  of  examin- 
ees to  coaching  treatment  groups  and  noncoaching  control 
groups,  for  only  ^ith  random  assignment  can  we  consider  treat- 
ment effects  to  be.independent  of  prior  status  on  any  of  a  host'of 
personal  or  background  characteristics.  With  random  assign- 
ment, there  are  no  systematic  differences  between  the  experi- 
mental and  control  groups  initially  and  if  effective  control  condi- 
tions are  maintained,  the  only  systematic  difference  that  will 
eventuate  is  that  one  group  will  have  received  coaching  and  the 
other  will  not*  In  the  absence  of  randomization,  as  is  the  case  in 
the  FTC  study,  there  is  an  inevitable  equivocality  in  the  interpre- 
tatiph  of  the  results  because  some  unmeasured  personal  charac- 
teristics might  have  influenced  both  the  student's  decision  to  par- 
ticipate in  a  coaching  program  and  that  program's  apparent  effec- 
tiveness. That  is,  the  same  personal  factors  that  led. a  student  to 
attend  coaching  school  may  be  responsible,  at  least  in  part,  for 
subsequent  sat  performance  that  appears  to  be  the  result  of  the 
coaciiing  program.  A  number  of  factors  that  might  lead  a  person 
to  seek  coaching  niay  also  by  themselves  explain  why  such  a  per- 
son would  subsequently  perform  better  than  expected  on  the  out- 
come measure  orpost^test;  for  example,  a  student  might  not  have 
scored  as  well  on  the  psat  or  sat  as  he  or  his  parents  expected  in 
light  of  high  school^tades  or,,  in  contrast,  he  might  be  highly 
motivated  to  earn  a  high  score  to  compensate  for  a  prosaic  high 
school  performance.  Thus,  the  effects  of  self-selection  are  con- 
founded with  effects  of  the  coaching  treatment  in  nonrandomized- 
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studies  and,  consequently,,  self-selection  tactors  afford  plausible 
rival  explanations  for  the  results,  or  for  part  of  t,he  results,  that 
might  otherwise  be  identified  as  coaching  effects.  In  such  non- 
randomized designs,  researchers  usually  attempt  to  control  sta- 
tistically  for  those  potential  ^elf-selection  factors  that  have  been 
-measured  and  to  analyze  the  data  in  alternate  ways  to  assess  the 
'  sensitivity  or  robustness  of  the  findings  under  various  plausible 
assumptions,  but  there  is  no  way  to  adjust  statistically  for  self- 
selection  factors  that  have  not  been  assessed . 

An  historical  appraisal  of  the  effects  of  coaching  on  the  sat  is 
complicated  because  most  of  the  investigations  prior  to  the  ftc 
study  were  concerned  with  diverse  special  preparation  programs 
typ'ically  offered  by  secondary  schools.  Furthermore,  some  of 
these  studies.used  nonrandomized  designs  and  therefore  are  ham- 
pered by  the  same  problems  of  interpretation  that  affect  the  ftc 
study;  some  were  also  poorly  controlled  and  involved  small  sam- 
ples-. On  balance,  the  average  effect  associated  with  participation 
in  a  coaching  or  special  preparation  program  according  to  those 
earlier  studies  that  included  some  type  of  control  group  was  less 
than  10  points  for  the  SAT-Verbal  score  (on  a  scale  running  from 
2Q0  to  800  points)  and  less  than  15  points  or  so  for  the  Math 
score.  For  example,  two  studies  were  conducted  using  random 
assignment  of  students  to  coaching  and  control  conditions,  one 
dealing  with  SAT-Math  and  the  other  with  sat- Verbal:  In  a  study 
by  Evans  and  Pike  (1973)  an  average  effect  of  slightly  over  16 
points  for  sat-M  was  obtained  for  special  preparation  involving 
seven  3-hour  sessions  with  21  additional,  hours  of  homework; 
Alderman  and  Powers  (1979)  estimated  an  overall  special  prepara- 
tion effect  across  eight  secondary  schools  of  about  8  points  for 
SAT-V  However,  for  particular  groups  of  students  and  for  particu- 
lar coaching  treatments,  estimated  effects  of  over  20  points  were 
■  also  reported  in  various  studies.  Although  substantive  content  of 
the  coaching  programs  was  not  systematically  evaluated  as  part 
of  these  studies,  the  smaller  effects  afipear  to  be  associated  with 
short-term  cramming  or  drill-and-practice  and  the  larger  effects, 
found  more  often  for  Math  than  Verbal,  with  longer-term  inten- 
sive programs  invplving  skill  development.  In  addition,  results  m 
at  least  two  earlier  studies  suggested  possible  interactions  for 
SAT-M  as.a  function  of  years  of  math  taken  and  sex.  Relatively 
consistent  with  this  historical  context,  the  ftc  study  found  negli- 
gible effects  for  students  attending  one  commercial  coaching 
school  and. average  score  increases  of  about  20  to  30  points  for 
both  SAT-V  and  -M  for  students  attending  another  school  (where 
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the  coaching  program  entailed  10  four-hour  sessions  plus  home- 
work). 

Because  random  assignment  could.not  be  employed  in  the  ftc 
study,  this  20-  to  30-point  effect  for  students  attending  one  school 
IS  actually  an  estimate  of  the  loint  effects  of  coaching  and  self- 
selection.  This  confounding  of  treatment  and  self-selection  effects 
is  one  of  the  rnajor  issues  addressed  in  the  critique  of  the  ftc 
study  that  follows  in  Section  III.  It  is  impossible  to  determine 
with  confidence  whether  the  effects  reported  by  the  ftc  study 
may  be  attributable  in  whole  or  in  part  to  self-selection  not  con- 
trolled under  the  study  design  rather  than  to  any  impact  of  the 
coaching  program  as  such.  No  statistical  reanalysis  of  the  data, 
given  the  study  design,  can  fully  solve  this  problem. 

NeverthelesiT,  in  an  effort  to  contribute  further  to  an  under- 
standing of  this  complex  issue  of  coaching  effectiveness,  we  com- 
missioned two  major  reanalyses  of  ftc  data.  The  first  one  fol- 
lowed an  analysis-of-covariance  type  of  model  similar  to  the  ftc 
approach,  but  included  additional  background  scores  as  covari- 
ates.  Furthermore,  this  first  reanalysis  introduced  an  important 
refinement  in  that  estimated  effects  were  obtained  relative, to  the 
regression  line  for  noncoached  students  rather  than  for  pooled 
coached  and  noncoached  students  as  in  the  ftc  analysis.  This  re- 
analysis covered  all  three  commercial  schools  in  the  ftc  data  stt, 
including  one  for  which  no  analyses  were  undertaken  by  the  ftc 
because  of  its  small  sample  size.  The  overall  results  were  similar 
to  the  general  ftc  findings,  inconsistent  and  negligible  effects  for 
students  at  two  schools  and  for  students  at  the  third  school  com- 
bined coaching  and  self-selection  effects  of  about  20  to  35  points 
for  both  Verbal  and  Math  scores.  In  addition,  for  students  attend- 
ing the  two  largest  schools,  this  study  investigated  interactions 
between  the  size  of  effects  and  the  characteristics  or  backgrounds 
of  the  students.  Two  interactions,  one  involving  race  and  the 
other  self-reported  parental  income,  ^yere  uncovered  for  students 
at  one  of  the  coaching  schools,  the  one  exhibiting  negligible 
effects  overall,  but  not  at  the  other  and  only  for  sat-V,  not  for 
SAT-M.  The  sample  of  black  students  was  very  small  and.some- 
what  atypical,  but  black  students  at  that  one  school  exhibited 
larger  coaching/self-selection  effects  than  nonblacks.  Similarly, 
independent  of  the  race  interaction,  students  reporting  low  paren- 
tal income  exhibited  somewhat  larger  coaching/self-selection 
effects  than  those  reporting  high  parental  income. 

The  second  reanalysis  employed  a  statistical  model  which 
takes  account  of  differential  rates  of  growth^  in  sat  scores  over 
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time,  if'they  accur,  for  the  coached  and  noncoached  groups.  How- 
ever^ this  analysis  does  not  adjust  for  self-selection  factors  or 
other  differences  between  the  groups  on  background  variables  un- 
related to  differential  growth.  Because  this  analysis  required 
three  test  scores  for  each  student,  it  was  undertaken  only  at  the 
largest  coaching  school,. the  one  for  which  the  ftc  found  a  correla- 
tion between  coaching  school  attendance  and  sat  performance. 
Differential  growth  in 'the  abilities  measured  by  the  sat  appeared 
to  operate  in  these  data  more  for  the  Verbal  score  than  for  the 
Math  score.  The  resulting  estimates  of  the  combined  coaching/ 
self-selection  effect,  taking  differential  growth  into  account,  were 
about  17  points  for  Verbal  and  30  points  for  Math. 

After  reviewing  earlier/studies  and  the  ftc  study,  the  present 
report  then  considers  the  implications  of  the  findings  for  testing 
;  practice  and  policy.  One  key  issu?  is  the  extent  to  which  in- 
.  creased  test  scores  attributable  to  coaching  may  represent  stable 
long-term  improvements  in  the  verbal  and  mathematical  reason- 
ing skills  measured  by  the  sat  or  instead  reflect  the  overcoming  of 
inadvertent  sources  of  test  difficulty  unrelated  to  these  reasoning 
skills,  such  as  difficulty  associated  with  test  apxiety  and  unfamil- 
iarity  with  different  item  formats  and  test-taking  strategies.  No 
coaching  study,  however,  has  yet  directly  addressed  this  basic 
question  of  whether  obtained  score  increases  reflect  stable  ability 
improvements  or  increased  test  wiseness. 

The  SAT  measures  verbal  and  mathematical  reasoning  abilities 
that  develop  over  many  years  of  experience  and  use  in  both  non- 
school  and  sthool  settings,  and  it  is  difficult  to  improve  them 
with  short-term  interventions  at  seventeen  or  eighteen  years  of 
age,  when  the  sat  is  typigally  taken.  Nonetheless,  these  abilities 
are  learned,  and  effective  learning  experiences  that  facilitate  their 
further  development  and  result  in  test  score  increases  should  be 
welcomed.  Such  score  incre^^cs  reflective  of  improved  abilities 
do  not  invalidate  the  sat— on  the  contrary,  they  contribute  to  the 
test's  construct  validity  as  a  measure  of  verbal  and  mathematical 
reasoning  abilities  and  presumably  also  to  its  predictive  utility, 
since  the  improved  abilities  should  serve  the  student  well  in  cri- 
terion situations  (such  as^  school  or  college  learning)  that  entail 
verbal  and  quantitative  reasoning  by  analogy,  induction,  or  de- 
duction. Issues  of  equity  of  access  to  coaching  programs  that  may 
develop  these  abilities  are  basically  similiar  to  issues  of  equity^of 
access  to  effective  school  programs  or  to  effective  nonschool 
learning  experiences.  Thus,  any  score  increases  that  may  repre- 
sent real'  improvements  in  the  underlying  abilities  measured 
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would  obviously  have  implications  fqr  instruction  and  educa- 
tional practice.  No  study  to  date  has  systematically  addressed  the 
question  of  what  kind  of  instruction  may  be  most  effective  over 
what  period,  for  what  kinds  of  students  or  groups  of  students,  in 
improving  sat  performance.  Data  that  would  permit  a  detailed 
comparison  and  evaluation  of  the  commercial  coaching  programs 
covered  in  the  nrcjeport  have  not  been  made-available. 

On  the  other  hand,  any  score  increases  that  may  resultjrom  the 
reduction  of  construct-irrelevant  difficulty  on  the  test  have  impli- 
cations for  testing  practice.  Such  sources  of  difficulty  should  be 
eliminated  to  the  extent  possible  through  astute  test-construc- 
tion procedures.  For  this  reason  also,  prospective^examinees 
should  be  provided  with  test  familiarization  materials^  sample 
tests  that  can  be  taken  at  home,  and  other  aids  to  effective  test 
taking,  such  as  those  prepared  and  distributed  by  the  College 
Board.  Issues  of  equity  of  access  to  coaching  •programs  that  help 
overcome  such  extraneous  test  difficulty  become  important  to 
the  extent  that  student  differences  in  test-taking  skills  per  se  sub- 
stantially influence  test  scores. 
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II 

Before  the  FTC  Study: 
The  context  of  Prior  Findings 
on  Coaching  for  the  SAT 


The  Scholastic  Aptitude  T^^st  (sat)  was  developed  as  a  measure  of 
academic  abilities,  to  be  used  toward  the  end  of  secondary  school 
as  a  predictor  of  academic  performance  in  college,  and  as  a  stan- 
dardized supplement  to  the  secondary  school  record  available  to 
xollege  admissions  officers.  The  sat  was  explicitly  designed  to 
differ  from  achievement  tests  in  school  subjects  in  the  sense  that 
its  comtcnt  is  drawn  from  a  wide  variety  of  substantive  areas,  not 
tied  to  a  particular  course  of  study,  curriculum,  or  program. 
Moreover,  it  taps  intellectual  processes  of  comprehension  and 
reasoning  that  may  be  influenced  by  experiences  outside  as  well 
as  inside  the  classroom.  These  intellectual  skills  are  exercised  to 
some  degree  in  all  subject-matter  areas  at  all  levels  of  schooling, 
as  well  as  in  response  to  real-life  situations.  These  skills  are 
thereby  learned  in  manifold  ways  and  gradually  develop  over  time 
as  a  function  of  both  instruction  and  experience.  The  growth  of 
these  acquired  abilities  thus  tends  to  be  slower  than  growth  in 
achievement  areas  such  as  French,  chemistry,  ancient  history, 
and  trigonometry,  which  are  prirnarily!  learned  as  a  function  of 
curriculum  and  instruction., In  addition,  the  sat  is  intended  as  a 
prospective  measure  for  the  prediction  of  future  academic  perfor- 
mance rather  than  as  a  retrospective  measure  for  the. evaluation 
of  past  school-related  attainment.  The  specificjtem  content  on 
the  SAT  attempts  to  sample  the  sort  of  cognitive  skills  underlying 
college-level  performance:  reading  with  comprehension,  under- 
standing vocabulary,  verbal  reasoning,  computational  skills, 
quantitative  reasoning,  and  problem  solving. 

Thus,  the  purpose  of  the  sat  is  to  predict  academic  succe^  in 
college.*  It  was  .designed  to  reflect  verbal  and  mathematical  abili- 
ties that  are  acquired  over  an  extended  period  and  hence  can  be 
expected  to  be  diffTcult  to  improve  substantially  through  short- 
term  instructional  cfforts.^However,  these  reasoning  abilities  are 
learned  and  if  effective  learning  experiences,  including  effective 
coaching  prograrhs,  facilitate  their  development,  one  would 
expect  not  only  increases  in  sat  scores  but  also  increases  in  crite- 
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rion  performancc—in  this  case,  performance  in  college.  Such 
increases  in  test  scores  and  academic  performance  do  not  invali- 
date the  SAT— rather,  they  contribute  to  its  construct  validity  and 
predictive  utility.  Coaching  or  special  preparation  programs  that 
increase  test  scores  that  were  inaccurately  low  because  of  anxi- 
ety, for  example,  or  test  unfamiliarity  would  also  improve  the 
validity  of  measurement  by  virtue  of  reducing  the  prior  invalidity 
of  measurement.  If,  on  the  other  hand,  special  preparation  or 
coaching  efforts  result  in  a  substantial  increase  in  test  scores 
without  a  corresponding  positive  effect  oh  the  level  of  verbal  and 
mathematical  reasoning  abilities  measured  by  the  test,  the.  value 
of  the  test  scores  fo''  admissions  purposes  .would  be  undermined. 
Thus,  three  major  potential  effects  of  coaching  rnay  be  distin- 
-->^.Wshed;,, First,, some  coaching  programs  may  improve  the  abilities 
'^^IB^  Skflli  measured  .by  the  test,  resulting  in  commensurate 
increases  in  test  scores,-  second,  some  coaching  programs  may 
enhance  test-taking  sJophistication  or  reduce  anxiety  associated 
with  taking  tests,  resulting  in  increased  tesj  scores  that  are  more 
accurate  assessments  of  ability  and  skill;  and,  third,  some  coach- 
ing programs  may  teach  test-taking  strategies  and  answer-selec- 
tion tricks,^  resulting  in  .increased  test  scores  that  are  inaccurately 
high.  Some  coaching  progtams,  of  course,  may  produce  none  of 
these  effects  or  more  than  9ne  in  various  combinations.  The  first 
two  effects,  if  they  were  realized,  would  be  good  from  the  stand- 
point of  the  student  and  good  from  the  standpoint  of  test  validity. 
The  third  effect  is  probably  minor  with  well-constructed  tests, 
because  test-makers  should  strive  to  minimize  the  use  of  compli- 
cated or  tricky  item  formats  and  to  eliminate  items  that  may  be 
•  answered  on  jhe  basis  of  clues  unrelated  to  the  abilities  tested. 
Moreover,  test-makers  should  also  strive  to  reduce  the^import  of 
the  TNCcond  possible  effect  of  coaching  by  providing  test-familiari- 
zatipn^materials  and  practice  tests  to  all  candidates  as  well  as  ad- 
yice  on  guessing,  reviewing,  pacing,  and  the  like,  in  part  to  re- 
duce apprehension  about  what  to  expect.  With  respect  to  the  first 
type  of  effect,  if  coaching  or  special  preparation  programs  can  im- 
prove the  abilities  measured  by  the  sAt,  the  effective  components 
and  techniques  should  be  identified  and  incorporated  more  v/idc- 
)yljn  secondary-  and  possibly  elementary-school  instruction. 
There  is  little  question  that  the  verbal  and  mathematical  abilities 
measured  by  the  sat  are  learned,  but  there  are  large  questions 
about  how  they  can  be  taught. 

There  is  a  progression  or  ordering  pf  educational  tests  ranging 
from  measures  of  scholastic  and  intellectual  abilities  at  one  pole. 
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with  content  drawn  from  a  variety  of  substantive  areas,  to  mea- 
sures of  academic  attainment  it  the  other  pole,  with  content  spe- 
cialized by  subject-matter  field,  the  sat  falls  toward  the  first 
extreme— it  taps  general  intellectual  processes  that  develop  grad- 
ually over  many  years  of  experience  and  use  both  in3ide  the  class- 
room and  in  everyday  life,  and  these  processes  should  therefore  be 
relatively  difficult  to  enhance  markedly  through  brief  courses  of 
intervention.  The  typical  educational  achievement  teSt  falls 
toward  the  other  extreme— it  taps  specific  knowledge  and  skills 
acqijired  through  the^nornial  course  of  classroom  instruction  or 
independent  study,  and  this  knowledge  and  skill  should  therefore 
be  relatively  responsive;  to  instructional  intervention,  even  in 
brief  courses.  Similarly,  there  is  a  progression'of  types  of  prepara- 
tipn  for  taking  examinations  rangiiig  .frpni  simple  practice  on 
sample  items  at  one  extreme  to  the^provision  of  intensive  instruc- 
tion aimed  at  developing  ability,  and^knowledge^at  the  other  ex- 
,  treme.  What  has  come  to  be  called  '^coaching"  is  now  generally 
considered  to  fall  anywhere  in  the  broad  range  between  these  two 
extremes,  entailing  some  combination  of  test  familiarizatibn, 
drill-and-practice  with  feedback,  training  in  strategies  for  general 
test-takiijg  and  for  specific  item  formats,  subject-matter  review, 
and  skill-development  exercises-r-although  widespread  usage  of 
the  term  in  the  past  tended  to  underscore  drill  and  cramming 
toward  the  practice  end  of  this  range.  The  important  point,  how- 
ever, whatever  the  special  test  preparation  is  called,  is  whether  or 
not  it  leads  to  significant  test  score  increases  and,  if  it  does, 
whether  those;  increases  represent  genuine  long-term  improve- 
ments in  the  knowledge  and  abilities  measured  by  the  test  as  op- 
posed to  enhanced  test-taking  skills  irrelevant  to  the  purposes  of' 
testing.  The  studies  that  have  been  undertaken  in  this  area,  in- 
cluding the  FTC  study,  have  tended  to  focus  on  the  prior  question 
of  whether  or  not  special  preparation  may  produce  score  in- 
creases. Because  of  the  relatively  modest  effects  identified,  there 
has  been  little  impetus  to  consider  whether  any  obtained  score  in- 
creases represent  improved  abilities  that  endure  over  a  long  term. 

Although  there  was  considerable  variation  in  the  score  in- 
creases observed  for  particular  groups  of  students  and  for  particu- 
lar programs  or  treatments,  the  earlier  studies  on  the  average 
reported  score  increases  associated  with  special  preparation,  rela- 
tive to  score  increases  for  control  groups,  of  less  than  10  points  on 
SAT-Verbal  and  less  than  15  points  on  SAT-Math,  on  a  score  scale 
ranging  from  200  to  800  points.  Studies  lacking  control  groups 
yielded  larger  effects  but  since  they  differed  from  control-group 
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studies.not  only  in  jJcsign  characteristics  but  in  critical  program 
chafacteristkS;  their  interpretation  is  especially  problematic.  In 
spite  o4 an.apj)arent  cpnsistency  of  results  when  some  type  of  con-^ 
trol-group  comparisoi[i  was  included;  many  of  these  studies  had 
methodological  weakriesses  that  detract  from  the  strength  of  the 
conclusions  drawn.  Wfi:  now  summarize  the  result^  of  these  ear- 
lier studies  and  consider  in  detail  their  particular  strengths  and 
weaknesses.  The  ftc  study  will  be^analyzed  in  the  next  section  of 
this  report.  -  — 


Studies  With  NO  Control  Croups  | 

Three  studies,  have  been  conducted— those  by  Pallone  in  1961,  by 
Marrdn  in  l^SS/and  by  Coffman  and  Parry  in  1967— that  lacked^ 
any  control  group  for  evaluating  unusual  patterns  of  score 
change.  Pallon'c  (1961)  looked  at  the  effects  of  short-  and  long- 
term  intensive  developmental  reading  courses  on  sat  scores  of 
students  u\  a  private  school  for  boys.  The  courses  were  under- 
, taken  "for  students  in  their  final  year  of  pre-college"  work,  in- 
cluding a  large  number  of  high  school  jgraduates  who  were  com- 
pleting a  year  of  post-high  school  s^udy  in  preparation  for  en- 
trance into  the  U.S.  government  academies'*  (p.  655).  According 
to  Pallone,  to  improve  the  skills  measured  by  the  sat,  "not 
'coaching'  methods,  but  instruction  of  a  developmental  nature  in 
reading  and  vocabulary  skills  was  indicated.  ImJ^rovement  in 
scores  could  be  expected'only  if  the  ba^c  skills  measured  by  the 
test  were  first  strengthened"  {pp.  654-655),  This  program  provid- 
ed focussed  instruction  to  strengthen  reading-^Ghi<^v<mK^along- 


with  intensive  practice  in  reading  skills,  including  such  special 
skills*  as  skimming  ancf  critical  reading,  as  well  as  a  brief  analysis 
of  typical  verbal  analogy  test  items.  Approximately  20'students^ 
participated  in  a  six-week  summer  pilot  program  that  met  for  90 
minutes  daily.  Substantial  percentile  increases  corresponding  to 
mean  reading  achievement  were  reported  on  the  basis  of  pre-  and 
posttest  results.  An  average  score  increase  of  98  points  was  ob- 
tained on  SAT- Verbal  from  the  March  1959  to  August  1959  admin- 
istrations. The  long-term  program  covered  a  six-month  period 
from  September  to  March  with  daily  jneetiiigs  of  50  minutes 
each.  From  March  of  1959  to  March  of  1960  for  some  80  students 
who  completed  the  long-term  course,  an  average  sat-V  increase  of 
10,9  points  was  reported,  although  the  difference  in  mean  scores 
in  Pallone's  Table  3  (p.  656)  was  only  84.  The  students  who  par- 
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ti^aletf'in  the  summer  program  also^ompleted  the  Ipng-tprn^ 
reading. course.  The  mean  increase  in  their  Verbal  s'corCjS  for!  the 
period  from  March  1959  to  March  156(Lwas  almost  122  point^,  or7 
an  average  of  about  24  points  over  the  increase  reported  after  the 
summer  course.  Tbe  special  quality  of  the  sample  and:the  laci<:  of 
~contf^  groups  severely  limitlihe  implications  of  these  findings 
vis-i-v^is  coaching.  Furthermore,  the  instructional  focus  on  skill 
development  and  the  intensive  and  long-term  nature  of  the  pro- 
^grams  put  Pallone's  efforts  close  to  what  ordinarily  would  be  con- 
sidered Vinstruction"  in  contradistinction  to  "cbaching,"  asj^al- 

lonehimVelf  insisted.   - 

In  the  dbs<mcetrfir(^rol^rpups  of  similar  students  -at  tfiis  pre- 
paratory school  who  were  not  taking  Pallone's  course,  it  is  diffi- 
cult to  assiss  the  import  of  these  score  gains.  Pallone  ^1961)  sug- 
gested cornparing  them  wUh  normal  expectations  of  gains'  i^f 
about  35-poWs  on  sat-V  during  the  final  seconda'17  school  year. 


—which  would  yield  an  instructional  or  program  effect  of  about  83 
points  for  thasummer  pilot  program  (prorated  for  the  five  months 
between  tests)  and  about  74  points  for  the  long-term  program. 
This  is  not  a  very  satisfactory  comparison,  however,  since  PaV 
lone'<;  stujlents  were  not  representative  of  students  in  their  final* 
year  of  high  school  who  take  the  sat.  Slack  and  Porter  (1980)  sugr 
gested  comparing  Eallone's  results  with  average  gains  in  national  ^ 
administratibna  of  junior-  to:  senior-year  fetcsters  having  the 
sanie  initial  average  score  levels  as  Pallone's  students,  vyhicH 
yields  pr^artcd  instructional  effects  of  85  and  79  points,  respec- 
tively,'^for  the  summer  and  long-term  programs.  Again,  this  is  not 
a  very  satisfactory,  comparison  because  Pallone's^  private  school  ^ 
students  were  hot  si  representative  sample  of  the  national  popula- 
tion of  test  repeatets.  Pike  (1978)  suggested  comparing  Pallone^s. 
results  with  average  gains  of  control  siudents  in  superior  schools 
from  other  studies  (jf  proprietary  programs— for  example,  those 
conducted  by  Frankel  (1960)  and  by  Whitla  (1962)  described 
below.  Wh^n  adjusted  for  time  differences  between  pre-  and  poist- 
tesi^  in  these  studies,  this  comparison  lead&  to  instructional 
effects  of.about  75  and  53  points,  respectively,  for  the  summer, 
-and  long-term  programs.  Ij  compared  with  score  gains  of, control 
students  in  other  coacning  studies  who  had  average  initial  secure 
]cvcls^qughly4:omparable  to  Pallone's  groups,  namely  in  this  in- 
stance" a~Velectiori~d^^  from  th^  study  byJCiear 
(1958)  described  bclow,^the  adjusted  instructional  effects  arc^  80 
and  65  points,  respectively.  Thii, point  is  that  in  the  absence  of 
comparable  control  groups,  no  generally  satisfactory  estimatb  of 
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instructional  effect^  can  be  ofiTairied;  If  an  average  is  taken  across 
the  four  adjustments  just  suggested,  the.riisulting  estimates  of  in- 
structional effects  are  81  ah^  68  points,  ^respectively,  for,  the  sum- 
iner  and  long-term  programs.  Thc;se  values  are  very  likely  still  , 
overestimates,  however,  because  none  of  the  coniparisons  can 
take  into  account  the  highly  self-selected  hature.ofPallone'^  pri-/^ 
vate  school  students,  many  of  whoni  were  completing  a  p^st-hign 
school  year  highly  motivated  to  increase  their  chances  6f  entering 
service  academies  or  selective  colleges.  But  given  the  overall  size 
of  the  .effects,  even  with  somewhat;  larger  adjustnients,  it  seems 
likely  that  Pallone's  (1961)  intensive  summer  and  long-term  ef- 
forts at  "instruction  of  a  developmental  nature"  may  have  suc- 
ceede;d  to  scnme  degre^inc^strengthening  basic  skills  measured  by  ^ 
'  thes/ir.'  - 

Marron  (1965)  examined  sat  score  gains  for  students  at  ten 
well-knqwn  preparatory  schools  that  specialize  in  preparing  liigh 
schoc^l  graduates  for  admission,  to , the  service  academies  and 
selective  colleges.  The  instructional  programs  entailed  "six 
months  of  full-time  exposure  to  cburse  cotitefit  that  is  directly 
related  to  the  verbal  and  mathematics  College  Board  tests  (both  ' 
Aptitude  and  Achievement)"  (p.  1).  A  special  administration  of 
SAT-V  and  -M  and  College  Board  achievement  tests  (English  com- 
position and  intermedijttf  or  advanped  math)  at  all  ten  schools  in 
Septerfiber  1962  smed  as^he  pretest,  while  the.posttest  was  the 
regujair  College  Board,  admissions  testing  administration  in 
March  11963.  It  should  be.noted  tha*t  if  the  level  of  motivation  and 
effort  on  a  special  pretcstJthat  did  not  count  for  college  admission 
was  not  comparable  to  tliat  on  the  regular  posttest,  the  instruc- 
tional effects  in  Marrpn'^  study  would  likely  be  overestimated. 
Since  significant  differences  were  Obtained  amo^g  the  ten  schools 
with  respect  to  both  the'September  pretest  scores. and  the  March 
posttest  scores  and  these  latter  differences  remained  sigpificant 
in  analysi^es  of  covariancQ  adjusting  for  pretest  levels,  the  tj^efall 
results  were  reported  sej)arately  for  groups  of  schools  having  non- 
significant differences  within  group*.  Score  gains  on  sat-V  were  77 
points  foF>group.l  (2  schools,  N  =  83),  56  points  for  group  2  (6 
schools,  t^=i«;600),  47  .points  for  group  3  (1  schpol^t  N  =  5),  and  35 
pomts  for^group  4  (1  school,  N  f  26);  the,  weighted  average^^-V 
increase  over  all  groups  was<58  points.  Score  increases/ fqr  satsJVI 
wcr?  83  ppints  for  group  1  (4  schools,  N  =  232),  78  points  for 
g|roup  2  (3  Schools,  N  «  405],  and  72  points  for  group  3  (3  schools, 
N«  78);  the  weighted  average  sat-M  increase  overall  groups  was 
79  points.  iVeighted  average  gains  on  achievement  tests  were  83 
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points  for  English  composition,  133  points  for  intermediate 
math,  and  127  points  for  advanced  math.  Again,  in  the  absence  9f 
coaKpi  groups,  it  is»difficult  to  appraise  the  size  of  these  instruc- 
tionareffects,  but  it  appears*  that  on  a  relative  basis  achievement 
test  scoVs  improved  much  more  than  sat  scores— on  the  average 
•  about  half  again  a^ much./         /  ,  * 

Marion  (1965)  suggested  comparing  the  sat  score  gains  w-ith 
those  considered  typical  for  males  in  their  senior  year  in  sec^bn- 
dary  school,  which  he  reported  based  on  College  Boardjla<^^40 
points  for  sat-V  ^and  43'pomts  for  sat-M  over  a  10-mdnth  testm^ 
interval.  Prorated  for  the  six-rnonth  testing  interval  in  Marrpnj 

-  studyYthis  yields  an  adjusted  weighted  average  of  34  pointp  fo 
SAT-y  ^d  53  points  for  sax-M.  As*was  done  for  Pallone's  (1961J 
results,libe  suggested  a4justm^fats:6.f  Slack  and  I^drter  (l9S0l^  ^ 
.Pike  {197S)^^  also  applied  tD  MarrOh^s  figUreS,  along  witlXari 
adjustment^ased  on  score  gains  of  control  students  in  other 
coaching  studies  who  had  average  initial  scor^  levels  roiighiy 
comparable  to  Manon's  groups.  If  an  average  of  all  four  of  thdse 
adjustments  is  taken;  the  resulting  weighted  average  values  are 
35  points  for  sat-V  and  54  points  for  sat-M.  But  again,  nohe  of 
these  adjustments  is  very  satisfactory  because  none  of  the  sug-^ 
gested  comparisons  takes  into  account  the  highly  seir-seltcted' 
nature  of  Marron's  students,  thereby  leaving  uhpoaant  fact(j)rs  of 
differential  motivation  and  growth  uncontrolled.  In  any  event, 
•the  relevance  of  Marton%tl'965)  study  to  the  issue  of  ^'coaching" 
is  arguable,  since  six  months  ofiull-tijtne  exposure  to  coursejcon- 
tent  directed  at  A^erbal  and  mathematical  knowledge  and  sjcills 
would  ordinarily  be  considered  "instruction.''  T'  ese  score  "gains, 
whatever  comparison  groups  they  are  contrasted  with,  might|bet- 
ter  be  interpreted^as  testimony  to  the  learning  and^kill  devd^lop- 
ment  that  highly  motivated  high*  school  graduates  carl  accom-- 
plish  with  six  months  of  full-time  concentrated  effort  on  focussed 

-curricula.  .  *    i  r 

In  an  attempi  to  explore  further  the  effects  of  developmental 
reading  instruction  on  sat-V  scores,  especially  in  light  of  Eal* 
lone's  (1961)  findings,  Coffman  arid  Parry  (1967)  undertook  a 

-  study  of  three  groups  of  college  freshmen  who  took  the  sat^V 
before 4nd  after  completing'^a^cours^^  in  accelerated  reading,  The 
course  was  described  as  stressing  speed  of  reading  with  relative 
accuracy.  Pre-  and  posttesr  scores  based  on  special  administra- 
tions of  tho  sat  were  available  for  two  small  groups  of  10  and  9 

\  students  who  elected  an  eight-week  course  meeting  six  hours 
.  ^*ach  week.  Pre-  and  posttest  sat-V  scores  were  also  available  for 
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25  Students  wjiosc  course  met  >three  hours  a  week;foT  15  weeks. 
For  the  ejght-week  cou  oc,  the  increases  in  sat-V  Were  3.5  and  9.9 
pointS;  while  a  28.9  ipean  loss  was  observed  for  the  group  taking 
the  15-week  course.  This  score  decrease  in  the  jS-week  course 
may  stem  from  problems  of  test  administration  a^nd  score  equat- 
ing since  time*constraints  dictated  the  use  of  a  Shortened  sat-V 
for  that  group.  It  may  also  reflect  problems  in  th^e  motivation  o( 
students  who  take  a  special  sat  when  they  are  already  in  college, 
as  may  the  Vdativelj/  modest  score  increai>es  in  the  other  two 
groups— although  all  of  these  students  were  pr(jsjimably  moti- 
vated to  enroll  in  the  course,  which  explicitly  entailed  taking  the 
SAT.  In  addition,  the  lack  of  coniibl  groups  is  a^ain  a  factor  that 
seriously  impairs  the  usefulness  of  these  result^.  Although  these 
findings  are  jn  sharp  contrast  to  the  score  increases  reported  by 
l^allone,  the  accelerated  reading  program  studied  by  Coffman  and 
,  Parry  appears  to  be  considerably  different  from  Pallone's  develop- 
mental reading  curncnlum  and  apparently  pot  as  directly  rele- 
vant-to  the  skills  measured  by  the  sat.        y  • 

/  :, 

studies  with  NoneqtiSvalent  Control  Croups 

A'Second  methodological  weakness  obtains  In  three  other  earlier 
studies:  Although  each  incorporated  control  groups,  these  groups 
were  drawn  from  schools  different  from  thos^  providing  special 
preparation  (or  the  experimental  students,  thus  confounding 
treatment  or  preparation  effects  with  school  effects. 

;  Dyer  ( 195v3)  studied  seniors  at:t\v6Tiighly  selective  independent 

schools  for  boys— 225  students  at  one  school  served  as  the  treat- 
ment group  and  193  students  at  the  other  scl^ool  served  as  the 
control  group.  The  students  at  both  schools  took  tlie  sat  twice, 
once  in  September  1951  and' again  in  March  1952.  The  twogroiips 
of  students  were  similar  with  respect  to  length  of  tinie  enrolled  in 
•ti>c  sc>^ool,  level  of  sat  scores,  and  the  level  and  number  of 

.  ^  ,  forJign-language  and  math  courses  taken.  The  experimental 
g'^oup  completed  .12  verbal  practice  exercises  in  30-  to  60-minute 
sessions  and  five  math  practice  exercises  in  60-  tO'90-tninute  ses- 
*sions.  The  control  variables  in  an  analysis  of  covariance  were  in- 
itial SAT  scores,  niimber  of  years  each  student  had  been  enrolled  in 
school,  and  the/number  and  level  of  foreign-language  and  mathe- 
^  matics  courses  taken  in  the  senior  year.  The  estimated  increase 
. '  m  score  forj^ie  treatmimt  group  over  the  control  group  was  about 
(4.6)  points  in  Verbal  and  about  13  (12.9)  points-ia  Math. 
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When  the  students  were  divided  into  those  who  were  n6t  taking 
mathei^atics  courses  as^seniors  and  those  who  were,  the feo-math 
boys  who  were  coached  gained  over  29i  points  more  thjin  those 
who  wqre  not  coached.  In  contriist,  it  y/as  found  that  the  toys 
taking  ijnathematics  who  were  cc^ched  gained  3,3  points  more 
than  thise  taking  mathematics  w|io  were  not  coached.  Dyer's 
conclusipns  were  (1)  ihat  coaching  on  sat- Verbal  is  not  likely  to 
be  effective;  (2)  coaching  on  SAT-Math  will  be  of  some  advantage 
Only  if  the  students  coached  are  not  already  enrolled  in  regular 
/math  courses.  ,  \ 

IaJ955,  John  W.  French  reported  a  stuay  conducted  at  three 
schoojs.  The  students  at  School  A  (N=  1581  pursued  their  regular  , 
courses  4ith  no  atte/npt  at  special  prepamtion  for  the  sat  and 
served  as  la  control  gtoup  for  coaching  in  blpth  Verbc^  and  Math^ 
the  studems.at  Schqpl  B  (N  =  1 10)  served  as  'a  treatment  group  for 
Verbal  anil  as  ^  control  group  for  Math;  knd,  the  students  at 
School  C  {N=/161)  served  as  a  treatment  group  for  both  Verbal 
and  Math] The  special  preparation  program  in  Verbal  at  School /B 
differed  frqi]l  the  one  at  School  C  in  that  the  fprmer  primarily  env 
p'hasized  vocabulary  for  a  total  of  4 !/2  hours,'  while  the  latter  re- 
viewed loj verbal  exercises  more  representative  of  sat-V  skills. 
The  students  were  all  seniors  who  planned  to  go  to  college.  In 
"  addition,  spme  students  in  School  C  participated  who  were  en- 
rolled in  a  technical  course.  AU  students  took  the  sat  in  Septem- 
ber 1953  aAd  again  in  March  1^54.  The  data  were  subjected 'to  an 
analysis  oflcovariance,  using  sat  scores  earned  in  September  1953 
as-  the  independent  or  control  variable  arid  sat  scores  earned  in 
March  195j4  as  the  dependent  or  outcome  yariable.  The  results  of 
French's  analysis  were  mixed.  The  advantage  in  Verbal  score  for 
boys  and  ^nrls  combined  who  were  coached  over  those  who  were 
'not  coached  was  found  to  be  18  points  in.jne  school  and  5  points 
in  another  (the  one  with  the  vocabulary  :oaching  prograrri).  The 
scote  increase  in  Math  for  boys  and  .girls  combined  who  were 
coached  6ver  those,  who  were  not  coached  was  shown  to  be  6' 
points  when  compared  to  one  control  school  and  18  points  when 
compared  to  the  other.  Thus,  the  largest  benefit  resulting  from 
Iboaching  for  groups  of  boys  and  girls  combined  was  18  points  in 
yerbaliand|18  points  in  Math.  When  broken  down  by  sex  and  cur- 
rent .enrollment  in  math  Curses,  the  sat-M  data  indicated  that 
(  oachJd  bdys  not  studying  math  at  the  time  of  coaching  showed 
greater,  jncteases  over  control  students  than  did  coached  boys 
\Lho  were  f  tudying  math,  by  about  4  points  in  one,  school  and  10 
ih  the  othek  This  pattern  of  higher  coaching  effects  for  boys  not\ 
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currently  studying!  math  is  consistent  with  the  Dyer  results.  In 
contrast,  coached  girls  not  studying  math  at  the  time  showed^ 
smaller  increases  pver  control  students  than  did  coached  girls 
who  were  studying  math.  Coached  girls  curTently  studying  math 
exhibited  score  increases  of  about  20  and  30  points  over  the  non- 
coached  girls  currently  studying  math  in  the  two  control  schools, 
whereas  the  coached  girls  not  studying  math  exceeded  their  non- 
coachecfcounterparts  in  the  two  math  control  schools  by  only  1 
and  4  points. 

French  also  investigated  the  effects  of  using  some  identical 
items  in  coaching  and  on  the  posttest.  Shortly  before  the  March 
SAT  administration,  the  students  in  School  C  were  giV6n  a  prav- 
tice  test  containing  50  verbal  and  reading  items  and  34  math 
items,  half  of  which  had  been  included  in  the  previous  praaice 
exercises  of  the  coaching  course.  Students  at  a  fourth  schoo'l'whd 
received  np  special  preparation  served  as  a  control  group.  The  raw 
scores  on  theiamiliar  and  unfamiliar  halves  of  the  test  were  each 
converted  to  the  sat  200-  to  SOO-point  scale,  and  in  an  analysis  of 
covariance  the  score  on  the  coached  items  wa;>  predicted  from  the 
score  on  the  uncoached  items,  A  compari' )0n  of  the  results 
showed  an  increase  of  15  pomts  on  sat-M  and/47  points  on  sat-V 
for  the  coached  over  the  uncoacfii;d:5tudem^  on  the  projected  full- 
length  test  made  up  of  itenis  explicitly  coached.  These  findings 
relate  to  a  test  made  up  of  items  identical  to  those  on  which  stu- 
dents received  coaching,  and  it  is  unlikely  that  this  situation 
would  ever  arise  in  practice.  Nevertheless,  in  1974  June  Stern  in- 
cluded an  identical  subsist  of  items  in  the  April  sat  administration 
and  again  in  the  November  administration  with.no  experimeiital 
coaching  iniervtntion.  She  found  that  the  average  net  gain  in  Ver- 
bal as  well  as  in  the  Math  score  was  approximately  17  points  for 
repeaters  of  identical  items  over  gains  for  repeaters  of  non-identi- 
cal items.  Clearly,  if  just  taking  an  identical  subset  of  items  twice 
yields  a  17-point  increase,  the  effects  of  coaching  on  identical 
items,  if  one  had  access  to  them,  could  be  substantial-. 

In  1958,  Robert  Dear  reported  a  study  to  determine  whether 
longer  periods  of  coaching  in  small  groups— two  class  periods  a 
week  for  6  weeks  and  for  12  weeks— were  likely  to  be  more  effec- 
tive than  the  shorter-term  coaching  studied  by  Dyer  and  by 
French,  In  Dear's  study,  6  public  and  4  private  secondary  schools 
were  chosen  randomly  from  a  list  of  schools  from  which  at  least 
as  students  had  taken  the  sat  as  juniors  in  May  of  1956.  A  treat- 
ment group  from  each  school  was  selected  at  random  from  stu- 
dents who  volunteered  for  coaching.  A  second  group  of  nine 
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schools-from  the  same  geographical  region— the  New  York-New 
Jersey-Greater  Philadelphia  area— was  drawn  at  random  as  the 
group  of  control  i^hools.  All  students  eligible  for  the  study  had 
indicated  an  interest  in  being  coached.  Three  students  were 
selected  from  each  school  from  each  of  three  ability  levels— 90  ^ 
coached  students  and  81  control  students.  Of  these,  71  coached 
and  79  uncoached  students  took  the  sat  in  May  1956  and  in 
March  ]957.  The  coaching  program  began  in  mid-November  and 
continued  through  mid-March  with  weekly  coaching  sessions 
supplemented  by  one  additional  hour  of  homework  each  week. 
Most  students  repeated  the  sat  in  January  1957,  halfway  through 
the  coaching  period,  and  again  in  March  1957.  The  January  re- 
sults showed  about  a  22-point  advantage  for  60  coached  students 
on  Math,  but  a  lii-poirit  disadvantage  on  Verbal.  The  control 
groups  for  this  January  administration  included  all  uncoached 
students  (N«526)  in  both  the  same  schools  and  the  Control 
'  schools  who  mdicated  interest  in  being  coached.  The  March,  ad- 
vantage for  the  coached  students  on  Math  was  about  24  points. 
The  Verbal  score  results,  unfortunately,  were  not  determined  be- 
cause of  a-  significant  difference  in  the  slopes  of  the  regression 
lines  for  the  coached  and  uncoached  grou^^s. 

*      h  '  '  ' 

Studies  with  Matched  Control  Groups 

A  third  methodological  problem  occurs  in  studies  in  which  con- 
trol and  experimental  students,  although  from  the  same  school, 
are  not  assigned  randomly  but  are  matched  on  selected  measures, 
thereby  still  permitting  systematic  differences  between  the 
groups  on  other  nonassessed  variables.  In  1960,  Edward  Frankel 
published  the  first  study  on  the  effects  of  commercial  coaching  on 
SAT  scores.  Frankel  selected  45  high  school  students  who  had 
taken  commercial  coaching  courses  and  matched  them  with  45 
control  students  from  the  same  high  school  in  the  following^ 
ways:  11)  their  pretest  scores  on  the.May  1958  sat  were  within  10 
points  of  each  other  on  both  Verbal  and  Math;  (2)  they  had  taken 
the  same  form  of  the  sat  in  either  December  1958  or  January  1959 
to  serve  as  a  posttest;  and,  (3)  they  were  of  the  same  sex.  Within 
each  pair,  one  had  taken  a  commercial  coacliing  course  involving 
roughly  30hours:of  coaching  in  classes  of  about  25  students  be- 
tween May  1958  and  January  1959.Jn  brief;  Frankel  found  an  8.4 
.  pomt  advantage  for  coached  students  on  Verbal  and  a  9.4  point  ad- 
vantage on  Math.  \ 
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.  In  1962,  Dean  Whitla  compared  the  score  increases  of  52  stu- 
dents who  had  attended  an  intensive  10-hour  course  in  improved 
study  habits,  rea'Hing  skills,  and  math  concepts  at  a  proprietary 
school  in  Boston  with  the  score  increases  of  a  comparable  group 
of  52  students  from  the  same  area  who  had  not  taken  a  coaching 
course.  All  of  the  students  had  taken  the  sat  in  March  or  May  of 
their  Junior  year  and,  in  addition,  were  admin^istered  a  special  sat 
in  the  fall  of  1959  when  the  study  began,-  the  January  1960  sat 
served  as  the  posttest.  The  average  V  and  M  scores  of  the  two 
groups^were  within  one  point  of  each  other  on  the  spring  sat  and 
within  two  points  on  the  fall  pretest,  suggesting  that  the  two 
groups  were  not  only  well-matched  in  terms  of  initial  level  but 
also  in  terms  of  growth  rate  over  this  period.  Whitla  found  an  11- 
point  advantage  for  the  coar  bed  group  on  Verbal  but  a  5-point  dis- 
advantage  on  Math  when^the  posttest  was  cpmpared  with  the  fall 
pretest,  there  was  a  10-point  advantage  on  Verbal  and  a  7-point 
disadvantage.on  Math  when  compared  with  the  spring  sat. 
\ 

Studies  With  Randomized  Control  Croups 

Three  studies  employing  a  randomized  design  have  been  carried 
out.  The  first  one,  by  Roberts  and  Oppenheim  (1966),  utilized  the 
Preliminary  Scholastic  Aptitude  Test  (psat)  as  both  pretest  and 
posttest.  In  contrast  to  earlier  coaching'  studies  that  involved 
highly  selective  and  effective  private  schools  and  specialized  or 
suburban  public  schools,  the  Roberts  and  Oppenheim  study  was 
undertaken,  to  investigate  whether  students  receiving  less  ade- 
quate instruction  might  especially  benefit  from  special  prepara- 
tion. Data  were  collected  from  18  predominately,  if  not  entirely, 
black  secondary  schools  in  rural  and  urban  Tennessee.  In  6 
schools  coaching  consisted  of  special  instruction  in  verbal  mate- 
rial, in  8  schools  coaching  was  for  mathematics,  and  in  4  schools 
.  no  special  instruction  was  provided.  Within  the  treatment 
schools  students  were  assigned  randomly  to  coached  and  un- 
coached  groups.  The  instruction  was  provided  in  15  half-hour  ses- 
sions over  a  4-  to  6rweek  period.  Tfie  results,  showed  small  in- 
creases for  the  coached  groups  over  the  control  groups:  about  1 V2 
(1.44)  points  on  PSAT-Verbal  and  less  than  1  (.81)  point  on 
PSAT-Math,  increases  which  correspond  to  about  14  points  on 
SAT- Verbal  and  8  points  on  sAT-Math.  This  advantage  of  coached 
over  control  groups,  however,  was  due  as  much  to  score  decreases 
on  the  part  of  the  control  students,  possibly  signaling  problems  in 
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motivation  or  attrition;  as  to  ?>C0re  increases  on  the  part  of  the 
coached  students. 

A^cond  randomised  study,  conducted  by  Evans  and  Pike 
(1973^ Pike  &  Evans,  1972);  examined  intensive  coaching  efforts 
in  the  math  area.  A  sample  of  509  students  in  12  schools  partici- 
pated in  the  study.  The  coached  students  received  21  hours  of  in- 
struction and  21  hours  of  homework,  over  a  7-week  period  during 
November  and  December  1970,  directed  at  one  of  the  following 
item  types;  Regular  Math  (im);  Data  Sufficiency  (ds);  or  Quanti- 
tative Comparisons  (qc).  Three  randomly  chosen  groups  of  stu- 
dents were  defined  in  each  schooli  one  to  be  instructed  in  QC,  one 
in  either  rm  or  dS;  and  one  as  a  control  group.  These  ^oups  fook 
the  SAT  first  in  October  1970,  which.served  as  pretest,  and  again 
in  Decembef~r970  (posttest)  and  April  1971  (delayed  posiiest). 
The  pretest  and  posttest  were  special  administrations  of  the  sat, 
whereas  the  delayed  posttest'was  a  regular  administration.  The 
three  experimental  groups  were  given  special  preparation  during 
November  and  December;  and  the  control  group  received  instruc- 
iioxi  after  the  December  posttest.  On  this  schedule,  all  groups 
received  instruction  in^  test-taking  skills— becoming  familiar 
with  test-directions,  pacing,  and  appropriate  strategies  for  using 
partial  information  and  guessing.  All  groups  also  had  instruction 
in  math  content— numerical  facts,  numerical  and  basic  algebraic 
skills,  and  in  particular  mathematical  areas  such  as  inequalities. 
In  addition,  there  was  practice  on  one  of  the  item  types  for  stu- 
dents in-cach  respective  experimental  group.  The  study  revealed 
score  increases  beyond  those  experienced  by  the  control  group  for 
each  of  the  three  experimental  groups  coached  on  a  particular 
item  type.  However,  because  the  Evaiis-Pike  study  was  designed 
to  investigate  the  relative  susceptibility  of  three  iten\ formats  to 
special  instruction,  it  is  difficult  to  say  just  how  large  the  effects 
were  ia  terms  of  sat  scores.  The  authors'  best  estimate  of  score 
increases  reflective  of  coaching  for  all  four  groups  over  "the  total 
period  from  October  to  April  was  about  25  points.  The  average  in- 
crease over  the  control  group^for  the  three  experimental  item- 
type  groups,  weighted  according  to  their  respective  sample  sizes, 
was  16.5  points  over  the  period  from  the  October  pretest  to  the , 
December  posttest.  Pike  (1978)  later  conjectured  that,  still  keep- 
ing within- the  total  21  hours  of  special  preparation,  a  judicious 
combination  of  instruction  for  both  rm  and  ds,  the  two  major 
item-types  then  in  sat-M,  would  be  expected  to  yield  coaching  or 
.  special  preparation  effects  of  about  33  points. 
^  In  the  third  randomized  study.  Alderman  and  Powers  (1979)  in- 
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vestigated  the  enectiveness  of  existing  secondary  school  pro- 
grams that  had  been  initiated  by  the  schools  to  improve^the  per- 
formance of  students  on  the  sat- Verbal  scale.  Students  at  each  of 
eight  schools  for  whom  P^at  scores  were  available  were  randomly 
assigned  to  a  special-preparation  group  or  to  a  control  group.  Ac- 
cess to  the  sameT preparation  course  was  delayed  for  control  stu- 
dents for  the  purpose  of  this  study.  A  special  administration  of  a 
retired  sat  was  used  as  the  posttest.  Across  the  eight  schools  .the 
^  overall  increase  in  sat-V  attributable  to  special  preparation  was 
^^  about  eight  points,  which  is  statistically  significant  at  the  .05 
level.  The  actual  effects  ranged  from  -3  points  at  one  school  to 
+  28  at  another.  Differences  in  effectiveness  between  the  coach- 
ing programs  were  not  statistically  significant  from  school  to 
school;  however,  and  the  best  statistical  estimate  of  the  range 
was  from  4  to  16  points.  Nor,  apparently,  did  the  control  groups 
react  in  comparable  fashion  from  school  to  school,  possibly  re- 
flecting.diffcrences  in  motivation  or  seriousness  in  approaching  a 
special  sat.  The  largest  school  effect  of  28  points,  for  exainple, 
resulted  in  part  "from  a  control-group  decrease  almost  equal  in 
magnitude  to  the  treatment-group  increase  (-11  score  points  in 
going  from  the  converted  psat  to  the  sat  for  the  control  group  ver- 
sus +  13  score  points  for  the  treatment  group,  which  yields  a  28- 
point  school  effect  after  co^'ariance  adjustments  are  made).  An 
attenuated  form  of  this  pattcrix  occurred  at  two  other  schools, 
whereas  the  remaining  five  schools  showed  varying  degrees  of 
score  increase  for  both  treatment  and  control  groups.  Overall, 
only  one-tenth  of  one  percent  of  the  total  variance  in  sat-V  scores 
was  accounted  for  by  special  preparation  jilOne,  while  school'at- 
tended  taken  alone  accounted  for  24  percent  of  the  Verbal  score 
variance.  Furthermore,  scores  on  the  psat-V  and  the  Test  of  Stan- 
dard Written  English  accounted  for  54  and  39  percent  of\SAT-Ver- 
*bal  score  variance,  respectively.  The  authors  concluded  that  the 
school  attended  and  scores  on  earlier  tests  of  verbal  and  writing 
ability  contribute  much  more  to  determining  sat-V 'scores  than 
did  special  preparation  as  typically  offercd^by  secondary  schools. 

Anpther,  more  subtle  methodological  problem  has  emerged  in 
the  process  of  reviewing  these  coaching-studies  haviiig  random- 
ized control  groups,  namely  the  problern  of  engendering  and 
maintaining  realistic  motivation  for  taking  the  posttest  SAT,.espe- 
cially  for  uncoached  controLstudents.  Developing  realistic  moti- 
vation and  effort  for  taking  pre-  and  posttests  is  a  common  re- 
quirement of  all  coaching  studies,  However,  the  three  experi- 
ments that  employed  randomized  control  groups  happened  also 
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to  use  as  the  positest  a  special  administration..of  the  sat  or  psat 
lather  than  a  regular  administration.  These  special  administra- 
tions tna^  have  been  viewed  to  some  degree  as  practice  tests  that 
did  not  count  for  the  record,  thereby  eliciting  less  motivation  and 
effort  than  would  a  regular  sat  administration.  Warning  signals 
suggesting  this  pos3ibility  were  noted  in  the  Alderman  and 
Powers  (1979)  study,  in  which  control  groups  in  three  schools 
were  found  to  exhibit  score  decreases  in  going  from  legular  psat 
to  a  special  sat,  even  though^the  expectatipn  is  for  a  score  in- 
crease from  an  October  psat  to  a  Spring  sat  of  upwards  of  10  or  12 
points,  which  is  the  basal  estimate  provided  by  national  adminis- 
tration samples.  Sixch  control-group  score  decreases  may  substan- 
tially complicate  the  interpretation  of  the  results.  One  way  of 
viewing  the  Alderman  and.  Powers  analysis,  for  example,  is  that 
their  appraisal  of  the  import  of  within-school  intercept  differ-, 
ences  tacitly  implies  that  within  each  of  the  eight  schools  the 
effect  on  student  performance  of  taking  a  special  rather  than  a 
regular  sat  operates  consistently  for  both  uncoached  and  coached 
students  on  the  average.  Differences  in  performance  between 
these  groups  at  a  given  school  may  then  be  used  to  estimate 
xoaching  effects  on  the  implicit  assumption  that  any  re.duced  mo- 
tivation and  effort  on  the  special  sat  posttest  would  have  lowered 
mean  performance  levels  of  both  groups  to  about  the  same  degree. 
Such  assumptions  are  not  as  apparent  when  the  analysis  is 
viewed,  in  terms  of  sampling  fluctuations  across  eight  indepen- 
dent samples:  The  control-group  score  changes  fromopretest  to 
posttest  ranged  from  -11  to  +30  with  a  mean  of  8,  and  the  treat- 
ment-group score  changes  ranged  from  3  to  44  with  a  mean  of  17; 
the  9  point,  overall  advantage  for  the  coached  over  the  control 
students,  when  adjustments  for  covariaj  are  made,  corresponds 
to  the  8  point  coaching  effect  reported  iri\.*e  study. 

Cantrol-group  scores  also  decreased  in  the  Roberts  and  Oppen- 
heim.(1966)  study,  which  similarly  employed  a  special  adminis- 
tration posttest,  in  that  case  a  special  psat.  Unlike  Alderman  and 
Powers,  who  used  a  regular  adjninistration  of  the  psat  a5  a  pro- 
test, the  Roberts  and  Oppenheim.pietest  psat  was  a  special  ad- 
ministration as  welL  None  of  the  rionrandomized  coaching  stud- 
ies reviewed  earlier  displayed  control-group  score  decreases,  and 
mt  posttest  in  all  of  those  studies  was  a  regular  administration  of 
the\^T-although  Dyer  (1953),  French  (1955),  and  Whitla  (1962) 
did  use.  special  pretest  administrations  and  thereby  introduced 
the  possibility  of  other  biases.  The  remaining  randomized  study, 
conducted  by  Evans  and  Pike  (1973),  employed  special  adminis- 
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test  was  a  regular  sat  administration.  Pike's  (1978)  subsequent 
interpretation  of  score^increases  from  posttcst  to  delayed  posttest 
as  reflecting  the  long-term  consolidation  or  continuance.otgains 
due  to  coaching  becomes  jeopardized  from  this  vantage  point  by 
the  plausible  rival  interpretation  that  those  score  gains  instead 
reflect  increases  in  motivation  and  effort  in  going  from  a  special 
administration  to  a  regular  one. 

Comparison  of  Results  Across  studies  of  Coaching^ 

For  numerous ^Xpasons,  including  the  diversity  of  design  limita- 
tions and  the  differences  in  sample  sizes,  it  is  difficult  to  compare 
rc^iUlts  actQS3  these  iseveral  studies  in  a  meaningful  way  (cf,  Pike, 
1978)'  Tablc'^-1  represents  one  suck  attempt  for  those  studies 
^   having  some  iy]pe  of  control  group.  The  size  of  coaching  effects 
reported  there  Were  calculated  uniformly  as  follows:  When  analy- 
sis of  covariancc  was  performed,  the  reported  values  are  intercept 
differences  between  the  cxjjcrimental  and  control  ref^ession 
lines,  weightga  in  the  case  of  multiple  experimental  orrxontrol 
j     groups  by  their  respective  sample  sizes.  In  four  studies  noureport- 
ing  analyses  of  co variance,  the  values  in  Table  If-l  are  average 
I     score  increases  of  experimental  over  control  groups,  again 
)    weighted  in  the  case  of  multiple  experimental  or  control  groups 
'  ..^^y  their  respective  sample  sizes.  Two  of  these  latter  studies  (by 
Frankel  and.by  Whitlajlinvolved  statistical  matching,  and  two  (by 
Roberts  and  Oppenheim  and  by  Evans  and  Pike)  involved  ran- 
domizatipn.  Averaging  these  results  over  all  of  the  studies  in 
.  Table  IM,  weighting  in  each  case  by  the  size  of  the  experimental 
sample,  yields  9.1  points  for  Verbal  and  13.0  points  for  Math,«(the 
unweighted  averages  arc  8.5  points  for  Verbal  and  12.3  points  for 
Math). 

For  those  studies  having  no  control  groups,  a  summary  is  pro- 
vided in  Table  II-2.  The  special  preparation  programs  summarized 
there  focus  on  verbal  or  mathematical  cdnteAt  knowledge  and 
skill  development  and  entail  the  largest  amounts  of  student  con- 
tact time  of  any  of  the  studies  reviewed,  which  would  ordinarily 
lead  one  to  characterize  them  as  instruction  rather  than  coachings. 
These  programs  range  frorp  45  hours.of  student  contact  time  over 
6  weeks  to  48  hours  over  8  weeks  to  roughly  100  hours  over  6 
months  to. virtually  full-time  over  6  months  or  approximately  600 
hours.  In  contrast,  the  most  intensive  of  the  control-group  stud- 
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Tabfeii-1 

Average  Difference  Between  Experimental  and  Control  Groups  in  Studies  of  sAT  Interventions  {Adapted  from  I>onlon) 


SampU  ChatacumtKS 

Oiffeientt 

Stfnificance 
Level' 

Exp  /Contwl 

%M-Math 
Oiffetence ' 

SiimUcance 
Uvei* 

N 

Exp  yContn 

Schwl 

Uvel 

Sex 

Chatoctenst ici  o;  the  Special  Ptepa ration 

t>yci  ilVlM 

CoRtiol,  UUfcicni  $ch(v)I 

Privau 

H  S  Seniors 

M 

Twelvc>10*60  minuie  scs^ion^  Uu  vcrbj], 
five  60'9(1  minute  sessions  for  maih 

05 

225/193 

12  9 

0) 

225/193 

French  tl"*'*^! 
Conuol,  dtlfcicnt  school 

PuHic 

H  S.  Seniors 

Ten  verbal  and  len  maih  cojchin^ 
•sessions  usinx     Item  materials 

18.) 

01 

161M$8 

6  2 

01 

'  161/15S 

ControtdiUcrcni  ich<x)l 

Public 

H  S  Seniors 

M^^F 

Total  verbal  coach in>:  4  v:^  hours;  maih 
coaehinx  was  ten  sessions  usin^  its  item 
materials 

5  0 

OS 

110/158 

18  0 

01 

161/110 

I'ubhc, 
N  Private 

H  S  Seniors 

M^F 

Approximately  6  weekly  2*hour,  2>person 
coJehinK  sessions,  plus  1  hourofhome< 
work  each  week 

-2  5 

60/526 

21  5 

01 

60/526 

IXar  119^81 
Control,  ^amc  and 
Jilkrint  schools 

Public 
Private 

fl  S  Seniors 

M^^F 

App/oximately  12  weekly  2-hour,  2'perM)n 
coachinx sessions  plus  1  hour  of  homework 
each  Week 

- 

.01 

71/116 

Frjnkcl  t\m)) 
Conlrot  wmc  ^ctuNtl  * 
stJtiUiCjHy  mJtchcd 

Public 

H  S  Seniors 

M  +  F 

Ten  3'hc»ur,  2vpers<in  sessions  of 
coaching 

84  • 

NS 

45/45 

94 

NS 

45/45 

Whub{lV/;2i 
Control,  MJlistically 
matched 

Public 
Pnvjtc 

H  S  $enior5( 

M^'F 

Commircul  proprietary  \ch(HiK  Five 
Z'hour  sessions  plus  intensive  homework 
Verbal  and  math 

11  0 

NS. 

52/52 

NS. 

50/50 

R4»hcrt5  Qppcnhcim 

?1V6A\ 

Rjnvl»>n>i?*d 

Public 

H  S  Juniors 

M  +  F 

7*A  hoursof  programmed  instruction  in 
test'takin}(  and  in  verbal  and  math  *n. 
content 

14  4* 

05 

154/111 

«  1* 

NS 

188/122 

M  $  Juniors 

M*F 

Tcst-takinx!>kilts^  mathcontt.nt  Seven 
AVh(Hirsvssi(>ns  2]  additional  hiturs  of 
h<>mework 

No  coaching  for  sat-V 

- 

165 

288/129 

Alder  nun  A,  l'tiwer% 
Randomized 

l^ubtu 
Private 

M  S  luniors 

M*F 

Varied stratcx'cs, at  ei^ht  schiHtts, 
centering  on  rejjinxand  anal(>>;icSi  time 
ranKc5<45  hours 

8  4 

OS 

No  coachinx  for  saT'M 

Avt,rjgc  weighted  by  Mrc  ot  experimental  sarn pic 

9  J 

13  0 

Ihs  4«'aihin;ioUv(v  ju  touucpi  JtrkKn^(.!>h<.tw(.cnr(.y:r(.vsiun  iintstur  cxpsrtmenulandumttol)(ruup>4tr  ^toi  frankti,  Whttla^  Riitx.rt>&Upp<.nhcim.dnd  PiU  6i.  Lvansiavtrax^'  Horc  tntrcaset 
of  txpsrinHnta}iH(.r4.(»ntrul  groups,  both  weighted  tn  the  case  of  multiple  experimental  o/ control  groups  by  thiir  respvt^tivt.  sample  sizes.  / 
'As  shown     eoachin^  etficrs  reported  in  oriKina!  text. 

'Not  cakulaied  variances  and  iexress;on  slopes  differed  significant  1)^  for  experimental  and  control  groups 

*This  study  impioyid  the  rsAT  as  both  pre  and  posttcst.  the  averages  shown  have  been  converted  to  the  sat  seore  seale  ranxmx  Irom  20p   ^00  points 

Odd 
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ICS  summarized  m  Table  IM  were  30  hours  (plus  homework)  over 
10  sessions  (Frankel;  I960);  24  hours  (plus  12  hours  homework) 
over  12  weeks  (Dear,  1958),  and  21  hours  (plus  21  hours  home- 
'  work)  over  7  weeks  (Evans  &  Pike,  1973). 

In  the  absence  of  control  groups,  instructional  or  program  ef- 
fects were  estimated  in  Table  11-2  in  the  manner  described  earlier 
—that  is,  by  adjusting  the  average  score  gains  reported  in  each 
study  by  the. average  of  four  adjustments,  those  suggested  by  (1) 
the  authors  of  tW  original  articles,  (2)  Slack  and  Porter  (1980), 
and  (3)  Pike  (1978),  as  well  as  (4)  the  average  score  gains  of  con- 
trol students  in  other  coaching  studies,  who  had  roughly  compar- 
able .initial  score  levels.  Averaging  these  estimates  over  all  the 
studies  in  Table  II-2,  weighting  in  each  case  according  to  group 
size,  yields  38  points. for  saV-V  and  54- points  for  sat-M  (the  un-  . 
weighted  averages  are  39  points  for  Verbal  and  53  points  for 
Math).  Given  the  dubious  and  provisional  nature  of  the  adjust- 
ments and  the  highly  self-selected  character  of  the  students  in 
each  program,  these  values  are  still  probably  overestimates  of 
program  effects.  But  their  general  magnitude  suggests  that  the 
verbal  and  mathematical  reasgning  skills  measured  by  the  sat 
r  may  be  enhanced  to  a  measurable  degree  by  long-term  and  inten- 
sive instruction,  at  leastfor  highly  motivatedstud^nts^  ' 

Granted  that  there  is  some  overlap  or  blurring  of  the  distinction 
between  coaching  studies  in,Table  II- 1  and  instructional  studies 
in  Tabic  II-2,  the  two  types  seemed  sufficiently  different  to  War- 
rant separate  treatment.  Accordingly,  overall  averages  were  not 
computed  for  the  total  combined  5et  of  studies  because  possible 
differences  in  impact  might  thereby  be  obscured.  In  contrast. 
Slack  and  Porter  (1980)  have  chosen  to  combine  both  types  of 
studies  in  a  single  table  and  to  report  overall  weighted  average 
r  score  increases  of  coached  groups  over  uncoached  control  groups 
(or  norm  comparison  groups);  these  weighted  averages  were  29 
points  for  sat-V  and  33  points  for  Sat-M.  However,  their  table  in- 
cluded French's  (1955)  study  of  identical  items,'  which  hardly 
seems  appropriate,  and  a  study  by. Lass  (1958)  which  we  viewed  a5^ 
too  informal  to  treat  quantitatively,  and  it  did  not  include  the 
studies  by  Alderman  and  Powers  (1979}  or  by  Evans  arid  Pike 
(1973).  If  the  French  identical-items  study  is  deleted  from  their 
table  and  the  two  missing  studies  ate  added  and  some  corrections 
are  made  in  the  effective  sample  sizes  of  the  studies  by  Dyer 
(1955)  and  Pallonc  (I9c\),  the  revised  weight/d  averages  are  25 
points  for  Ver^afand  33'poiijts^for  Math.  Further,  if  the  score  in- 
creases t/^ken  from  the  studies  by  Pallone  (1961)  and  Marron 
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Adjusted  Average  Score  Gtins^in  Studies  of^AT-lnstruction*!  In(,er^entions  Haji^ing  No  Control  Groups 


Sample  Charpctenstks 


Study 

School 

•  level 

Sfx 

Pjllonc(I96H 

Civile 

H.S.  Seniors 

M 

r»IIonc{196f| 

Priviic 

H^.  Seniors 
&Gr«(Ju«ic» 

M 

M«rronll96S| 

-  1 

* 

Privjic 

H  S,  Seniors  M 
^Cradusics^^-  

Corfm<nAP«rryn967j» 

Public 

Collcxc 
^rcfhmen 

X^hanKteristics  of  the  Special  P/eparation 


SKT'Verhat 
Adiusted  Average 
Scor^lnsctease* 


SKT-Math  \ 
Adfusted  AvcMfie  ^ 
5cor<  Increase*'- 


9(^mmuieJ«iTy  insiruciion  «nJpricticc 
in  develop mcnul  retdinjt  skills  over 
6  weeks 

5<hminuied«|ly  msiruciibnanJ  praciicc 
in  Jcvelopmenml  rc<JinK>kills.  wiih 
jilrcss  on  {(t^ical  inference inJ  4nalokic' 
anilysis  over  ^p)onihs 

Ful|<iimcil«ily$essions4imcdat  verhal  , 
-3i)dm«thconlenl  and  (csi'taVinj;  skills 
over6ni(^lhs  , 

6*hours  weekly  insiruciiop  in  aeccl<^ra(ed 
reading  over  S  weeks 


68 


Croup )  54 

Croup,  2  .13 

Cro6p*3  24 

|Croup4  h 

4» 


35 


20  + 


80- 


83 
5 

,19 


Croup  r  59 
Croup  2'  53 
Croup3!  46 


2M 
405 
78 


Wciitl^rcd  Averajtc 


38 
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•To  esilmait  insi ruciional  or  pr(^ram  efTcci*^  averan*  Jcomncreases  in  the  Pallone  il961|  and  Manon  il96S|  studies  were  adiusied  by  ihe  avcrajte  of  four  adjust, 
meni?  ihosc  suMcntd  by  (1!  ihe  auib*K5of  che  orixinal  art  ielcs- Pal  lone  »u)«i-$ted35  points  on  UpV  as  normal  cxpeeiation  of  nains  durin/;  ihc  final  year  of  sec. 
undaiy  school  { 15  points  for  rh^  5-month  ince^val  between  tests  in  the  shori-ierm  prt»Kram|.  and  Marron  su^esied  24  and  26  poj nis.  rcspeci  i  vely,  for  s/st-V  and  .M' 
aj  typical  M>ns  for  h«h  school  seniors  over  ft  monihs^i2|  Slaek  and  Porter  |l9ftO)-averaxe  xains  In  niuorial  admTnlJira lions  of  lunior- la  senirtr.ycar  rctescefS 
havtn^  the  same  initial  average  score  levels  as  Pallone's  and  Marron's  jtroups;  and  |3I  Pike  |l978|-averaKC  ^^ains  of  conirol  Sludenis  in  superior  schtwts  from 
olher  studies  of  propriccary  program*,  as  well  as.  (4|  *Vffaj(CX<>nv>f«^oncroi  students  in  oiher  studies  wholiave  avcraj?einili«l  score  levels  roughly  comparable  to 
,  Pallone's  and  Marron  "sxroups  »  ,  ^  ,  '   

*The  H;wcek  pro/{ram  in  Coffman  and  Par^ry  il967|  was  not  included  because  che  29-poini  mean  decrease  in.seorc*  was  considered  atypical  and  possibly  indiCa* 
tive  of  motivaiional  and  test  adminisiraitbr^  prrblcms.  ^  j 

The  two  8-week  proffams  in  Coffman  aj(d  Parry  (I967|  were  combined,  bui  admscmcnts  were  made  only  by  ihc  Slack  and  Poricr  tl980)  procedure,  which  ai^cnu* 
ated  by  only  a  few  points  an  already  tcjiuous^  effect  None  of  ihc  sujucstCd-compAison  xr«up>  of  Sat  lakers  appeared  to  provide  even  remotely  rcas<mahlciard- 
sticks  lor  xauxlnxscorcx«insofsiudcnl<  already  enrolled  in  a  collcKcnoi  requiring  the  SAT,  ;  -     '  '  / 
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lt965)  are  aditisted  by  the  average  of  f6ur  suggested  control  con- 
-trasts-ras  was  done  in  this  report's  Table  II-2,*ih?  adjusted 
weighted  averages  of  SlacKand  Portet  become  22  poinii  for  Verbal 
and  28  points  for  Math.  •  * 

ThuS;  the  overall  effeet  of  averaging  together  the  two  types  of 
studies— those  with  control  groups  and  those  withom— is  toiaise^ 
the  estimates  of  average  coaching  effects  based  onxontrol-group 
studies  alone  (Table  If-l)  bji^'about  13  points  on  Verbal  and  15 
points  on  Math.  This  assumes  that^  the  adjustments  applied  to  the 
score  gains  in  studies  laci^Jjg-control  groups  were  large  enough  to 
^corrccr  appropriate! /  for;  the  experiential  growth  of  self-selected 
students  that  woulil  nave  occurred  regardless  of  the  program. 
This  combined  averaging. of  Slack  and  Pprter  |1980)  is  misleading! 
not  only  becaus.e  the  adjusfments, are  questionable,  but  because^ 
the  cpmbined  averages  obscure  imp^prtant  differences  bet\yeen 
the  spcdArpreparat ion  programs,  in  the  two'types -of  studies.  As 
indicatejl  earlier,  a  compansoh  of  the  brief  program  descriptions 
in  Tables  II-l  and  II-2  r^eveals  that  the  programs  in  studies  lacking 
control  group^.happened  also  to  be  jquite  long-term  and  intensive 
with  respect  to  student  contact  tin^e,  while  the  programs  in  con-  * 
trol-group  studies  were  relativelj^  and  nonintensive.  . 

The  former  programs  also  entailed* organized  curricujum  cpntent" 
and  skill  development  as  well  as4cst  review,  whereas  the  laucr  . 
programs  tended  to  emphasize  tes^t  review  and  practice  exercises.  ^ 
Rather  .than  averaging  across  t^ese  studies,  which  ^^evitaWyx 
precipitates  arguments  about  t1iJ^„appropi:iat.e  sjze  of  the  sc6i^ 
effects  to  be  included  from  unccjntrolk-.  studies,  let  us  instead 
rank  the  studies  in  order  of  theireported^treatment  vs.  control 
gwup  contrasts  and  when  cpntrol  groups  , are  not. available  in 
order     the  rep&rted  s^^ore  increases.  That  is,  for  sat-V  Pallone's 
(r96iriong-term  and  summer  prc^rams. would  be  ranked  1  and  2, 
respectiwiyrfollowed  by  MarronJ's  {1965J  four  groups,  etc.  This 
j^rocedure  grants  that  the  scoi:e  effects  iii  the  sfudies  lacking  con- 

'  sense  than  those'in  the  control- 
tioh  with  rf  spect  it  now  miffch 


trol  groups  are  larger  in  an  ordinal 
group  studies/felt  irtakes  no  p'os 


larger.  If  the  programs  are  then  also  ranked  in  terms  pfr.the  num- 


ber of  student  contactliours  invo 


correlation  coefficient  computed  (Table  II-3),  the  rank  correlation 
is  found  la  be  .60  across  22  studies  for  sat^-V  and  .80  across  11 


ved  and 'a  Spearn^an  rank-order  • 


studies  for  sat-M 
(Dixon  &,Masse7, 


Bo,th  coefficien 
19511.  If  five 


:s  are  significant  at  tjie  .01  level 
particularly  suspect  studies  are 


deleted  from  the  calculations'  for-«|AT-V,  th(vfiew  correlation  is  .73 
across  1 7  studies,  which  is  also  sij  ;nifican1i  at.the  .01  jevel:  In  this 


— 26-^ 
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TaBl^j|-3 

CorrclationsBet  ween  RankrOrdcr  of  ScorcEffcct 
and  Rank  Ofdcr  of  Student  Contact  Time  for  Studies  of  sat  Interventions 
With  and  Without  Control  Groups 


Verbal* 


Math' 


-StpJy 


StUiUnt 
Contact 
Time 


Pank 
Time 


Rank 
Score 
Effect 


Study 


Student 
Contact 
Time 


PfCn<:hU955]iV^M 
Fftfnch  Vocah 

School  C 
^  Sch(X))>E  . 
School  F 

<k:h<wni 
PjIloncilVftlJ 
Shon  . 

Croup  1 

Cf  oup I  , 
Oiuup  \ 
Gfoiip4 


10  huuis* 

4  Should 
'6  hoprs 
IS  h()ur» 

5  houf%  . 


11 
12 
17 
US 
8 


n 

7 

12 
16 
1! 
10 


Oycf  |ly>M 
Ficncb(IVSS|» 
IX:«|1958JLon){ 
I>:Ji(1958)Sh(>jr 
Fiankcl  11960! 
Wh/ilai  19621 
Evans  ikL*jkcll97'M 


(MarrontrMS) 
Cioup  r 
Gfoup2^ 
Croup  3' 


3(K) 
3(K) 


ho^  . 
houis 
houfs 


{(ank<'>rtlcr  Cof  relation 


'^^17  studicM 


Kank-Oitlcr  CoriLlation 


74|10%tud>csf 


/Robcfts^ 
Orpchhrtm  0966P. 
AMcrman 
^  l»owm0979t 
School  A'     ♦  ' 
School 
SchtHim 


^Hhor.rs 


Kohcio  & 
Oppcnhcim  119661* 


3  8houfs 


7 

m 

10 


h4)ur« 
hours 
hours 


l'4irirn967l* 


'48  hours 


iUnk  Oril^r  CoTrcfaTion 


6(M22«udicsi 


kanlk'OTcfcr  Coir«.lauon 


80111  studicsl 


"V 


(When  only  a  loial  srudcni  coniacr  time  was  ava>iabk«  it  was  assumed  that  hall  the  timt.  was  dc  vtMCHl  to  Vcr 
%ar.ahiH/toMith  *  '  '  ' 

'Each  of  12^x'crc»sc>  was  estimated  to  require  a  50- m  mote  class  pcruj 
'iEjchof  J0cxcuMsc5  was  cstimatcU  to  require  a  SO* mmuic  class  pcrifl 

♦S^hoolvA,     Xml  I)  were  ^uspcu  because  of  eontrol  ^roup  store  dceuTsis  and  fienee  wcu  oniiiied  in  the>e 
caUuIatumihiKd  on  ^  7  si  odif$^  they  arc  included  hi  low  in  calculations  based  o/iall  22  studies 
*Robcrts^5<  Oppcnhcim  09664  was  suspctt  because  ol  contn^|-xroup  decreases  and  hence  waj  omitted  from 
/  the  cal^btions  foi  Verbal  hiicd  on  17  studies  and  for  Math  bised  on  10  studies 

♦Coffmin  &  Parry  il967i  wai  saspeci  because  of  t^atment  xroup  score  decre*se.s  jHB  mhcf  indications  of 
moiiv^tmnil  problem*  and  Ivcnce  waxi»nmicd  Irortythi^lculaiions  baseiJ  tm  17  studies  The  2S  week  jvo 
Xram/was  dropped  altirKelherV-cay^TiTJKvrcnr^  decreases,  and  the  two  8  week  prtixrams 

were  combined,  yielding  a  wc)};ht/d  aver  ajic  score  effect  of  6,5 
— 'JEicfroHn  JoublC'lenxth  '  cxerci|c»  was  estimated  toreqtnro  |Wo  ^l^mfnuic  class  periods 
•Fr«^5h'*il9SS|  Math  ctMchin^t  xv>up  was  contrast c-d  witK  two  control  groups,  one  in  a  sthiml  havinK  no 
co^hinx  and  one  in  ajschiM)!  h a vir\  vocabulary  coaching,  these  iwo^omp^risons  were  eombin«»d,  yieldmK  a 
w^ixhtnUvciaxc  Kore  effect  of  n  ^  •      ^  '  ' 


as  3 


27L 
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latter  calculation,  Schools  A,  B,  and  D  from  Alderman  and  Pow- 
ders (1979)  were  eliminated  because  of  control-group  score  de- 
creases, as  was  the  Roberta  and  Oppenheiqi  (1966)  study  for  the 
same  reason,  and  the  Coffman  and  Parry  (1967)  study  was 
dropped  because  of  treatment-group  score  decreases  and  other  in- 
dications of  the  low  relevance  to  the  SAt  of  both  the  accelerated 
reading  program  studied  and  the  samples  of  enrolled  college  stu- 
dents employed.  If  one  suspect  study,  namely  Roberts  and  Oppen- 
heim  (1966),  is  deleted  from  the  calculations  for  sat-M,  the  new 
correlation  is  .74,  which  is  also  significant  at  the  .01  IcveL  These 
rank-order  correlations  are  summarized  in  Table  II-3  It  should  be 
noted  that  although  the  various  coaching  programs  required  dif- 
ferent and  unknown  amounts  of  homework,  this  rank-correlation 
procedure  tacitly  assumes  that  the  amount  of  homework  in  each 
case  was  roughly  proportional  to  the  number  of  student  contact 
hours,  so  that  the  overall  orderings  would  not  be  markedly 
changed  if  homework  were  taken  into  account. 

In  interpreting  these  sizable  monotonic  relationships  between 
st^udcnt  contact  time  and  score  effects,  it  must  be  remembered 
that  these  are  rank-order  correlations  between  average  values  of 
different  samples  or  groups,  and  correlations  between  averages 
are  typically  rpuch  higher  than  correlations  between  individual 
differences  within  groups.  Furthermore,  these  rank  correlations 
are  dominated  by  the  relative  consistencies  between  the  two 
types  of  studies  with  respect  to  the  ranking  variables— that  is,  the 
control-group  studies  are  all  relatively  low  in  both  student  con- 
tact time  and  score  effects  while  the  uncontrolled  studies  are  all 
relatively  high  in  both  student  contact  time  and  score  effects  It 
must  also  be  remembered  that  the  relatively  high-contact  pro- 
grams entailed  structured  curricula  emphasizing  content  knowl 
edge  and  skill  development  while  the  relatively  low-contact  pro- 
grams emphasized  test  review  and  practice.  With  this  confound- 
ing of  program  characteristics  in  .mind,  it  appear?  .that  increases 
in  student  contact  time  (possibly  serving  as  a  proxy  for  increasing 
curriculum  emphases  on  content  knowledge  and  skill  develop- 
mem)  are  systematically  associated  on  the  average  with  increases 
in  SAi;  scores.  However,  even  though  the  time  dimension  i§  cov- 
ered i^^only  a  fragmentary  fashion  by  the  available  studies,  when 
the  magnitude  of  (adjusted)  score  effect  is  plotted  against  student 
contact  Ume,  the  relationship  appears  not  to  be  linear  but  approx- 
imately i9ganthmic.  There  is  somewhat  more  variance  or  noise 
around  the^line  of  best  fit  relating  score  effect  to  log  contact  time 
for  SAT-V  than  sat-M,  but  only  the  Pallone  (1961)  results  appear  to' 
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be  particularly  out  of  line  in  this  logarithmic  formulation.  Con- 
siderably more  research  is  needed,  of  course,  with  special  j)rep- 
aration  program^>  entailing  more  than  40  hours  of  student  con- 
tact  time  to  fill  in  the  gaps  on  the  time  line.  But,  if  this  suggested 
logarithmic  relationship  has  substance,  then  each  additional 
increase  in  sat  scores  may  require  geometrically  increasing 
amounts  of  student  contact  time  and  pf  all  the  curricular  effort 
that  contact  time  may  be  proxy  for.  " 

In  summary,  the  average  coaching  effect  across  studies  having 
some  type  of  control  group  was  less  than  10  points  for  sat- Verbal 
and  less  than  15  points  for  SAT-Math.  The  special  preparation  pro- 
grams in  these  control-group  studies  tended  to  be  relatively  short- 
term  and  relatively  nonintensive  in  terms  of  student  contact 
time,  three  of  the  longest  and.  most  intensive  being  30  hours  of 
student  contact  over  ten  sessions,  24  hours  of  student  contact 
over  12  weeks,  and  21  hours  over  seven  weeks^.  For  particular 
groups  of  students  and  particular  coacHing  programs,  the  score  in- 
creases ranged  as  high  as  about  18  points  for  Verbal  and  about  24 
points  for  Math  lorcven  somewhat  higher  if  interactions  between 
years  of  math  taken  and  sex  are  considered).  The  larger  score  in- 
creases tended  to  be  associated  with  the  longer  and  more  inten- 
sive  of  these  relatively  short-term  programs,  especially  in  Math. 
The  average  program  effect  across  studies  having  no  control 
groups  could  only  be  tentatively  estimated;  because  there  is  no 
good  way  of  taking  into  account  the  experiential  growth  of  self- 
selected  students  in  the  absence  of  comparable  control  groups. 
The  amount  of  their  experiential  growth  and  skill  development 
could  be  considerable  in  this  case,  because  all  of  the  programs  in 
the  studies  lacking  control  groups  happened  also  to  be  relatively 
long-term.  In  addition,  they  were  relatively  intensive  in  terms  of 
student  contact  time.  The  briefest  of  these  programs  was  45 
hours  of  student  contact  over  six  weeks,  and  the  longest  was  vir- 
tually full-time  over  six  months.  The  provisional  estimate  pf 
average  program  effects  for  these  noncontrolled  studies  was  38 
points  for  Verbal  and  54  points  for  Math.  Although  the  substan- 
tive content  of  the  coaching  programs  was  not  systematically 
evaluated  in  any  of  these  studies,  overall  the  smaller  coaching 
effects  appear  to  be  associated  with  short-term,  relatively  nonin- 
tensive practice  and  review,  and  the  larger  effects  .(which  occur 
more  for  Math  than  for  Verbal)  appear  to  be  associated  with 
longer-term,  high  student-contact  programs  focussing  on  skill 
development. 
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III 

Beyond  the  FTC  Study: 
Critique  of  Assumptions  and  inferences 


This  section  draws  together  the  major  points  made  in  several 
reviews Aydertaken  at  Educational  Testing  Service  (ets)  ,of  the  ^ 
FedcralTf?ade  Commission's  (ftc)  study  of  the  effectiveness  of 
commercial  coaching  schools  in  raising  scores  on  the  College 
Board  Scholastic  Aptitude  Test  (sat).  The  separate  reviews  over- 
lap somewhat  in  their  criticisms,  but  they  are  reproduced  in  full 
in  the  Appendix  since  some^additional  points  not  covered  in  this 
summary  are  raised.  The  comments  that  follow  are  limited  to  the 
revised  statistical  analyses  issued  by  the  pxc  Bureau  of  Consumer 
Protection  (bcp)  in  March  of  1979,  undertaken  in  response  to  the 
several  major  data>analysis  flaws  observed  in  the  memorandum 
issued  previously  by  the  rrc  Boston  Regional  Office  (1978). 

Before  proceeding  to  develop  the  critical  arguments,  we  will 
first  briefly  describe  the  object  of  this  critique,  namely  the  ftc 
study  of  the  effects  of  commercial  coaching  on  the  sat.  Students 
enrolled  in  two  New  York  City  area  commercial  coaching  schools 
during  the  testing  years  1974-75,  l'975-76,  and  1976-77  served  as 
the  experimental  or  treatment  group,  and  a  random  sample  of  un- 
coached  persons  who  took  the  sat  during  the  same  three-year 
period  in  the  same  greater  New  York  metropolitan  area  served  as 
a  control  group.  Data  from  a  third  coaching  school  were  not  ana- 
lyzed bccausc-t)f  Its  small  sample  size.  Six  subgroups  were  ana- 
lyzed. (L)  high  school  juniors  taking  the  sat  for  the  first  time  in 
April  1975  (76  coached  and  607  uncoached  students),  (2)  juniors 
taking  the  sat  for  the  first  time  in  April  1976  (247  coached,  617 
uncoached),  |3)  seniors  taking  the  sat  for  the  second  time  in  No- 
vember 1975  (98  coached,  396  uncoached),  (4)  seniors  taking  the 
SAT  for  the  second  time  in  November  1976  (177  coached,  387  un- 
coached), (5)  all  high  school  students  taking  the  sat  for  the  first 
time  on  any  test  date  during,  the  three-year  period  (417  coached, 
1763  nnco'ached),  and,  (6)  all  high  school  st^uJents  taking  the  sat 
for  the  second  time  during  this  period  (316  coached,  1267  un- 
coached). Statistical  analyses  were  actually  based  on  smaller 
samples  than  these  largely  because  of  missing  student  descriptive 
data.  " 
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Since  the  coached  and  uncoached  groups  might  differ  from  each 
other  m  a  number  of  ways  possibly  relevant  to  the  treatment,  the 
demographic  and  personal  characteristics  of  the  two  groups  were 
contrasted.  It  was  found  that  the  coached  group  was  significantly 
higher  than  the  uncoached  group  in  high  school  class  rank,  paren- 
tal income,  most  recent  English  grades,  most  recent  math  grades,  ^ 
'  and  number  of  years  of  math  taken,  in  addition,  the  coached 
group  included  significantly  more  nonpublic  school  students  and 
fewer  public  school  students  than  the  uncoached  group  Before  . 
multiple  regression  analyses  controlling  for  these  and  other  back- 
ground variables  were  conducted,  the  possibility  of  differential 
coaching  impact  on  good  and  poor  students  was  first  discounted 
by  noting  a  lack  of  interaction  between  psat  scores  and  coaching 
treatment. 

The  multiple  regression  analyses,  which  controlled  for  psat  (or 
.  first  sat)  as  well  as  for  the  several  relevant  background  variables, 
yielded  neglible  effects  for  students  at  one  school  and  statistically 
significant  effects  for  students  at  the  other,  where  the  impact  for 
SAT- Verbal  was  found  to  be  30  and'  27  points,  respectively,  for 
first-  and  second-time  sat  takers  over  the  pooled  time  periods  and 
19  and  28  points,  respectively,  for  sAT-Math  over  the  same  peri- 
ods.  Since  these  values  represent  combined  coaching  and  selP- 
^selection  effects  by  virtue  of  the  confounding  between  pre-e5cist- 
ing  group  differences  and  the  coaching  treatment,  the  ftc  report 
then  presented  an  analysis  of  potential  self-selection  bias.  In  a  re- 
gression analysis  of  the  pooled  treatment  and  control  groups, 
coached  students  were  found  to  achieve  lower,  psat  (or  first  sat) 
scores  than  were  predicted  from  their  background  characteristics, 
whereas  uncoached  students  scored  slightly  higher  t}ian  expected 
given  their  personal  and  demographic  background  This  type  of 
self-selection  was  charabteristic  of  students  attending  the  appar- 
ently effective  coaching  school  but  was  not  generally  found  at  the 
ineffective  school.  In  an  effort  to  eliminate  the  self-selection 
effect  of  this  underachievejrient  on  the  psat  (or  first  sat),  the  re- 
gression analyses  were  repeated  dropping  the  psat  (or  first  sat) 
from  the  set  of  covariatcs.  As  a  consequence,  the  estimated 
eff^cFs~wcre  greatly  reduced.  For  example,  the  effects  for  sat-V 
and  -M  for  first-time  sat  takefe  over  the  pooled  time  periods  in 
the  previously  effective  school  were  11.5  and  .55,  respectively, 
which  are  no  longer  statistically  significant,  the  effects  for  sec- 
ond-time sat  takers  over  the  same  period  were  16.2  and  16.6,  re- 
spectively, for  SAT-V  and  -M,  -which  remain  statistically  signifi- 
cant. It  was  then  argued  that  this  reanalysis  would  be  appropriate 
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only  if  the  undt:r,ichicvcmcnt  on  the  psat  for  coached  students 
were  duetto  chance.  Since  an  imalysis  of  psat  scores  for  students 
coached  between  their  first  and  second  sat  exams  revealed  a  simi- 
lar pattern  of  underachievement  on  both  the  psat  and  the  first  sat, 
it  was  concluded  that  the  phenomenon  was  not  random  but  was 
characteristic  of  stu.dents  self-selecting  coaching,  that  is,  they 
were  underachievcis  on  standardized  tests  and  would  likely  con- 
tinue to  be  test  underachievers  in  the  absence  of  coaching  There- 
fore, it  was  argued,  the  prior  results  showing  coaching  effects  in 
the  20-  to  30-point  range  for  both  sat-V  and  at  one  coaching 
school  wercthe  most  defensible  findings.  Those  findings  still  rep- 
resent estimates  of  combined  coaching  and  self-selection  effects, 
*  however,  since  this  attempt  to  analyze  self-selection  as  under- 
achievement on  standardized  tests  did  not  alter  the  confounding 
of  coaching  with  pre-existing  group  differences  or  otherwise  eUm- 
inate  the  effects  of  unmeasured  self-selection  factors. 

The  most  fundamental  issue  concerning  the  ftc  coaching  study 
is  that  It  undertakes  an  interpretation  of  available  data  as  a  substi- 
tute for  collecting  experimental  data.  The  fact  that  the  data  are 
tifken  from  records  and  files  necessarily  puts  the  study  out  of 
reach  of  the  kinds  of  experifnental  controls  that  would  permit 
clear,  unambiguous  interpretation  of  findings— i.e.,  it  is  a  quasi- 
experiment  rather  than  a  true  randomized  experiment,  Such  a 
study  does  not  involve  random  assignment  of  students  to  coach- 
ing and  noncoaching  conditions,  and  in  the  absence  of  randomi- 
zation some  interpretive  equivocality  is  inevitable.  We  hope  to 
reduce— but  cannot  eliminate— this  equivocality  by  conducting 
mulu'ple  alternawve  statistical  analyses.  Summaries  of  two  such 
reanalyses  are  included  in  Sections  IV  and  V  of  this  report  and  the 
full  texts  are  reproduced  in  the  Appendix. 

The  Power  of  Randomized  Experiments 

The  value  of  a.randornized  experiment  warrants  discussion  here 
To  conduct  a  true  experimental  study  of  coaching,  one  assembles 
a  large  group  of  students  representative  of  the  kinds  of  individuals 
about  whom  inferences  and  generalizations  are  to  be  drawn. 
These  Students.are  assigned  at  random  to  either  a  treatment  (or 
experimental)  subgroup  to  receive  coachirfg  or  to  a  control  sub- 
group for  whom  the  coaching  experience  is  to  be  delayed.  To 
increase  precision,  before  the  treatment  subgroup  takes  the 
coaching  course,  a  form  of  the  sat  could  be  administered  to  both 
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subgroups  as  a  pretest.  Or,  to  avoid  possible  pretest-treatment  in- 
teractions, a  different  instrument  might  be  used  as  a, pretest  or 
some  other  proxy  measure  of  ability  or  achievement  used  as  a  co- 
variate.  Effective  control  conditions  should  be  established  to 
.maintain  motivation,  avoid  attrition,  and  otherwise  assure  that 
the  two  groups  remain  comparable  except  that  one  receives 
coaching  and  the  other  does  not.  At  the  end  of  the  coaching  peri- 
od, the  SAT  is  administered  as  a.posttest  to  both  treatment  and 
control  subgroups.  The  experimental  data  may  be  analyzed^in  any 
one  or  a  combination  of.  several  ways.  For  example,  the  analysis- 
of-covariance  model  uses  pretest  and  other  pretreatment  varia- 
bles to  ad)ust  for  any  differences  that  might  exist  between  the  two 
randomly  assigned  subgroups  on  those  variables.  Since  by  ran- 
domized design  and  the  maintenance  of  effective  controls  the 
only  systematic  difference  between  the  two  subgroups  is  that  oric 
.  received  coaching  and  the  other  did  not,  differences  observed  on 
the  outcome  or  posttest  measure  can  be  confidently  attributedfto 
the  coaching  cxpenence  within  some  range  of  standard  error,  j 

In  a  nonrandomized  desigii  or  quasi-experimeiit  such  as  the  ft'c 
study,  in  which  the  coached  students  were  those  who  had  en- 
rolled in  coaching  schools  and  the  "control''  students  were 
drawn  from  another  source,  there  is  no  way  of  discounting  alter- 
native reasons  for  the  difference  observed  on  the  outcome  or  post- 
test  measure.  The  difference  might  result  from  the  coaching  ex- 
perience or,  on  the  other  hand^  might  simply  reflect  differences  in 
the  chiu^cteristics  of  the  two  groups  existing  prior  to  the  coach- 
ing expedience.  One  powerful  feature  of  the  randomized  experi- 
ment in  this  regard  is  that  we  can  attach  probabilities  to  the  like- 
lihood of  these  alternative  events.  Thus,  although  we  have  other 
reservations  regarding  the  analysis  and  interpretation  of  the  rrq 
study,  our  chief  reservations  are  those  that  relate  in  one  way  or 
another  to.the  nonrandom^ed  nature  of  the  study. 

confronting  Treatment 

and  Control  croup  Differences 

0 

As  a  consequence pf  the  nonrandom  assignment  of  subjects  in  the 
FTC  study-^indeed,  the  highly  s^lf-sclected  nature  ul  the  treat- 
ment group— the  d^ta  offer  numerous  opportunities  for  alterna- 
tive interpretations.  The  fjc-bcp  (1979)  report  recognizes  the  lim- 
itations of  quasi-experimental  dat?i  and*  takes  care  to  avoid  the 
type  of  simplistic  analyses  undertaken  by  the  Boston  Regional 
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Office  (1978).  The  hop  analysis  takes  proper  note  of  jthc  fact  thai 
the  coached  and  uncoached  groups  differ  at  the  one  percent  level 
of  significance  on  several  key  demographic  variables  relevant  to 
SAT  performance,  e.g.,  class  rank,  parental  income,  ethnic  back- 
ground, high  school  type  Ipublic  or  nonpublic),  most  recent  En- 
glish grade,  most  recent  math  grade,  and  expected  years  of  math 

It  IS  noted  in  this  regard  that  the  bci»  analysts  took  account  of 
certain  demographic  items  available  to  them  from  the  Student 
Descriptive  Questionnaire  (sdq),  but  excluded  others Ihat  seem 
,at  least  as  relevant  as  those  that  w^ere  included.  For  example,  the 
SDQ  data  provided  by  the  College  Board  and  ets  for  the  study  in- 
cluded such  variables  as  students'  level  of  educational  aspirations 
and  their  parents'  level  of  education,  but  these  variables  were 
omitted  on  the  master  tape  released  by  bci>  for  reanalysis 

There  are,  in  addition,  some  refinements  that  might  have  been 
introduced  in  the  bcp  analysis,  but  v^ere  hot* 

•  It  might  have  proven  useful  to  conduct  additional  analyses  of 
interactive  effects— e.g.,  the  coaching  effect  with  sex  of  stu- 
dent, with  mmority  status,  with  the  number  of  previous  psats 
taken,  the  number  of  years  of  math  study,  and  high  school 
grades.  Analyses  to  assess  possible  interactions  with  treatment 
have  been  undertaken  by  ETS.  , 

•  In  comparing  coached  and  uncoached  students,  it  would  have 
been  informative  to  report  the  demographic  profiles  for  each 
coaching  school  separately  rather  than  combining  them  across 
schools  and  risking  the  chance  that  important  school  effects 
might  be  obscured. 

•  Although  the  primary  objective  of  adjusting  for  the  indepen- 
^  dent  variables  was  fulfilled,  it  might  have  been  more  in-forma- 
tive if  these  variables  had  been  entered  into  the  analysis  seri- 
atim rather  than  simultaneously.  This  would  have  made  it^os- 

.  sible  to  examine  the  incremental  effects  of  each  variablells  it 
entered  into  the  regression  system.  . 


The  Bane  of  self -selection 

We  have6omc  major  questions  regarding  the  formulation  of  some 
of  the  hypotheses  and  inferences  drawn  in  the  ftc  report  about 
the  nature  and  impact  of  self-selection:  ^ 
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•  The  FTC  report  suggests  that  the  control  group  ''may  in  fact 
have  received  some  form  of  coaching  other  than  formal  enroll- 
ment  in  a  commercial  coaching  course"  (p.  2),  in  which  case 
the  apparent  benefit  from  coaching,  as  observed  in  this  study, 
would  have  been  an  underestimate  of  the  real  coaching  effect 
However,  data  from  a  study  by  Powers  and  Alderman  (1979)  on 
the  effects  of  usmg  the  College  Board  booklet  Taking  the  SAT 
suggest  tha.t  coached  students  may  be  more  likely  than  un- 
coached  stjadents  to  engage  in  additional  methods  of  prepara- 
tion. Thus,  under  these  circumstances  the  ftc  analyses  would 
be  more  likely  to  overestimate  the  effects  of  commercial 
coaching  schools  by  failing  to  account  for  other  ways  in  which 
coached  students  may  have  prepared  for  the  test. 

•  The  hypothesis  is  offered  in  the  ftc  report  that  students  who 
are  coached  before  taking  the  sat  for  the  first  time  are  serious 
about  their  test  experience  and  do  not  plaii  to  take  it  a  second 
time,  while  those- who  are  uncoached  aire  not  as  serious  since 
they  do  plan  to  take  the  test  a  second  time.  If  this  is  so,  then 
higher  scores  obtained  by  coached  students  may  not  be  due  to 
coaching  but  to  the  difference  in  how  serious  the  students  are. 
The  results  showed  that  coached  students  were,  in  fact,  not 
less  likely  but  more  likely  than  uncoached  students  to  take  the 
SAT  a  second  time  and  the  conclusion  is  drawn  that  the  issue  of 
seriousness  is,  therefore,  not  a  cause. for  concern.  However, 
consideration  should  be  given  to  the  counter-hypothesis  that 
because  coached  .students  were  more  Hkely  than  uncoached 
students  to  take  the  sat  a  second  time,  coached  students  are  in- 
deed more  serious  and  more  determined  to  persist  until  they 
obtain  satisfactory  sat  scores. 

•  In  considering  the  possibility  of  self-selection,  psat  (or  sat) 
scores  wfere  predicted  frorfi  a  composite  of  demographic  charac- 
teristics including  family  income,  most  recent  English  and 
mathematics  grades,  and  class  rank,  among  others,  for  tKe^ 
pooled  sampjrf^  coached  and  uncoached  students.  These  pre-^ 
dieted  scores  were  then  compared  with  actual  initjal  psat  (or 
SAT)*scores.  The  c(>achpd  students  were  found  to  earn.lowcr  ini- 

^  tial  PSAT  (or  sat)  scores  than  expected  from  their  background 
characteristics,  whereas  uncoached  students,  on  balance, 
score.d  slightly  higher  than  expected  given  their  personal  and 
demographic  characteristics.  Thus,  the  coached  students  on 
the  average  achieved  lower  initial  psAT,(or  sat)  scores  than  un- 
coached st.udents  having  the  same  values  of  demographic  varia- 
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bles.  It  is  concluded  that  coached  students  "tend  to  under- 
achieve on  standardized  tests'*  and,  further,  that  coaching  is 
"effective  for  underachievers."  The  terminology  is  rather  un- 
fortunate in  that  it  is  easy  to  slip,  as  happens  occasionally  in 
the  FTC  Report;  and  refer  to  the  coached  students  as  "under- 
achievej/s"— a  term  that  is  generally  applied  to  students  v^hose 
grades^n  school  are  lower  than  one  would  expect  on  the  basis 
of  tes^  scores  or  prior  achievement.  In  fact,  the,comparison  of 
dempgraphic  profiles  presented  for  coached  and  uncoached  st^u- 
d^Mlts  indicates  that  the  coached  group  earned  higher  grades  in 
£nglii>h  and  mathematics  and  had  higher  class  ranjcs  than  did 
the  uncoached  students— but  they  did  not  score  aS  well  on  the 
PSAT  as  those  accomplishment^  would  have  led  one  to  expect.  ^ 
In  contrast  to  the  hypothesis  offered  in  the  ftc  report  that 
"the  students  who  choose^to  go  to  a  coaching  school  represent 
those  individuals  who  scored  lower  than  they  expected  on  the 
sat"  (p.  23);  a  number'of  other  hypotheses  about  self-selection 
are  at  lea^t  as  plausible  and  consistent  with  the  data.  These  in- 
clude self-selection  on  the  basis  ot  family  income,  attending 
private  schools,  etc.  The  point  is  that. we  simply  cannot  tell 
w.ith  any  certainty  on  what  basis  self-selection  occurred.  For 
example,  students  ^it  Coaching  School  A,  which  charged  $225 
for  the  couise,  were  found  to  be  "underachievers  bn^  stan- 
dardized tests,"  whereas  students  at  coaching  School  B,  which 
charged  only  S75,Were  not. 

In  the  FTC  regression  analyses,  the  estimated  effects  of  taking 
the  PSAT  twice  prior  to  taking  the  sat  were  found  to  be  larger, 
although  less  precise,  than  those  attributed  to  coaching  These 
effects  on  sat  performance  of  repeating  the  psat  are  unusually 
high  relative  to  what  we  know  about  the  impact  of  prior  test 
practice  or  test  repetition,  suggesting  the  operation  of  'some 
form  of  self-selection  bias  in  these  data. 

A  major  conclusion  of  the  study  is  that  "coat  hing  can  be  effec 
tive  for  those  who  do  not  score  well  on  standardized  tests" 
jp.35).  On  closer  examination^  we  note  that  this  conclusion  is 
not  substantiated  in  data^ahalysis  because  the  ftc  regression 
analyses,  by  virtue  of  not  investigating  interactions  with  treat- 
ment, estimate  the  same  effect  of  coaching  regardless  of  demo- 
graphic characteristics  of  the  subjects.  Consequently,  there  is 
.no  evidence  in  the  ftc  study  on  this  point  of  differential  effec- 
tiveness of  coaching.  Rather,  this  conclusion  is  based  on  con- 
jecture, as  follows.  One  school  produced  significant  coaching 
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•  effects  and  the  other  did  not^  students  at  the  effective  School  A 
tended  to  be'underachievers  on  standardized  tests  while  those 
at  the  ineffective  Sciiool  B  were  not.  The  FTcrejjprt  then  notes 

^  that  coaching  can  be  effective  for-^^inderachievers  on  standard- 

•  ized  tests  because  it  was  at  School  A,  rather  than  arguing  that 
undcrnchievement  on' standardized  tests  and  attendance  at 
School  A  are  confounded  and  that  seU-selection  affords  a  plaus- 
ible rival  interpretation  for  the  oJ)tained  effects  or  for  part  of 
those  effects.  It  is  then  speculated  that  "if  only  underachievers 
can  be  helped,  it  is  possible  that  coaching  at  School  B  would  be 
effective  for  such  students"  (p.  36).  Furthermore,  in  School  A 
s.elf-selection  in  the  sense  of  "underachievement  on  standard- 
ized tests"  was  not  apparent  on  one  of  the  test  administrations 

_  (thasOcond-SAT' Verbal  raken  in  l?7S),  wd  the  conclusion-is 
drawn  that  "coaching  at  School  A  can  be  effective  for  all  stu- 
dents, not  just  for  underachievers"  ip.  35J.  Although  qualified 
in  the  ftc  report,  for  conclusions  of  this  importance  to  be 
drawn  with  such  generality  one  would  expect  both  the  data  and 
the  analyses  to  be  more  directly  supportive. 

Additional  Puzzlements 

\ 

The  FTC  report  describes^ some  findings  that  warrant  clarification 
.and  further  research: 

•  The  effects  of  coaching  on  the  Verbal  section  of  the  sat  were 
,found  to  be  as  large  or  larger  than  the  effects  on  the  Math  sec- 
tion. This  result  seems  contrary  both  to  intuition— the  Math 
test  is  much  more  curriculum-felated  than  is  the  Verbal  test— 
and  to  the  general  trend  of  results  from  earlier  studies^'that  the 
VejFbal  test  is  less  susceptible  than  is  the  Math  test  to  special 
preparation  effects. 

•  the  FTC  report  gives  data  showing  that  the  effect  for  students 
attending  Coaching  School  A  was  significantly  greater  on 
SAT- Verbal  in  1976  than  in  1975  and  greater  on  SAT-Math  for 
second-time  takers  than  for  first-time  takers.  These  varia- 
tions are  potentially  important,  and  an  examination  of  their 
sources  might  illuminate  the  relative  effectiveness  of  coaching 
practices. 

'  •  The  analysis  revealed  that  attendance  at  School  A  was  associ- 
ated with  larger  effects  on  sat  performance  than  attendance  at 
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School  B.  Considering \he*  fact  that  the  tuition  at  School  A  is 
,  three  times  the  tuition  at  School  B,  it  is  not  surprisfng  that  the 
self-selettion  effects  d^^cussed  in  the  report  are  stronger  for  the 
School  A  students  th^n  for  rhe  School  B  students,  who  might 
thereby  be  expected  tp  be  more  similar  to  the  uncoached  stu- 
dents. Such  a  view  would  put  more  stress  on.the  School  B  find- 
ings than  is  given  in  the  ftc  import. 
At  a  more  specific  level,  there  is  some  concern  that  t^e  proce- 
.  durcs  used  for  constructing  the  samples  in  the  ftc  analyses 
may  have  introduced  biases  ^elated  to  the  effects  under  investi- 
gation. For  example,  the  ftc  noted  that  testing  histories  were 
identified  for  1568  of  the  coaching  school  students  bur  not  for 
600  others.  This  represent^an  attrition  of  about  2.8  percent,  a 
highly  significant  loss^  In  addition,  all  students  who  did  no;^ 
respond  to  the  Studerit  Descriptive  Questionnaire* were 
dropped  from  the  analysis.  The  sfu^y  showed  a  significantly 
lower  rate  of  response  to  the  items  on  the  spQ— approximately 
64  and  67  percent  for  the  coached  and  uncoached  students,  re- 
spectively—than is  typical  of  the  ColFegv  Board  candidate 
group.  The  usual  response  rate  for  the  candidate  grwuip  is  about 
-  86  percent,      '  \ 

New  Perspectives  on  the  FTC  Data 

In  an  attempt  to  clarify  some  of  the  points  raised  in  this  critique, 
ETS  undertook  reanalyses  of  the  data  includccl  on  the  master  tape 
released  to  the  public  by  the  ftc.  As  part  of  our  effort  to  under* 
stand  the  conduct  and  implications  of  the  ftc  study,  ets  invited  " 
Dr.  XW.E  Stroud,  Queens  University,  Kingston,  Ontario,  to 
design  and  carry  out  additional  analyses  of  the  ftc  master  tape 
data.  As  the  first  step  in  his  independent  rcanalyste.  Dr.  Stroud 
successfully  replicated  the  results  as  reported  by  the  ftc.  Having 
asi^ured  the  accuracy  of  the  ftc  computations  using  their  stausti- 
cal  design;  Dr.  Stroud  undertook  a  reanalysis  of  the  data  for  all 
three  coachmg  schools  using  a  similar  analysis-of-covariance 
modql,  but  differing  from  the  ftc  analysis  in  two  important 
respects.  Tbje  ftc  analysis  employed  a  pooled  regression  equation 
across  both  coached  and  uncoached  students  using,  along  with 
other  variables,  psat-V  in  predicting  coaching  effects  on  the 
SAT-Verbal  score  and  p.sat-M  in  predicting  sAT-Math  effects.  In 
contrast.  Dr.  Stroud  employed  a  regression  equation  defined  by 
the  performance  of  uncoached  students  only  and,  in  addition,  in- 

39 


•  eluded  both  psat-V  and  -M  m  predicting  coaching  effects  for  each 
area-p'n  the^sAT.  This  analysis  is  preferable  not  .only  because  it  is 
more  precisely  controlled  through  the  inclusibn  of  addltjonal  co- 

'  vanates,  but  because  it  more  appropriately  contrasts  the  perfor- 
mance Q*:oached  students  with  predicted  levels  based  on  un- 
coached  s^dents  rather  than  a  mixture. of  the  two.  This  approach 
results  in  valid  estimates  with  fewer  assumptions  and.cnables  ex- 
amination of  interactions  in  a'straightforwarjd  manner  (Cochran, 

^  1968). 

This  reanalysis  indicates  that,  given  their  background  charac- 
teristics and  pretest  levels  on  the  psaT,  students  enrolled  in  ©ne  of 
the  three  coaching  schools  studied  obtained  significantly  higher 
SAiLScores  than  did  uneoached  students  by  «lbout  20  to  35  points 
in  both  Verbal  and  Math— the  same  neighborhood  as  the  ftc  esti- 
mates. The  estimated  effects  of  coaching  for  the  other  two 

_,scKaol$  were  not  statistically  'significant.  These  are  estimated 

^'combined  effects  due  to  coaching  and  self-seleCtion  (self-selec- 
tion in  terms  of  students  who  seek  and  complete  commercial 
coaching  programs  as  opposed  to  those  students  wio  do  not), 
since  it  is  ncJt  possible  to  estimate  cbaching  and  self-selection 
effects  separately  with  these  data.  No  interactions  were  uncov- 
ered at  Cotiching  School  A  for  either  sat-V  or  sAt-M-  At  (poaching 
School  B,  however,  statistically  significant  and  independent  in- 
teractive effects  were  obtained  on  sat-V  for  race  and  self-reported 
parental  income.  On  the  average,  even  though  their  number  was 
quite  small  jN  =  13),  black  students  at  School  B  exhibited  sigriifi- 

'   cantly  larger  coachmg/self-bclection  effects  on  sat-V  .than  non- 
^. blacks,  and  students  reporting  low  family  income  exhibited  sig- 
.<^{icantly .larger ,coaching/self-selection  Verbal  effects  than  those 
reporting  high  family  income.  A  detailed  summary  of  the  Stroud 
reanalysis  follows  in  Section  IV,  and  the  complete  report  appears 

"  in  Appendix  2.  '         ^  " 

A  second  study  of  the  data  was  undertaken  by^DOnald  A,  Rock, 
Senior  Research  Psychologist  at  ets.. Since  w,e  know  that  gains  in 
•  SAT  scores  can  be  expected  from  the  junior  year  to  the  senior  year 
of  high  school,  Di,  Rock  applied  a  statistical  model  incorporating 
growth  effect^.  For  the  treatment' or  experimental  group,  this 
study  included  only  those  ^  udcnts  at  the  largest  coaching  school 
(School  A)  for  whom  three  sets  of  test  scores  were  available,  a 
PSAT  and  two  administrations  of  the  sat.  The  control  group  in- 
cluded only  those  uneoached  students  for  whom  thek  same  three 
sets  of  test  scores  were  also  available.  The  coached  students,  who 
were  labeled  ''iindcrachievers"  in  the       report,  performed  bet- 
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tcr  than  the  iincoachcd  students  on  the  psat  and  were  al^  higher 
in  high  school  rank-in-class  and  family  income  than  were  the  un- 
coached  students.  As  would  be  expected,  the  coached  students 
also  scored  higher  than  their  uncoached  cohorts  on  the  first  sat 
administration,  but  in  the  case  of  the  Verbal  area  scored  differen- 
tially higher.  That  is,  during  the  period  from  taking  the  psaT  to 
taking  the  initial  sat,  prior  to  attendance  at  the  coaching  school, 
the  verbal  skills  of  the  coached  students  appeared  to  grow  more 
rapidly  than  those  of  the  uncoached  students.  In  Math,  however, 
both  the  coached  and  uncoached  students  showed  similar  group 
growth  rates  durmg  this  preintervention  period.  When  the  con- 
founding effects  of  differential  group  growth  rates  are  controlled 
for,  the  estimated  coaching  effect  on  fhe  Verbal  score  (about  17 
points)  is^substantially  smaller  than  that  for  the  Math  score 
{about  30  poin|s).  The  fact  that  these  two  effects  are  different 
from  each  other,  and^r^ot  the  same,  is  consistent  with  the  results 
of  earlier  studies  and  with  expectations  that  Math,  being  gener- 
ally more  curriculum-related  than  Verbal,  might  be  more  respon- 
-sive-lo  special  preparation.  A  detailed  summary  of  the-Rock-study 
foJl^'  6  in  Section  V,  and  the  complete  report  appears  in  Appendix 

Most  of  the  criticism  in  this  section  points  up  the  limitations 
of  the  FTC  data  and  the  limits  on  inferences  that  can*be  drawn 
from  such  data.  Within  these  limits,  further  analysis  and  inter- 
.pretation  may  still  prove  to  be  illuminating.  In  this  spirit,  we 
next  attempt  to  estimate  the  combined  coaching/sclf-selection 
effects  using  more  refined  methods  and  to  investigate  the  possL- 
bihly  of  interactions  between  si^c  of  effects  and  student  back- 
ground characteristics.  We  also  attempt  to  adjust  statistically  for 
that  portion  of  self-selection  effects  that  is  embodied  in  differen- 
tial group  growth  rates. 
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Estirtiatioh  of  combined  Coaching  / 
self -Selection  Effects  in  the  FTC  Study: 
Detailed  summary  and  Elaboration  of 

the  Stroud  Reianalyses 


In  ap  effort  to  obtain  more  precise  estimate^  of  the  combined 
-  ^GoU'ching/self-selection  effects  in  the  ftc  data,  Dr.  T.W.F.  Stroud 
of  Queens  University,  Kingston,  Ontario,  at  the  request  of  ets, 
designed  and  conducted  additional  analyses  introducing  several 
refinements  over  the  procedures  used  by  the  ftc.  It  will  be  re- 
called that  the  ftc  study  was  based  on  six  subsamples:  (1)  high 
school  juniors  taking  the  sat  for  the  first  time  in  April  1975  or  (2) 
in  April  1976;  (3)"high  schoor Seniors  taking  the  sat  for  the  second 
time  in  November  1975  or  (4)  in  November  1976;  and,  (5)  all  high 
school  students  taking  the  sat  for  the  first  time  on  any  test  date 
over  the  three-year  period  1974-1977  or  {6)  taking  the  sat  for  the 
second  time  on  any  test  date  during  that  period.  Data  for  students 
at  two  coaching  schools  in  the  metropolitan  New  York  area  were 
,  included,  while  data  from  a  third  eoaching  school  were  left  unan- 
alyzed  because  the  number  of  studcrfts  was  considered  too  small. 
A  control  sample  of  uncoached  students  consisted  of  every  150th 
/  individual  in  the  ets  files  who  took  (he  sat  during  the  given  three- 
year  periodin  the^ame  greater  N^w/fork  area. 

The  following  background  variabfes,  roughly  in  decreasmg 
order  of  th'eir  importance,  were  controlled  for  in  the  ftc  regres- 
sion analyses:  pretest  score  [psat-V  when  the  first  sat-V  (sat1-V) 
was  being  predicted.  sat1-V  when  the  second  sat-V  (sat2-V)  was 
being  predicted,  and  similarly  psat-M  when  predicting  sat1-M 
and  SATl-M  when  .predicting  sat2-M|,  self-reported  grade  in 
English  or  Math,  self-reported  rank-in-class,  self-reported  years  of 
English  Oi  math  taken,  self-reported  parental  income,  sex,  race, 
high  school  type  (public  or  nonpublic),  and  number  of  psats 
taken.  Time  between  pretest  and  posttest  was  also  included  as  a 
covariate,  but  it  did  not  improve  prediction  significantly.  The  rrc 
regression  analyses  were  based  only  on  students  with  complete 
data  on  all  of  these  variables.  For  each  of  the  six  subsamples,  sep- 
arate regression  equations  predicting  sat-V  and  sat-M  were  com- 
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puted  for  pooled  coached  and  noncoachcd  students,  using  dummy 
variables  to  represent  attendance  at  Coaching  School  A  and 
Coaching  School  B. 

Overall;  the  ftc  analyses  showed  that  students  at  Coachmg 
School  A,  on  ^he  average,  scored  significantly  higher  on  the  sat 
than  noncoached  students.  The  amount  of  advantage  oh  a  200-  to 
800-point  score  scale  falls  somewhere  between  14  and  38  points, 
which  are  95%  confidence  limits  for  the  differences  m  adjusted 
means  (the  median  lower  confidence  limit  and  the  median  upper 
confidence  limit  over  the  12  analyses,  for  sat-V  and  -M  in  the  6 
subsamples).  Students  at  Coaching  School  B  did  not  do  signifi- 
cantly better  than  noncoached  students,  their  score  effect  falls 
somewhere  between  median  confidence  limits  of  -12  and  +  19 
pomts.  In  any  event,  since  the  coached  students  in  this  nonran- 
domized study  differed  significantly  from  the  noncoached  stu- 
dents in  a  number  of  ways  that  could  have  influenced  both  their 
decision  to  attend  coaching  school  and  their  performance  on  the 
SAT  (such  as  having  higher  rank^n-class  and  higher  parental  in- 

come),.thesc  obtamcd„score  diffcrcnccsbciween  coached  and  un-   

coached  groups  represent  a  confounding  of  coaching  effects  and 
personal  factors  that  cannot  be  disentangled  with  the  available 
data.  Among  these  personal  factors  influencing  attendance  at 
commercial  coaching  schools,  for  example,  are  motivation  to 
earn  a.higher  test  score  and  financial  means.  The  ftc  data  .set  in- 
cludes a  rough  proxy  for  financial  means  iii  the  form  of  self- 
reported  parental  income,  but  it  includes  no  proxy  for  motivation 
or  for  a  host  of  other  important  ways  in  which  coached  and  noh- 
coached  students  are  likely,  on  the  average,  to  differ,  such  as  in 
career  aspfrations  or  in  level  of  parental  education  Attempts 
were  made  in  the  regression  analyses  to  control  for  student  differ- 
ences in  reported  income,  but  there  is  no  way  that  statistical  ad- 
justments can  take  unmeasured  influences  into  account.  As  a 
consequence,  the  score  effects  reported  in  the  ftc  study  must  be 
interpreted  as  combmed  coaching/self-selection  effects,  as  must 
the  findings  of  the  reanalyses  that  follow. 

The  reanalyses  undertaken  here  differ  from  the  ftc  analyses  in 
a  number  of  respects: 

In  the  ftc  analyses,  verbal  pretests  (psat-V  and  sat1-V)  and  ver- 
bal background  variables  (e.g.,  grades  in  English,  years  of  English) 
were  used  to  predict  sat- Verbal  scores,  and  quantitative  pretests 
and  background  variables  were  used  to  predict  sAT-Math  scores 
However]  since  the  inclusion  of  both  verbal  and  quantitative  vari- 
ables improved  prediction  of  each  scorp,  both  verbal  and  quantita- 
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tivc  pretests  and  background  variables  were  used  in  the  current 
reanalyses  to  predict  both  sat1-V  and  -M  for  juniors  and  both . 
SAT2-V  and  -M  for  seniors.  The  only  exception  was  "number  of 
years  of  English/'  which  was  dropped  from  the  analyses  because 
It  did  not  add  to  prediction  in  any  regression  equation  when  tiic 
other  variables  were  already  entered. 

the  current  reanalyses  dealt  only  with  the  peak  test  dates  in 
1975  and  1976  (subsamples  1,  2,  3,  and  4  in  the  ftc  study).  Sub- 
samples  5  and  6  for  the  pooled  time  periods  were  omitted  because 
of  their  heterogeneity. 

Only  students  with  complete  data  were  included  in  the  ftc 
analyses.  In  contrast,  Stroud  used  missing-value  techniques  so 
that  students  not  reporting  parental  ipcome,  race,  or  rank-in-class 
could  nevertheless  be  me^ingfully  mclud^ed  in  the  analyses. 

hi  the. FTC  study,  students  enroljed  in  coaching  school  who  did 
not. receive  coaching  prior  to  the  sat  administration  in  question 
were  added  to  the  uncoached  group.  Since  the  representativeness 
of  the  control  sample  is  thereby  eroded,  these  students  were  ex- 
cIuded_from  thejresent  analyses,  

All  three  coaching-^choab  in  the  FTC'data  set  were  included  in 
the  present'afiaTyses,  and  effccTs^and  standard  errors  are  estimated 
for  each  school  separately.  In  addition,  smoothed  e3timaies  are 
provided  for  the  three  schools  which  utilize  the  empirical  Bayes 
concept  of  "borrowing  strength"  across  samples  and  which 
allow,  under  cei-tain  assumptions,  for  the  possibility  of  predicting 
coaching/self-sclection  effects  in  the  same  schools  in  future 
years. 

In  a  key  departure  from  the  ftc  methodology,  a  multiple  regres- ' 
sion  equation  predicting  each  dependent  variable  (sat1-V  and  -M 
fofr  juniors  and  sat2-V  and  -M  for  seniors)  is  constructed  in  the 
present  approach  on  the  respective  junior  and  senior  samples  of 
uncoached  students  rather  than  on  a  pooled  sample  of  coached 
and  uncoached  students  as  in  the  ftc  study  (Belson,  r956).  This 
procedure  yields  an  unbiased  estimate  of  the  treatment  effect  in 
the  presence  of  interactions  between  the  size  of  effects  and  values 
of  a  covariate;  it  is  also  the  recommended  procedure  when  the 
control  sample  is  much  larger  than  the  treatment  sample  (pro- 
vided that  the  relative  contribution  of  sampling  errors  in  the 
control-group  regression  line  to  the  variance  of  the  effect  estimate 
is  negligible)  (Cochran,  1968).  These  regression  equations  are 
then  applied  to  the  coached  students  to  predict  the  sat  scores  they 
would  have  expected  had  they  been  uncoached  students  with 
their  same  values  on  predictor  variables.  Since  we  wish  to  assess 
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the  average  score  increase  of  those  coached,  we  adjust  the  control 
group  from  one  mean  to  the  other.  Residuals  from  these  regres- 
sions are  then  calculated  for  students  at  each  coaching  school, 
and  the  average  value  of  these  residuals  is  taken  to  represent  the 
combmed  coaching/self-selection  effect  for  each  school.  Com- 
bined coaching/self-selection  effects,  together  with  standard 
errors  (including  the  sampling  errors  of  the  regression  line);  are 
reported  in  Table  IV*1  separately  for  juniors  and  seniors  in  each  of 
the  two  administration  years  for  each  of  the  three  coaching 
schools.  The  overall  results  are  similar  tq  the  ftc  findings, 
although  more  precisely  estimated  with  smaller  standard  errors 
Combined  coachmg/^elf-selection  effects  were  statistically  sig- 
nificant for  one  coaching  school  and  negligible  and  inconsistent 
for  the  other  two  coaching  schools.  The  significant  effects  ranged 
from  about  27  to  34  points  for  sat-V  and  from  about  20  to  33 
points  for  sat-M.  Smoothed  estimates  based  upon  empirical 
Bayes  procedures  present  a  similar  pattern  \h  Table  IV-2;  with  the 
size  of:the  effects  somewhat  moderated  and  the  standard  errors 
soinewhat  increased. 


Table  tv-1 

Coaching/Sclf-Scleciion  Effects  and  Their  Standard  Errors 
SAT-Verbal  sat-Math 

1975sat1-V  1976$at1-V  1975sat1'M  1976sat1'M 

School   Effect     SE        Effect     5.£.         i^chool  Effect     S  E        Effect     $  P. 

A    27.44   6.66    34.13   5.23        A    22,36   7.45    20.37  5735 
Juniors       b      —  4.16  6.38        b      -      -       3.71  7.14 

C    17.88  11.19    25.64  14.10        C    27.68  12.52  -23.32  15.79 

1975SAT2-V  I9765AT2-V  1975sat2'M  1976sat2;M 

School   Effect     S,E        Effect     S.E  School  Effect     SE        Effect  S:E 

A    32.07   5.86    31.34   4.51        A    22.54   6.41    32.62  4.93 
Seniors       B     11.12  10.16     4.76'  8.05        B    26.40  11.10     8.07  8.80 
C  -10.47  14.02    20,30  18.70        C    24.34  15.33  -21.57  20.44 

Another  advantage  of  the  present  methodology,  in  addition  to 
yielding  valid  estimates  with  fewer  assumptions  and  usually 
greater  precision  than  the  ftc  approach;  is  the  straightforward 
manner  in  which  potential  interactions  may  be  explored.  This  is 
accomplished  in  general  by  correlating  the  coached  students'  re- 
sidual scoreS;  which  represent  individual  coaching/self-selection 
effects;  with  whatever  student  characteristic  or  background  vari- 
able one  suspects  might  be  associated  with^differential  effects. 
Variables  yielding  significant  correlations  then  serve  to  identify 
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Table  iv-2 

Smoothed  Estimates  of  the  Mean  Coaching/Self-Sclcction 
Effects  at  the  Three  Coaching  Schools 

SAT-VtRBAL  SAT-Math 

SchiX>I   Bllcci     St  SdiMl   m%l  S.E 

A     28,5     9.2         A     16.9  18.6 
luniors  j^.g         B      7.8  23.0 

C     20.9    10.7         C      8.4  19.5 

ScW)   Elleiri     SE  ScHmI   Bllcci    S  E 


A     28.4    12.1         A     24.0  15.1 
Seniors       ^  ,23         b  ,  17.2  15.3 

l"^"^^'       C      6.1    15  0         C     12.0  J7.6 

subsets  of  the  coached  student  population  that  systematically  ex- 
hibit greater  coaching/self-selection  effects  than  others.  As  previ- 
ously suggested,  it  would  not  be  surprising  to  find  a  number  of  in- 
teractions in  the  ftc  data  for  such  variables  as  "years  of  math 
taken,"  which  revealed  differential  score  effects  for  Dyer  (19531— 
possibly  moderated  by  sex  as  it  was  for  French  (1955)-or  educa- 
tional-or--culturaLdisadxantagement  as  antjcipated  but  not  con- 
firmed by  Roberts  ^nd  Oppenheim  (1966). 

In  the  present  exploratory  analysis  of  interactions,  as  an  overall 
test,  two-multiple  correlations  were  computed  for  the  coached 
students,  one  predicitng  the  individual  Verbal  coaching/self- 
selection  effects  and  the  other  the  individual  Math  effects,  usmg 
as  predictors  the  same  set  of  variables  that  had  served  as  control 
measures  in  the  initial  regression  equations  computed  on  un- 
coached  students.  In  the  u-^coached  group,  of  course,  these  varia- 
bles would  be  uncorrelatea  with  residual  scores.  These  predictors 
included  fSAT-V  and  -M  (or  sat1-V  and  -M),  high  school  type, 
rank-in-class,  years  of  mathematics,  self-reported  parental  in- 
come, grades  in  English  and  math,  sex,  and  race  or  minority 
group  membership.  (Two  minority  grouping  variables  were  in- 
cluded: Group  1  refers  to  Asian  Americans,  Hispanics,  and  other 
nonblack  minorities  Group  2  refers  to  blacks).  Only  persons 
with  complete  data  from  the  three  largest  cells  of  coached  stu- 
dents were  included  in  this  analysis,  namely  the  1976  juniors  and 
seniors  of  School  A  and. the  1976  juniors  of  School  B;  the  sample 
sizes  were  103,  102,  and  85,  respectively.  For  the  two  School  A 
samples,  neither  the  multiple  correction  for  the  Verbal  effects 
nor  the  multiple  correlation  for  the  Math  effects  was  statistically 
significant.  For  the  School  B  juniors,  the  multiple  correlation  for 
the  Math  effects  was  also  nonsignificant  but  that  for  the  Verbal 
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effects  was  significant  at  the  .05  level.  An  examination  of  the  in- 
dividual correlation  coefficients  between  each  predictor  and  the 
Verbal  residual  score  revealed  that  Group  2  (black  vs.  nonblack) 
^  was  the  most  significant  predictor  variable.  The  most  important 
predictor  after  Group  2  was  entered  into  the  equation  was  self- 
reported  parental  income.  Group  2.  correlated  .288  with  the  Ver- 
bal residual  score  and  Income  correlated  -.250,  both  of  which  are 
statistically  significant  at  the  J05  level.  The  partial  correlation  co- 
efficient between  Income  and  Verbal  residual  score  after  partial- 
ling  out  Group  2  was  -.258,  indicating  tliat  the  effect  of  income 
and  the  effect  of  black  vs.  qonblack  were  essentially^scparate 
from  each  other  in  this  sample  of  School  B  juniors. 

The  interaction  with  Income  indicates  that  among  coached 
juniors  at  School  B  those  students  reporting  lower  parental  in- 
comes exhibited  larger  coaching/self-selection  effects  on  sat- Ver- 
bal than  did  students  reporting  higher  parental  iqcopies.  Since 
students  with  low  family  income  may  have  had  less  access^  to 
learning  resources  at  either  home  or  school,  this  interaction 
might  have  arisen  because  some  of  them  chose  to  attend  coaching 
school  as  a  limited-cost  effort  lo  gain  short-term  intensive  access 
to  such  resources,  which  they  then  used  to-good- compensatory 
effect.  Or,  as  we  have  previously  suggested,  since  both  motiva- 
tion and  financial  means  are  probably  instrumental  m^cciding 
whether  or  not  to  attend  a  commercial  coaching  school,  tt  is  not 
unreasonable  that  coaching  school  enrollees  having  lower  than 
average  financial  means  might  have  especially  strong  motivatiqn'^ 
to  perform  well.  It  should  be  noted,  however,  that  no  interaction 
with  parental  income  was  uncovered  for  either  juniors  or  seniors 
at  School  A,  where  the  required  financial  investment  is  three 
times  that  of  School  B.  The  reason  for  such  apparent  differences 
in  the  effects  of  parental  income  in  School  B  as  opposed  to  §chool 
A  is  not  obvious,  unless  the  nonreplications  signify  that  this  in- 
teraction IS  one  of  those  rare  random  events  that  achieves  statisti- 
cal significance  by  chance.  On  the  other  hand,  the  fhnge  of  in- 
come was  so  restricted  at  School  A— 50  percent  of  the  students 
reported  parental  incomes  in  the  top  category  of  more  than 
$30,000  a  year— that  a  significant  correlation  with  residual  scores 
would  be  difficult  to  obtain. 

Plausible  interpretations  for  the  interaction  with  black  vs.  non- 
black  are  even  less  obvious,  For  example,  at  first  glance  one 
might  expec*.  this  interaction  to  be  associated  with  disadvantage- 
ment.  But  if  so,  it  is  unrelated  to  economic  disadvantagement 
because  the  interactive  effects  of  black  vs.  nonblack  in  School^B  j 
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arc  separate  from  the  effects  of  self-reported  parental  income;  m 
this  sample,  unlike  the  general  population;  these  two  variables 
areinncorrelated.  Nor  is  educationaLdisadvantagement  or  devel- 
oped ability  level  implicated  in  any  simple  way,  because  there 
were  no  differential  effects  associated  with  pretest  score  level  or 
With  high  school  grades.  Neither  was  this  Group  2  interaction 
replicated  in  School  A,  but  in  this  case  U  had  no  opportunity  to 
occur  there  because  only  three  black  students  with  the  requisite 
background  scores  were  identified  in  the  School  A  data  set 

In  an  effort  to  clarify  thq  nature  of  this  Group  2  interaction,  test 
score  and  background  data  were  examined  for  all  of  the  coached 
students  who  identified  themselves  as  black  and  who  took  the  sat 
cither  as  juniors  of  seniors  during  the  peak  month  of  either  ad- 
mmistration  year  and  for  whom  the  information  necessary  for  the 
missing-value  regression  equations  was  available.  Fifteen  such 
students  were  identified,  13  of  whom  attended  Coaching  School 
B.  The  average  V^erbal  coaching/self-selection  effect  for  these  13 
students  was  46.7  points  above  that  for  whjte  students  at  Scbool 
B,  which  is  statistically  significant  at  the  .001  level.  The  average 
Math  effect  for  these  13  black  students  also  exceeded  that  for 
"^whit^,  but  the  difference  was  not  statistically  significant.  The 
Verbal  effects  fornhe  other  two  black  students,  exLceededthe^ll 
mean  for  thcTr  resp^ective  coaching  school  by  24.6  points  on  the 
average.  Six  additional  black  students  were  identified  who  had 
taken  the  sat  at  nonpeak  a^tninistrations;  their  Verbal  effects 
exceeded  their  corresponding  cell  means..by52.6  points  on  the 

average.  •  ^^^^^"^^ 

In  terms  of  background  characteristics,  the  total  grou^rof  blacky 
students  identified  reported  parental  incomes  ranging  from  5' 
thousjvndito  more  than  30  thousand  dollars  per  year,  with  a  mean 
of  $fl,500.  These  students,  in  the  main,  were  in  the  top  third  of 
their  high  school  class  and  earned  grades  of  B  or  better  in  both 
math  and  English,  but  their  scores  on  the  p.sat  or  satI  were  rela- 
tively low.  This  pattern  of  lower  test  scores  than.might  have  been 
expected  from  background  characteristics  is  reminiscent  of  thq 
type  of  self-selection  attributed  to  School  A  students  in  the  ftc 
report,  but  such  "underachievemerit  on  standardized  tests/'  it 
will  be  recalled,  was  not  found  to  be  typical  of  School  B  students 
on  the  average.  Since  the  Group  2  interaction  might  thus  be  an- 
other example  of  self-selection  effects,  data  were  examined  for 
coached  and  uncoached  black  students  in  the  Alderman  and 
Powers  (1979)  randomized  study  of  high  school  special  prepara- 
tion programs.  Only  8  coached  bjack  students  were  identified 
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but  their  individual  SAT-VerBal  coaching  effects  were  estimated 
anyway,  especially  since  the  interaction  in  question  was  based  on 
only  13  black  students.  Using  the  same  within-school  regression 
equations  employed  by  Alderman  and  Powers,  the  black  stu- 
dents'  coaching  effects  were  found  to  exceed  their  respective 
school  mean  coaching  effect  by  only  8.4  points  on  the  average,  in- 
dicating little  differential  effectiveness  for  bla.qj^^students.  Using 
within-school  regression  equations  based  only  on  uncoached 
white  stydents,  as  a  parallel  to  the  regressions  Stroud  used  for  un- 
coached students  in  general,  the  coached  black  students  scored  an 
average  of  3.8  points  below  the  level  predicted  had  they  been  uri- 
cqached  whites.  In  contrast,  the  coached  white  students  scored' 
an  average  of  9.2  points  above  what  would  be  expected  had  they 
been  uncoached.  JEight  uncoached  bjack  students  scored  an  aver- 
age pf  18.2  points  below  their  expectation  had  they  been  un- 
coached whites  with  their  same  values  on  the  predictor  variables 
(in  this  case  psat-V,  psat-M,  and  Test  of  Standard  Written  En- 
glish). The  average  residual  score  for  the  coached  black  students 
was  thus  14  points  higher  (-3.8  vs.  -18.2)  than  that  of  the  un- 
coached blacks,  while  the  average  residual  for  the  coached  white 
students  was  0  points  higher  than  the  expected  value  for  un- 
coached whites.  Hence  there  is  little  indication  that  coaching,  at 

r  least  in  the  form  of  high  school  special*  preparation-programs  as 

opposed  to  commercial  coaching,  works  differentially  better  for 
black  students  in  the  absence  of  self-selection  effects. 

Whatever  the  basis  for  this  black  vs.  nonblack  interaction,  it 
does  not  appear  to  be  minority  status  in  general,  because  Group  1 
(Asian  Americanc.,  Hispanics,  and  other  non-black  minorities)  did 
not  yield  a  significant  interaction.  Indeed,  when  data  for  some  40 
nonblack  minority  students  were  examined,  their  individual 
coaching/self-selection  effects  bore  more  resemblance  to  those  of 
white  students  than  black  students,  with  the  Verbal  effect  being 
only  about  8  points  higher  than  the  corresponding  cell  means  on 
the  average.  Tending  to  elevate  that  average,  however,  were  8 
Asian  American  students,  4  at  School  A  and  4  at  School  B,  who 

\  exhibited  Verbal  effects  about  46  points  greater  than  their  cell 

means  on  the  average. 
\  One  possibility  is  that  the  Verbal  sat  entails  additional  dimen- 
sions of  difficulty  for  blacks,  and  possibly  for  Asian  Americans  as 
well,  tjiat  might  be  overcome  by  special  preparation— similar  per- 
haps to.tKe  test  sophistication  factor  found  by  Vernon  (1962)  in 
the  multiplc-qhoice  responses  of  British  students  relatively  unfa- 
miliar with  sucKlests,  but  not  in  the  responses  of  American  stu- 
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dents,  (This  would  be  particularly  plausible  if  some  of  the  black 
students  in  the  ftc  sample  were  nonindigenous  to  the  American 
educational  system— from  the  West  Indies,  for^xample.)  Coun- 
tering this  hypothesis,  however,  are  the  findings  of  Rock  and 
Werts  (1979),  who  compared  factor  structures  for  sat-V  and  -M 
across  Native  American,  Mexican  American,  Asian  American, 
Puerto  Rican,  black,  and  white  samples  and  evaluated  the  degree 
to  which  the  same  factors  were  being  measured  in  each  popula- 
tion. Theyconcluded  that  both  sat-V  and  -M  were  measuring  the 
same  things  across  these  populations,  in  the  same  units  of  mea- 
surement, with  equah  accuracy  as  indicated  by  equivalent  stan- 
dard errors  of  measurement.  Moreover,  on  the  average,  sat-V  cor- 
relates equally  well  with  college  performance  for  whites  and 
blacks,  asdocssAT-M  (Breland,  1979). 

Nonetheless,  differences  in  test-taking  strategies  and  in  test  so- 
phistication more  generally  might  still  be  at  the  root  of  the  Group 
2  interaction  at  Coaching  School  B,  but  it  is  difficult  to  limit  that 
interpretc^tion  to  black  vS.  nonblack  (Jifferences  per  se.  For  exam- 
,ple,  in  low-income,  inner-city  samples  that  were  75  percent 
black,  Flaugher  and  Pike  (1970)  found  more  random  responding 
on  the  PSAT  than  appeared  in  national  administratioa  samples  as 
well  as  a  tendency  for  the  more  able  students  to  omit  more  items, 
which  is  counter  to  the  usual  trend.  When  patterns  of  guessing 
and  omissions  on  the  Graduate  Record  ExaminationjA^erc  con-^ 
trasted  for  black  and  white  samples  matched  on  total  score  level, 
however,  no  differences  in  the  response  patterns  of  black  and 
white  students  were  obtained  (Pike,  1980),  suggesting  that  the 
previously  observed  patterns  might  possibly  be  characteristic  of 
low-scoring  students  in  general  rather  than  being  specific  to 
inner-city  blacks. 

In  suhi,  the  meaning  of  the  Group  1  interaction  for  sat-V  at 
Coaching  School  B  is  both  intriguing  and  perplexing.  Even  though 
It  is  based  on  only  13  students,  the  size  of  the  effect  was  quite 
large  and  highly  significant  statistically.  It  is  clear  that  well-con; 
trolled  randomized  studies  of  the  possible  differential  effective- 
ness of  coaching  or  special  preparation  for  the  sat  are  needed  to 
clarify  this  issue  and  to  draw  implications  for  practice. 
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V 

Disentangling  Coaching  Effects 
.  and  Differential  Growth: 
Detailed  Summary  of  the  Rock  Analyses 


To  recapitulate  briefly,  the  ftc  study  is  a  prctest-posttest  design 
in  which  subjects  could  not  be  randomly  assigned  to  experimen- 
tal and  control  groups.  In  the  language  of  Campbell  and  Stanley 
(1963),  it  is  a  special  case  of  a  quasi-cxjienni^tal  desig^ 
as  the  nmequivalent~c^^  Hesign"  In  tHe  true  experi- 

ment with  random  assignment  and  effective  control,  the  only 
rival  explanation  to  the  treatment  being  the  cause  of  the  results  is 
sampling  error.  However,  in  the  nonequivalent  control-group  de- 
sign, both  sampling  error,  and  possible  selection  bias  are  plausible . 
rival  hypotheses  to  account  for  the  treatment  effects  obtained. 

The  FTC  analysis  and  the  Stroud  reanalysis  both  relied  heavily 
on  the  ability  of  models  in  the  general  tradition  of  analysis-of-co- 
variance  (ancova)  to  rule  out  rival  hypotheses  by  making  linear 
adjust^pients  in  treatment  and  control  group  means  for  the  effects 
of  covarying  factors.  However,  if  growthJs  occurring  in  the  de- 
pendent variable  (that  is,  in  the  verbal  and  mathematical  abilities 
measured  by.the  sat),  then  one  of  the  key  ways  in  which  nonran- 
domized treatment  and  control  groups  might  differ  prior  to  any 
coaching  intervention  is  in  the  rate  of  this  intellectual  growth  If 
the  treatment  and  control  groups  do  differ  in  growth  rates  prior  to 
coaching  and  if  these  differential  rates  can  be  estimated  from 
time  series  data,  even  if  only  linearly  from  two  testing  occasions 
prior  to  coaching,  then  another  kind  of  adjustment  model  can  be 
employed  to  correct  for  those  self-selection  effects  embodied  in 
differential  group  growth  that  were  not  predicted  from  the  avail- 
able covariates  used  (Bryk  &  Weisberg,  1976,  1977),  Using  such  a* 
growth  model,  the  reanalysis  presented  in  this  section  shows  in 
some  detail  that  the  Verbal  data  from  the  ftc  study  indeed  display 
differential  group  growth  rates  and  tha.  estimates  of  the  coaching 
treatment  effect  are  subject  to  growth  adjustments  beyond  those 
predicted  from  available  ancova  covariates.  The  Math  data,  on 
the  other  hand,  do  not  exhibit  differential  group  growth  and  since 
the  growth  model  does  not  adjust  for  group  differences  on 
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background  variables  unrelated  to  differential  growth,  the  Math 
coaching,  effect  is  bejter  analyzed  by  ancova. 

More  specifically,  the  ftc  analysts  did  not  investigate  tl]^e  pos- 
sibility of  differential  group  growth  rates  for  coached  and  un- 
coached  students  as  a  rival  hypothesis  for  part  of  the  score  in- 
creases observed.  Campbell  fl969)  suggests  that  if  two  groups 
start  out  at;  time  1  with  divergent  means,  those  with  the  hij^er 
mean  very  likely  mature  or  grow  at  a  greater  rate  than  those  With 
the  lower  mean.  Campbell  calls  this  the  interaction  of  selectljon 
and  maturation.  The  nrc  analysis  of  the  group  demographic  varia- 
bles provides  evidence  that  coached  students  represent  a  sejf-se- 
lected  population  different  from  uncoached  studeuts  in  a  number 
of-ways^n(^luding  having  higher  mean  pretest  scores.  The  differ- 
»ent  groups  ^rc  members  of  different  populations  living  in  differ- 
cnt  environments.  The  different  environments  interact  with  dif*' 
ferences  in  ability,  to  create  and  maintain  different  levels  of 
performance  and  different  rates  of  growth,  suggesting  that  the  use 
of  a  statistical  model  incorporating  differential  group  growth 
rates  is  called  for. 

An  interrupted  time  series  design  comprising  three  data  points 
was  used  to  estimate  the  relative  growth  rates  of  coached  and  un- 
coached groups  during  a  period  prior  to  the  formal  coaching  inter- 
vention. That  i&>  the  following  design  used  observations  (O)  of 
test  performance  at  time  to  and  time  ti  to  estimate  growth  rate  in 
the  absence  of  a  formal  intervention  (I)  for  both  the  treatment 
group  (P)  and  control  group  (C).  F(5rtunately,  the  majority  of  indi- 

Coaching  Program  Group  (P)     Oo .       Oi    I  O2 


Control  -  (C)     Oo        O,      ^  O2 

to  t,       *  t2 

v'iduals  who  attended  the  most  successful  coaching  school 
(Schqol  A)  had  three  testing  sessions,  with  a  coaching  interven- 
tion taking  place  between  time  ti  and  t2. 

Figure  V-1  presents  means  and  standard  deviations  of  the  Ver- 
bal test  scores  at  three  points  in  time.  Similar  data  are  presented 
for  Math  test  scores  in  Figure  V-2.  The  three  testmgs  consisted  of 
the  PSAT,  the  sat  taken  for  the  first  ^ime  in  April  as  a  junior,  and 
the  SAT  taken  for  the  second  time  in  November  as  a  senior.  Only 
one  of  the  three  coaching  schools  in  the  ftc  data  set  had  a  large 
enough  student  population  to  burnish  sufficient  subjects  with  all 
three  data  points.  The  coached  sample  included  192  individuals 
while  the  control  sample  numbered  684.         •  4 
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Figure  v-;l 

Verbal  Gains  OvcrThrcc.Time  Periods  for  Four  Populations 

The  pattern  of  verbal  data  in  Figure  V-1  suggests  that  the  ob- 
served group  differences  at  posttest  may  well  be.reflecting  differ- 
ential growth  rates  as  well  as  treatment  effects.  Not  only  is  the 
classic  growth  phenomenon  of  increasing  means  demonstrated  in 
Figure  V-1  for  both  the  coaching  program  students  and  the  con- 
trols, but  it  can  be  seen  that  the  slope  of  the  line  from  the  psat  ad- 
ministration (to)  to  the  first  sat  administration  (t,J  is  considerably 
steeper  for  the  coached  group  than  for  the  control  group.  The  dif- 
ference in  mean  score  from  to  to  t|  for  the  coached  group  is  22 
points  while  the  difference  for  the  unooa^ed  control  group  is  10 
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Figure  v-2 

Math  Gains  Over  Three  Time  Periods  for  Four  Populations 

points-^  discrepancy  of  12  points.  On  the  other  hand,  while 
there  appear  to  be  significant  differential  group  growth  rates  in 
the  Verbal  area,  this^does  not  seem  to  be  the  case  for  Math  (see 
Figure  V-2).  This  is  not  unreasonable  since  mathematics  is  a  skill 
which  requires  practice  if  students  intend  to  maintain  or  increase 
their  level  of  achievement.  In  sAT-Math,  the  slopes  of  the  lines  for 
coached^and.control  groups  are  nearly  parallel,  with  the  mean  dif- 
ference in  Math  score  from  to  to  t,  for  the  coached  group  only  3 
points  larger  than  that  for  the  control  group. 
In  addition,  mean  scores  for  the  national  College  Board  sat 
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-sample  tested  in  April  of  the  junior  year  (tj^ind  retesfed  in  No- 
vember [ti]  of^the  senior  year  are  also  plotted  in  Pigures  V-1  and 
V-2.  These  plots  represent  the  1975  and  1976  populations.  Inspec- 
tion of  the  verbal  plQts  (Figure  V-1)  suggests  that  gains  of  12  to  17 
points  from  April  to  November  appear  to  be  commonplace  for 
junior  to  senior  retesters-  The  fact  that  the  control  sample  shows  ^ 
a  gain  of  11  points  over  the  Same  interval  from  t,  to  u  suggests 
that  they  are  reasonably  representative  pf  junior  to  senior  retest- 
ers/Similarly,  in  Figure  V-1,  the  April  to  November  gain  in 
SAT-Math  foi^the  control  group  is  consistent  with  the  17-point 
gam  for  the  1975  and  1976  junior  to  senior  retestcrs  in  the  nation- 
al sample.  The  control  group's  rate  of  gain  is  consistent  and  linear 
over  both  plotted  time  periods  to  to  ti  and^i  to  ii. 

An  adjustment  index  may  be  derived  from  these  data  which 
takes  into  consideration  differential  group  growth  rates  in  the  ab- 
sence  of  formal  intervention.  If  the  C9ached  group  grows  at  a 
faster  rate  than- the  control  group  prior  to  intervention,  as  might 
be  expected  by  virtue  of  its  higher  initial  mean  score,  the  adjust- 
ment index  lb*)  m  the  growth  model  is-greater  than  unity,  in  con- 
trast to  the  adjustment  index  (b)  in  the  traditional  ancova  model 
for  test-retest  data  which  is  typically  somewhat  I'^ss  than  unity. 
Using  adjustment  indices  derived  from  the  ftc  data,  treattnent  ef- 
.  fects  were  estimated  for  the  growth  model  and  contrasted  with 
the  effects  obtained  from  the  standard  ancova  model. 

Table  V-d  presents  ancova  and  growth-model  adjustment  in- 
dice3  and  coaching  effects,  as  well  as  the  mean  growth  rates  for 
t*he  coached  and  control  students  for  Verbal  and  Math.  These  esti- 
mates of  growth  are  based  on  the  time  period  between  the  first 
and  second  testmg  (to  tati)  and  thus  are  not  confounded  with  the 
coaching  intervention.  The  estimates  of  growth  rates  assume  lin- 
earity of  growth,  which  would  seem  to  be  a  reasonable  assump- 
tion given  the  restricted  time  period^and,  even  mere  importantly, 
given  that  the  observed  data  for  the  control  group  on  both  Verbal 
and  Math  conform  quite  closely  to  a  linear  growth  model.  If  one 
were  lo  expect  a  deviation  from  linearity,  it  would  more  likely  be 
m  the  direction  of  a  steeper  slope  (in  the  absence  of  intervention) 
between  the  second  and  third  testing  since  the  motivational  level 
*  vyould  be  at  least  as  great  during  this  time  period  as  in  the  previ- 
ous timejeriod  between  taking  the  psivr  and  the  junior-year  sat. 

The  estimates  of  the  coaching  effect  under  the  growth  model 
are  about  17'points  on  Verbal  and  31  pointson  Math.  This  .finding 
that  the  Verbal  effect  is  substantially  less  than  the  Math  effect  is 
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in  marked  contrast  to  the  ancova  estimates  of  quite  comparable 
V  and  M  effects.  The  growth  model  appears  to  yield  an  estiniate 
of  the  Verbal  coachmg  effect  that  is  more  consistent  with  earlier 
studies  and  with  exj  ctations  that  Math,  bemg  generally  more 
curriculum  related  than  Verbal,  might  be  more  responsive  to 
coaching  or  special  preparation. 

The  results  for  SAT-Verbal  in  Table  V-1  call  into  question  the 
adequacy  of  the  standard  ancova  to  correct  for  selection  effects^ 
when  they  are  present  in  the  form  of  differential  group  growth 
rates  not  predicted  from  available  covariates.  The  ancova  adjust* 
ment  mdex  (b)  is  approximately  1.0  for  the  Verbal  data  and  some- 
what paradoxically  1.25  for  the  Math  data,  which  is  the  one  situa- 
tion displaying  little  or  no  evidence  of  differential  groxip  growth 
However,  since  the  growth  rates  appear  to  be  static  for  the  Math 
data,  the  ancova  model  is  probably  the  more  defensible  approach 
for. estimating  the  coaching  effect  for  Math  because  ancova  con- 
trols for  all  available  measures  of  pre-existing  difference,  not  just 
those  related  to  differential  growth. 

In  summary,  then,  examination  of  testings  at  three  points  in 
time  suggests  that.  (1)  the  traditional  ancova  approach  used  by 
the  FTC  is  inadequate  for  the  Verbal  data  because  of  self-selection 
effects  which  are  at  least  partially  captured  in  differential  group 
growth  rates,  (2)  a  more  appropriate  growth-related  adjustment 


Table  V-1 

Mean  Growth  Rates,  Adjustment  Indices,  and  Estimated 
Coaching  Effects  Under  Different  Mode)  Assumptions 


Verbal 

Prograrh 

Control 
Mathematics 

Program  . 

Control 


Growth  Rate" 
lVoun%/Mimih} 


3.294 
1.654 

2,354 
2.048 


AJntsiment  Imhce^ 
and  Their  Buinuuc<  oj  OuiChtn^  Effects* 

Orci^th  M(h!c1  am  ova 


1.485   16.946      .993  28.065 


1.102  30.558     1.252  27.625 


'The  lAvira);*;  in  p<»tni\  |Hr  month  in  csnmau'J  »n  ihj:  ;ihscncc  «f  intcrvcniitm 
Crowth  irnM  cstimaus  ht  and  a?  an.  ihi.  aJuisMiicni  index  and  ihc  isdnuud  cffm 
based  on  the  Xf"^>p rate  cMimato  in  ihi  titst  (.dUtmn  The  ancova  cst.mau'i 
■»rc  ihc  Mandard  isnmaus  arrived  it  usin^  iht  lisi  ot  onirol  variables  prcscnud  in 
Tabic  Appvndix  I  Ihi  amova  b,  is  iht  nit  aJuisinuni  index,  when  Hscd  in  ihi 
mu.i!  AM  OVA  iquaium  it  yields  Ihc  effect  eMim<iiC3| 
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model  yields  Verbal  coaching  effects  about  one-half  the  size 
reported  by  the  rrc;  and,  (3)  the  Math  data  are  more  consistent 
with  the  ANCOVA  model.  Thus,  the  resulting  rrc  estimate  of  the 
coaching  effect  in  Math  is  more  likely  to  be  reasonable  given  the 
available  control  variables  than  is  the  growth  model  estimate, 
since  the  latter  does  not  adjust  for  group  differcn9es  in  back- 
ground variables  unrelated  to  growth.  This  is  not  to  say  that  the 
FTC  estimates  of  the  Math  coaching  effect,  as  well  as  those  of  the 
present  analyses,  are  not  overestimates  (or  underestimates),  since 
the  only  self-selection  causes  that  have  been  adjusted  for  were 
those  reflected  m  differential  growth  rates  and/or  available  demo- 
graphics. 
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VI 


implitations  for  Educational  and 
Testing  Policy  and  Practice 


In  summary,  the  ftc  $tudy^ commercial  coaching  found  negli- 
ble  effects  for  student^  attenHiTig^Qne  coaching  school  and  com- 
bined coaching  and  self-selection  effects  otabout  20  to  30  points 
on  both  SAT-V  and  -M  f(^r  students  at  another  schooL^The  reanajy- 
sis  by  TW.F.  Stroud,  using  a^more  sophisticated  analy^^is^f^ 
covariance  design  and  all  three  coaching  schools  in  the  ftc  dJt? 
set,  yielded  similar  overall  results:  combined  coaching/self-selec- 
tion effects  in  the  neighborhood  of  20  to  35  points  for  both  sat-V 
and  -M  at  one  school  andlinconsistent  and  negligible  effects  at  the 
other  two  schools.  The  effects  due  to  coaching  per  se  at  the  one 
apparently  effective  schopl  are  probably  lower  than  this,  how- 
ever, because  of  the  confo;anding  with  self-selection  factors  that 
influence  both  attendance  at  that  coaching  school  and  perfor- 
mance on  the  posttest  sat.  As  we  have  seen,  for  example,  when 
factors  related  to  differential  group  growth  rates  in  the  treatment 
and  control  groups  wer«  taken  into  account  in  the  reanalysis  con- 
ducted by  D.A.  Rock,  the  combined  coaching/self-selection 
effect  for  sat-V  dropped  to  about  17  points  while  that  for  sat-M, 
which  did  not  exhibit  diffei;ential  group  growth  rates  in  these 
data,  remained  at  about  30  points.  But  it  is  impossible  to  deter- 
mine with  any  confidence  whether  the  effects  obtained  in  the  ftc 
study  may  be  attributable  in  whole  or  part  to  uncontrolled  self- 
selection  factors  rather  than  t<}  any  impact  of  jhe  coaching  pro- 
gram as  such.  1  \ 

Thus,  overall,  the  ftc  study  aijpears  to  reveal  considerable  vari- 
ability in  the  coachingAelf-seTection  effects  associated  with 
coaching-school  attendance]  wit^  an  estimated  combined  effect 
for  students  at  one  school  of  5bout  20  to  30  points  on  SAT-Math 


and  very  likely  about  half  to 


tworthirds  that  (as  reflected  in  cor- 


rections for  differential  groud  groW^th  rates)  on  sat- Verbal.  In  addi- 
tion, the  sporadic  emergence  of  significant  interactions  indicates 
that  particular  types  of  students,  such  as  those  highly  motivated 
to  achieve,  or  students  witi  particular^ cultural  backgrounds, 
such  as  blacks  or  Asian  Ankericaris,  might  sometimes  exhibit 
larger  score  increases  in  sorne  conimercial  coaching  programs 
Further  research  is  needed  on  this  problem  since  the  samples  of 
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blacks  and  other  minorities  in  the  ftc  study  were  exceedingly 
small  and  somewhat  atypical.  On  balance,  however,  the  overall 
findings  for  commercial  coaching  appear  generally  consistent 
with  the  results  of  prior  studies  on  the  effectiveness  of  special 
preparation  programs  offered  by  hi{;h  ""schools,  especially  the 
longer  and  more  intensive  ones.  ^ 

To  pursue  this  latter  conclusion  in  more  detail,  let  us  inquire 
how  the  results  of  the  ftc  reanalyses  jibe  with  the  rankings  of 
prior  coaching  studies  in  regard  to  student  contact  time  and  mag- 
nitude of  score  effects,  as  summarized  in  Table  II-3.  The  coaching 
progiam  at  School  A  in  the  ftc  study  entailed  40  hours  of  student 
contact  time  while  that  at  School  B  involved  24  hours.  If  it  is 
assumed  that  roughly  half  that  time  in  each  case  was  devoted  to 
Verbal  coaching  and  half  to  Math  coaching,  then  the  Verbal  stu- 
dent contact  time  of  School  A  would  receive  a  rank  of  8  when 
added  to  the  rank-order  correlations  of  Table  II-3,  while  the  asso- 
ciated Verbal  combined  coaching/self-selection  effect  (using  the 
weighted  average  of  estimates  from  Table  IV- 1)  would  receive  a 
rank  of  7.  The  rank  for  the  Math  student  contact  time  at  School  A 
would  be  5,  while  that  for  the  associated  Math  combined  coach- 
ing/seif-seleetion  effect  would  be  4.  The  corresponding  valuer  for 
School  B  would  be  rank  10  for  Verbal  student  contact  time  and 
rank  13  for  combined  sat-V  effect,  and  rank  7.5  for  Math  student 
contact  time^and  rank  11  for  combined  sat-M  effect  The  consis- 
tency in  thu&e  associated  ranks  between  student  contact  tirne  and 
magnitude  of  combined  coaching/self-selettion  effects,  espe- 
cially for  School  A  where  the  associated  ranks  differed  by  only 
one  ordinal  position,  suggests  that  the  rrc  results  are  of  a  compar- 
able order  vyith  the  results  of  prior  studies.  With  the  values  for 
School  A  incluJed,  the  niw  t:orrelations  between  rank-order  of 
student  contact  time  and  rank-order  of  score  effect  are  .77  for 
.SAT-V  across  18  studies  and  78  for  sat-M  across  11  studies.  Fur- 
ther, if  the  statistically  unreliable  values  of  School  B  are  added, 
the  new  correlations  become  J7 jlox  sat-V  across  19  studies  and 
,74  for  SAT-M  across  12  studies.  «  .  * 

If  It  were  to  be  shown  that  relatively  intensive  coaching  could 
substantially  improve  scores  for  some  students  on  the  sat,  this 
would  have  important  implications  for  both  educational  and  test- 
ing practice.  In  considering  what  these  policy  implications  might 
be.  It  would  be  important  to  know  whether  any  increased  test 
scores  attributable  to  coaching  represent  stable  improvements  in 
the  verbal  and  mathematical  reasoning  abilities  measured  by  the 
SAT  or  whether  they  reflect  improved  facility  in  overcoming  inad- 
vertent sources  of  test  difficulty  unrelated  to  these  reasoning  abil- 
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ities,  such  as  difficulty  associated  with  test  anxiety  or  unfamiliar- 
ity  with  different  item  formats  or  test-taking  strategies.  The  for- 
mer case  would  threaten  neither  the  interpretive  validity  nor  the 
predictive  utility  of  the  sat,  for  any  genuine  long-term  improve- 
ments in  the  abilities  measured  should  lead  to  score  increases  and 
should  also  serve  the  student  well  in  coping  with  the  demands  of 
college  learning;  which  typically  entail  the  same  kinds  of  verbal 
and  quantitative  reasoning  by  analogy,  induction,  and  deduction 
as  are  measured  by  the  sat.  The  latter  case,  by  virtue  of  pointing 
to  construct-ii:relevant  test  difficulty,  has  double-edged  implica- 
tions. If  improved  test  wiseness  increases  test  scores  that  were  in- 
accurately low  because  of  construct-irrelevant  difficulty,  a  more 
accurate  assessment  of  ability  level  would  result  and  the  predic 
tive  value  of  the  test  should  be  enhanced.  On  the  other  hand,  if 
improved  test  wiseness  leads  to  test  scores  that  are  inaccurately 
high,  the  interpretive  validity  of  the  test  would  be  diluted  and  its 
predictive  validity  jeopardized.  In  any  particular  instance,  of 
course,  some  combination  of  improved  abilities  and  improved 
test  wiseness  might  contribute  to  improved  test  performance. 

None  of  the  studies  of  coaching  or  special  preparation  con- 
ducted so  far  has  systematically  addressed  this  issue  of  improved 
abilities;  rather,  they  have  all  focused  on  the  prior  issue  of  first 
identifying  any  score  increases  associated  with  coaching  pro- 
grams before  inquiring  into  their  causes;  This  second  step  has 
never  been  taken  and,  as  a  consequence,  at  this  point  we  can  only 
conjecture  as  to  the  likelihood  that  obtained  score  increases  re- 
flect improved  reasoning  skills.  On  the  one  hand,  the  verbal  and 

•AlihouKh  no  coaching  study  lui&  directly  dddrcsscd  this  basic  question  of  wheth- 
er score  increases  reflect  improved  abihties  or  increased  test  wiseness,  Marron 
(19651  did  broadi  the  issue  indirectly  by  investigating  the  extent  to  which  sat 
scores  after  special  instruction  predicted  freshman  class  standings  at  the  U  S 
service  academies  and  at  selective  colleges.  Tins  appraisal  is  indirect  because  it 
requires  not  only  that  the  verbal  and  mathematicijl  reasoning  abilities  be  im 
proved  by  instruction  but  that  they  be  effectively  utilized  in  college  perfor- 
mance^ whereas  there  are  numerous  countervailing  factors,  athletics  and  extra 
curricular  activities  among  them,  that  contribute  to  schMasric  underachieve- 
inent.  Thus,  high  correlations  would  provide  positive  evidence  that  increased 
test  scores  rellect  improved  abilities  being  well  utilized  m  cbllege  performarice, 
but  low  correlations  would  constitute  negative  evidence  only  if  plausible  rival 
explanations  lor  poor  academic  performance  could  be  disco  inted  As  a  further 
complication,  relatively  crude  and  approximate  methods  o  equ.lting  were  re- 
quired in  Marron's  study  to  obtain  some  semblance  of  distribitional  comparabd 
Ity  across  the  service  academies  and  across  the  widely  diverse  colleges  that  the 
preparatory  students  dispersed  tii,  thereby  rendering  the  ofutcome  *idmittedly 
tenuous  Nonetheless,  the  findings  suggest  that  at  the  service  academies  the  stu 
dents  did  less  well  acad^ically  than  the  test  scores  predicted,  whereas  at  the 
selective  colleges  the  dMbutions  of  class  standings  and  test  scores  did  ''not 

Jiccm  to  be  inconsistent"  (p.  22[ 
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mathematical  reasomng  abilities  measured  by  the  sat  develop 
over  many  years  of  experience  and  use  in  nonschool  and  school 
settings,  and  it  is  difficult  to  improve  them  markedly  with  short- 
term  interventions  in  late  adolescence  or  young  adulthood.  On 
the  other  hand,  the  more  productive  special  preparation  programs 
were  relatively  intensive— the  one  commercial  coaching  school 
where  students  exhibited  significant  average  effects,  for  exarnple, 
involved  10  four-hour  sessions  plus  homework,  which  is  about 
the  equivalent  of  a  one-semester  college  course.  And  the  effect  on 
scores,  while  valued,  was  not  marl^ed.  Whether  due  to  coaching 
or  other  factors,  20  score  points  or  so  on  a  score  scale  ranging 
from  loO  to  800  with  a  standard  deviation  of  100  amounts  to^ 
fewer  than  three  additiorial  items  correct.  It  is  thus  quite  consis- 
tent with  the  notion  of  gradual  development  of  reasoning  abilities 
to  argue  that  intensive  study  over  many  sessions  might  yield 
modest  but  genuine  improvements  in  reasoning  skills. 

It  would  be. important  to  investigate  whether,  and  to  what  ex- 
tent, coaching  or  intensive  special  preparation  programs  may  lead 
to  improved  abihtics  and,  in  any  event,  to  consider  how  secon- 
dary schools  might  be  able  to  improve  their  students'  academic 
abilities  over  the  longer  hauL  Since  reasoning  abilities  facilitate 
educational  accomplishments,  school  programs  stressing  ability 
development  as  well  as  subject-matter  learning  should  have  a  syn- 
ergistic effect  on  current  and  subsequent  educational  achieve- 
ment. The  verbal  and  mathematical  reasoning  abilities  measured 
by  the  Si^T  are  related,  after  all,  not  only  to  college  performance 
but  to  high  school  performance  as  well.  The  function  of  the  sat  is 
to  measure  validly  and  uniformly  across  different  groups  and  dif- 
ferent settings  the  current  level  of  developed  Scholastic  abilities 
fdcilitative  of  academic  learning,  in  an  effort  to  improve  the  accu- 
racy of  forecasting  subsequent  academic  performance  at  the  col- 
lege level.  Whether  the  current  level  of  developed  abilities  facili- 
tative  of  college  learning  derives  in  part  from  intensive  special 
preparation  programs  pointed  toward  test  performance  or  from 
long-term  general  preparation  programs  pointed  toward  school 
attainment  or  from  extensive  experiential  learning  in  nonschool 
settings— that  is,  from  coaching  or  instruction  or  experience— is 
indistinguishable  to  the  sat.  The  issue  of  equity  of  access  to 
coaching  programs  that  are  effective  by.  virtue  of  ability  develop- 
ment, if  such  could  be  identified,  is  thus  similar  to  the  issue  of 
equity  of  access  to  effective  school  programs  or  effective  life  expe- 
riences. Thus,  coaching  or  special  preparation  programs  produc- 
ing increased  test  scores  by  improving  the  abilities  measured 
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would  have  important  implications  for  educational  practice  and 
social  policy. 

In  contrast,  if  coaching  or  special  preparation  programs  may 
lead  to  substantially  increased  test  scores  without  improving  the 
abilities  measured,  there  are  important  implications  for  testing 
practice.  Such  an  outcome  would  imply  that  the  test  or  the  test- 
ing experience  entails  unintended  sources  of  difficulty,  such  as 
anxiety  over  being  evaluated  or  unfamiliarity  with  different  item 
formats  or  test-taking  strategies,  that  can  be  o>^.ercome  by  special 
preparation.  Issues  of  equity  of  access  to  such  special  preparation 
become  important  to  the  extent  that  individual  differences  in 
test-taking  skills  per  se  influence  test  scores.  t 

Although  one  might  expect  the  typical  coaching  program  to 
reduce  unfamiliarity  by  drilling  the  student  in  different  ap- 
proaches to  different  item  formats  and  to  allay  anxiety  by  provid- 
ing feedback  on  effective  item  performance,  the  fragmentary 
research  evidence  suggests  that  if  this  is  all  that  is  done  the 
coaching  will  have  little  impact  on  test  scores.  The  coaching  or 
spegial  preparation  programs  that  emphasize  drill-and-practice 
appear  to  be  associated  with  small  effects,  if  any,  whereas  pro- 
grams that  include  skill-development  cojnponents  tend  to  be 
associated  with  larger  effects  (which,  by  and  large,  seem  to  occur 
more  for  Math  than  for  Verbal).  Nonetheless,  following  accepted 
principles  of  good  test  practice,  te§t  makers  should  strive  to 
reduce  construct-irrelevaht  test  difficulty  wherever  possible— for 
example^by  Avoiding  arcane  item  types,  complicated  instruc- 
tions, esoteric  or  culture-specific  content,  undue  speededness, 
and  the  like.  Substantial  efforts  should  also  be  made  routinely  to 
increase  test  familiarization  and  test  wiseness,  such  as  the  Col- 
lege Board  has  done  by  distributing  a  sample  sat  and  answer  key 
to  all  candidates  along  with  strategic  advice  in  the  booklet  Taking 
the  SAT  With  well-made  tests  the  concern  5s  not  that  students 
will  learn  how  to  capitalize  on  extraneous  climes  to  inflate  their 
test  scores,  for  such  clues  should  be  rare  and  are  .further  reducible 
^through  test  analysis,  but  rather  that  students  learn  to  cope  most 
advantageously  with  the  test  as  a  standardized  vcihicle  for  demon- 
strating their  abilities.  To  ensure  the  fairness  0/  the  admissions 
testing  process,  then,  test  makers  should  attempt  to  make  clear 
to  all  prospective  test  takers  what  the  test  measures,  what  kinds 
of  items  and  formats  will  be  encountered,  and  what  kind  and 
level  of  preparation  the  test  presupposes,  as  well  as  providing 
j)ractice  materials  and  advice  on  effective  test  taking.  This  should 
be  done  not  Just  to  minimize  the  effects  on  test  scores  of  student 
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differences  in  this  regard,  but  to  increase  the  validity  of  the  test 
and  to  enhance  the  value  of  the  testing  experience  for  each  indi- 
vidual. 

Finally,  what  advice  does  all-.this/imply  for  the  prospective  sat 
taker?  If  this  advice  were  based  mainly  on  a  summary  of  the  re- 
search findings  as  best  we  can  interpret  them  at  this,  point,  the 
student  might  be  told  something  like  this: 

The  verbal  and  mathematical  reasoning  abilities  measured  by  the 
SAT  develop  over  years  of  experience  and  use  both  within  and  out- 
side .of  school.  In  preparing  for  the  test,  a  review  of  mathematical 
concepts  may  be  beneficial,  especially  for  students  not  currently 
enrolled  in  mathematics  courses. 

Studies  of  the  effects  of  drill-and-practicc.on  sample  items  or  of 
last-minute  crammmg  show  little  score  increase,  although  such 
practice  may  serve  to  familiarize  the  student  with  different  item 
formats  and  to  reduce  apprehension  about  what  to  expect.  The  Col- 
lege Board  distributes  test-familiarization  materials  to  all  candi- 
dates and  recommends  that  they  take  the  sample  sat  provided, 
carefully  review  the  answers,  and  read  the  booklet  on  Taking  the 

'  SAT. 

Studies  of  students  attending  special  preparation  programs  avail- 
able in  many  high  schools  show  a  range  of  effects  averaging  less 
than  10  score  points  on  Verbal  and  less  than  15  points  on  Math  for 
programs  rcquirmg  an  average  of  about  20  hours  or  so  of  total  stu- 
dent contact  time.  Part  or  allof  th«sescorc  increases  may  b^  due  to 
factors  ottier  than  the  special  prcpkation  program  offered,  such  as 
the  level  of  motivation  or  prio^cducational  experience  of  the  stu- 
dents. And  individual  students  or  qcrtain  groups  or  types-of-  slu* 
dents  might  tatgcriencc  larger  increases  or  possibly  even  losses. 

A.  rcccntitstu^  of  students  enrolled  in  commercial  coaching 
courses  shows  v^iability  in  average  score  improvement  depending 
on  which  course  the. students  attended,  negligible  effects  were 
found  for  students  attending  two  of  ithc  three  coaching  schools 
studied,  while  average  effects  in  the  2(^-  tb  30-point  range  for  Math 
and  perhaps  half  to  two-thirds  that  for  yerbal  were  associated  with 
attendance  at  the  third  school,  which  entailed  about  40  hours  of 
total  student  contact  time.  Even  for  students  attending  this  latter 
school,  however,  it  was  not  at  all  clear  \vhat  proportion  of  the  score 
increases  was  due  to  coaching  experiences  as  such  rather  than  to 
motivational  and  other^  background  characteristics  typical  of  the 
students  taking  that  course.  Again,  intiividual  students  or  certain 
groups  or  types  of  students  might  experience  larger  increases  or  pos- 
sibly cvcn11)ssc5.  '  {  * 

There  have  been  no  systcrriatic  studies  comparing  the  relative 
effectiveness  of  different  types  of  coaching  programs,  whether  they 
be  commercial  or  school-based,  let  alone  their  relative  effectiveness 
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for  particular  groups  or  types  of  students,  but  the  larger  score  effects 
.  appear  generally  to  be  associated  with  longer-term  intensive  pro- 
grams emphasizing  skill  development  in  verbal  and  mathematical 
reasoning. 

In  any  event,  whether  due  to  coaching  or  to  personal  factors, 
score  increases  of  20  to  30  points  on  a  200-  to  800-p^9int  scale  corre- 
spond to  approximately  three  additional  items  correct,  and  compar- 
able or  larger  effects  might  be  obtained  if  students  were  to  devote 
the  same  level  of  effort  on  a  regular  basis  to  classroom  instruction 
and  independent  study. 

Although  further  research  is  needed  to  clarify  the  nature  of  the 
relationship,  it  seems  very  likely  that  improvement  of  the  com- 
prehension and  reasoning  skills  measured  by  the  sat,  when  it 
occurs,  is  a  function  of  the  time  and  effort  expended.  Further- 
more, each  additional  increase  in  ability  may  require  increasing 
amounts  of  time  and  effort,  probably  geometrically  increasing 
arhounts.  But  since  the  time  required  to  achieve  average  score  in- 
creases greater  than  20  to  30  points  or  so,  especially  in  Verbal, 
-may  rapidly  approach  that  of  full-time  schooling,  the  soundest 
long-range  mode  of  preparation  for  the  sat  would  appear  to  be  a 
secondary-school  program^emphasizing  the  development^  of 
^Tthbught lis  wHlas  Knowledge . 
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J  Appendix  n 

Critical  Notes  on  the  Ftc  Coaching  Study 


CriticalNptcs  pn  the  FTC  Coaching  Study 


DoNAfcO  L.  Aldernjan,  November  16',  1979 


Staff  Memoian4um  of  the  Boston  Regional  Office  (bro)- 

The  disclaimers  and  reservations  attached  to  the  Boston  memo- 
randum make  it  quite  clear  that  the  Federal  Trade' Commission 
|ftc)  itself  found  serious  fla^s  in  this  staff  report.  Yet  it  may  be 
useful  to  enumerate  those  criticisnris  as  well  as  to  offer  further 
comments  on  specific  detaifs  sii^ce  the  "revised  statistical  analy- 
ses" conducted  by  the  ftc's  Bureau  of  Consumer  Protection  (bcp) 
in  Washington  accepts  the  data-set  and  r£peat3  several  assump- 
tions  of  the  Boston  memorandum. 

The  note  on  the  cover  of  the  Boston  memorandum  goes  further 
Ihan  ustial  disclaimers  in  stating-^haf  '^the^Commission  specifi- 
cally believes  that  some  pf  the  conchisions  in  the  stud y^  are  not 

>  supported  by  the.^dence  obt'^ined  in  the  investigation."  This 
strong  disavowal  of  certain  conclusions  may  be  attributed  to 
"several  major  flaws  in  the  dataa^alysis,"  quofng  from  the  bcp's 
notice  td  recipients  of  the  Bosto^  memorandurti.  The  notice  cites 
four  specific  flaws:  (1)  comparisons  are  made  "for  groups  of 
'coached  and  uncoached  students  without  controlling- for  differ- 
ences which  may  exist  in  personal  and  demographic  characteris- 
tics of  tthe  students  in  the  two  groups;"  (2)  failu/e  ''to  provide  a 
tests  of  statistical  significance  which  are  necessary  .to  interpret 
the  results"  (i.e.,  whether  differences  may  simply  be  due  to 
chance  occurrences  rather  than  treatment  effects);  (3)  defects  that 
concern  "the  method  used  to  present  the  findings  from  the  data 
analysis"  (e.g.,  discussion  of  results  in  terms  of  a  nonexistent 
subpopulation  of  students);  and,  (4)  "all  the  limitations  associ- 
ated with  (a  nonexperimentitl  design]." 

These  points  stressed  by  th}?  ftc  focus  on  the^statistical  analy- 
sis and  give  inadequate  attention  to  the  data  editing  which  neces- 
sarily took  place  prior  to.  the  sVage  of  statistical»analysis.  More- 

~"6v~ei7The,subsequent  bcp  report  repeat^several  weak  assumptions 
made  in  the  Boston  memorandum.      x  75 
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Assumptions  and  Data  Analysis 

These  additional  comments  concern  some  of  the  bro's  assump- 
tions and  some  of  the  steps  taken  in  constructing  the  final  data  ^ 
base.  But  the  design  of  the  study  would  itself  preclude  any  defini- 
tive conclusions.  Numerous  alternative  explanations  exist  for 
any  differences  in  the  test  performance  of  the  two  comparison 
groups  (i.e.,  ''coache^'d"  and  "uncoached'^j  since  students  in 
these  groups  differ  markedly  on  key  demographic  characteristics 
(see  Table  1  of  the  bcp's  report,  pp.  8-11).  And  the  statistical  anal- 
yses undertaken  in  the  bro  memorandum  exacerbate  these  initial 
group  differences  by  ignoring  them.  Nevertheless,  I  offer  a  few 
additioifal  comments; 

•  Scope  of  inferences, The  bro  me  norandum  assumes  that  ''valid 
inferences  about  the  coachability  of  othqr  examinations  can  be 
drawn  from  the  specific  results  we  obt^  for  the  sat  and  lsat." 
Given  the, pre-existing  differences  evident  in^the  comparison 
groups,  there  is  not  even  a  strong  basis  for  inferences  about  the 
SAT  and  LSAi  let  alone  any  other  examinations.  Indeed,  the 
results  themselves  show  inconsistencies  across  test  adminis- 
trations, commercial.schools,  and  examinations. 

•  Repxesenttiti\ e  sample^  The  enumeration  of  the  study's  as- 
*    sumptions  (bro  memorandum,  p.  49)  begins  with  a  statement 

concerning  the  sample's  representativeness  of  the  entire  sat 
and  LSAT  candidate  populations.  Although  the  control  group . 
was  a  random  sample  drawn  from  history  files,  the  "coached" 
group  i^  obviously  very  different  from  the  population  of  candi- 
dates (see  Table  1  of  Bcr's  report).  The  release  of  bro's  technical 
appendix^'saQ,"^:ivhich-giV£S  demograRhic^profifes  b>^ compari- 
son group,  should  confirm  the  weakness  of  this  assumption . 

•  Consistency  of  treatment  effects.  Another  assumption  was 
that  the  "coaching  school  (effect)  is  consistent  during  the 
study  perigd  (p.  49)."  Certainly  the  consistency  of  treatment 
effects  acoss  schools  or  test  administrations  should  be  an  open 
question  subject  to  investigation  rather  than  conjecture  br 
assumption. 

•  Treatment  self-selection  and  control  contamination.  The 
strangest  assumption  made  in  the  bro  memorandum  is  that 

,  "the  effect:;  of  cnrollce  self-selection,  if  any,,  and  of  coaching  of 
presumably  uncoached  stud^ts  offset  one  another  (p.  49)" 
Th(^re  is  no  way  to  estimate  the  extent  of  treatment  contami- 
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nation  in  the  control  group  since  there  were  no  data  collected 
on  this  issue,  and  the  bro  mernorandum  made  no  attempt  to 
identify  a  component  of  score  change  which  might  b J  attrib- 
uted to  self-selectidn  in  the  treatment  group.  Yet  the  statement 
appears  that  these  unknown  and  unspecified  effects  offset  one 
another.  , 

•  Data  Bditing.  The  steps  which  led  from  tl^e  ets  tapes  and  the 
commercial  schools'  enrollment  rosters  to  a  final  data  base 
were  difficult  to  follow  in  the  bro  memorandum.  If  my  recon- 
struction  of  these  steps  is  accurate,  substantial  numbers  of  stu- 
dents enrolled  in  commercial  coaching  coarses  were  ommittcd 
from  the^inal  data  base: 

Number  of  Students 

LSAT  SAT 


Enrollment  in  commercial  course.  

Matches  with  ets  test  files   

Students  with  results  from  one  or  two  test 
administrations  

Students  with  cpa  (lsat)  or  psat  (sat)  

Students  with  known  sex  and  ethnicity . ,  . 
Final  "study  group"  in  treatment  (coached) 
condition   >. »  « . . . . 


n,<^06  2,286 
9,029  1,777 

6,894 
4,662 
2,830* 

3,509*  603 


Such  sizeable  losses. (and  gains!)  raise  questions  about  possible 
changes  in  the  nature  of  the  sample  at  each  step  of  the  data  edit- 
ingrjthas  already  been  noted  elsewhere  that  the  number  of  com- 
mercial school  enrollees  without  sat  testing  histories  seems  high 
(1^  =  509).  But  the  reduction  in  sample  size  from  the  number  of 
cases  with  testmg  histories  to  the  final  "study  group"  is  twice  as 
large. 


Revised  Statistical  Analyses 
of  the  Bureau  of  Consumer  Protection 

The  BCP  report  is  a  much  stronger  technical  document  than  the 
BRO  memorandum.  Its  conclusions  must  be  subject  to  the  same 
qualifications  since  the  study  necessarily  involves  comparisons 
against  a  nonequivalent  control  group,  but  the  bcp  report  ac- 
knowledges these  limitations  and  taljces  care  to  qualify  any  infer- 
ences from  the  results.  Furthermore,  the  explanation  of  the  steps 

77 


ERIC      100  i 


997 


taken  in  editing  and  in  analyzing  the  data  is  far  better  than  that 
contained  in  the  bro  memorandum.  Nevertheless,  they  indicate 
that  SAT  testing  histories  were/identified  for  1568  coaching  school 
enrollees  but  were  not  located  for  "approximately  600  individ- 
uals identified  from  ttq^coaching  school  list"  (p.  5).  This  attrition 
rate  is  about  28  percent  ^^nd  represents  a  significant  loss.  More- 
over, the  response  rate  for  ^the  sdq  for  the  coached  and  uncoachcd 
students  (64  and  67  percent,  respectively)  is  considerably  lower 
than  that  typically  found  Tor  sat  candidate  groups— about  86  per- 
^  cent.  Such  high  attrition  rates  from  each  source  may  have  intro- 
duced  biases  relevant  to  coaching  and  its  effects. 

The  BCP  report,  despite  its  inherent  limitations,  provides  infor- 
mation on  a  topic  of  concern  and  interest.  On  the  whole,  we 
should  welcome  the  report  as  a  contribution  to  the  literature  on 
coaching.  The  effects  (see  bcp  report.  Table  3,  p.  20)  correspond  to 
three  additional  items  correct  on  each  of  the  sat-V  and  sat-M  and 
probably  incorporate  several  components,  including  self-selec- 
tion, instruction,  and  coaching.  Moreover,  those  effects  held  just 
for  School  A.  School  B  had  negligible  impact  on  sat  scores.  If  we 
view  or  demonstrate  these  effects  as  probable  overestimates  aris- 
ing from  comparing  nonequivalent  groups  and  confounding  sever- 
al possible  sources  of  seore  changes,  three  additional  items  cor- 
rect seems  not  to  represent  a  dramatic  gain.  The  same  effect 
might  be  found  for  students  devoting  comparable  effort  and  time 
to  independent  study  or  regular  academic  courses  covering  typi- 
cal subject  matter. 

Comments  on  selected  points  in  the  bcp  report  follow: 

"VndeTachieveTs:  Th^  bcp  report  suggests  that  coaching  at  School 
A  was  "cffccuve"  for  '*underachicvers.''  an  estimated  treatment 
effect  of  25  points  was  found  at  School  A  for  students  whose  sat 
stores  were  lower  than  might  be  expected  on  the  basis  of  their  high 
school  grades,  class  rank,  and  other  demographic  characteristics 
Usually  students  whose  school  grades  seem  high  in  relation  to  their 
test  scores  would  be  called  "overachievcrs/'  And  that  term,  "over 
achievers,"  seems  more  consistent  with  the  demographic  profiles  in 
Table  \  (bcp  report,  pp.  8-11),  coached  students  had  higher  class 
ranks  |'31%  irt  the  top  tenth  of  their  class),  reported  larger  parental 
incomes  (41%  with  $30,000  or  more),  attended  nonpublic  schools 
more  often  [45%  \n  nonpublic  schools),  had  higher  English  grades 
155%'wfith  an  A  in  their  latest  course),  and  had  higher  mathematics 
grades  (|t8%  with  an  A  in  their  latest  course)  than  control  students 
These  sfudents  in  the  coached  group  were  riot  underachievers  or 
disadvai^taged,  they  were  overachievcrs  and  middle-class 
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Adjustment  for  selhelection.  The  dropping  of  i»sat  as  a  covariato 
(and  the  concomitant  increase  in  the  standard  error  of  the  esn- 
mated.  treatment  effects)  in  attempting  to  compensate  for  self- 
selection  left  me  puzzled.  After  confirming  students'  self-selection 
mto  the  coached  group  by  noting  unaccounted  differences  in  psat 
(bcp  report,  Table  4,  p.  26],  psat  is  dropped  as  a  covariate  in  the  re- 
gression analyses.  If  we  extend  that  argument  to  all  other  indepen- 
dent variables  which  show  significant  differences  between  the 
coached  and  uncoached  groups  (bcp  report,  Table  1,  pp.  8-11),  the^ 
only  covariates  left  would  be  sex  and  expected  years  of  English.  The 
point  is  that  all  of  the  variables,  dependent  and  independent,  show 
self-selection  and  no  statistical  analysis  will  fully  compensate  for 
the  nonequivalent  control  group. 

True  expeiimental  design.  The  bcp  report  takes  the  position  that  a 
true  experiment  with  random  assignment  of  studerits  to  compari-  - 
son  groups  would  be  unethical  ("as  It  would  require  denying  access 
to  commercial  coaching  to  students  who  want  it"  [bcp  report,  p. 
31),  expensive,  and  time-consuining.  But  our  own  most  recent 
study  of  special  preparation  for  the  sat-V  did  follow  a  true  ex- 
perimental design  by  delaying  rather  than  denying  access  to  the 
treatment. 

The  FTC  memorandum  from  the  bro  and  report  from  the  bcp  do 
not  close  the  question  of  the  impact  of  commercial  coaching  en- 
terprises. It  has  not  been  unequivocally  shown-  that  such  pro- 
grams cause  score  gains  on  national  admissions  tests.  Indeed,  no 
amount  of  researqh  can  disprove  the  possible  effectiveness  of 
coaching.  The  possibility  will  remain  open  since  there  is  always 
another  program  or  a  different  student  population.  Even  an  exper- 
imental study  showing  no  significant  effects  this  year  would  not 
be  conclusive  evidence,  regarding  new  programs  and  diffrfent  stu- 
dents next^^ear.  But  we  can  perhaps  clarify  this  issue  by  explain- 
ing sources  of  score  changes  on  major  admissions  tests  and  by 
studying  the  impact  of  regular  academic  programs. 
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Critical  Notes  on  the  FTC  Coaching  Study 


DoNAio  E.  'Powers,  November  19,  1979 

The  claims  made  for  the  efficacy  of  special  preparation  or 
"coaching"  b>ahose  commercial  or  proprietary  schools  that  offer 
such  prepaf^fion  programs  for  standardized  admission  tests  is  a 
j)j:opefconcern  of  the  Federal  Trade  Commission  (ftc).  The  Com- 
mission deserves  support  for  adSressing  this  thorny  issue  and  for 
assembling  what  appears  to  be  the  first  credible  set  of  data  from 
which  inferences  about  the  effects  of  commercial  coaching  rea- 
sonably could  be  attempted.  As  a  result  of  the  ftc  effort  we  now 
know  something  more  about  the  effects  of  commercial  coaching. 
Through  further  analyses  that  are  possible  with  the  ftc  data  base, 
even  more  may  be  learned. 

The  FTC  stjouM  also  be  applauded  for  acknowledging  the  limita- 
tions inherent  in  the  type  of  quasi-experimental  study  that  was 
conducted,  for  recognizing. the  serious  flaws  in  an  earlier  report 
issued.by  its  Boston  Regional  Office,  and  for  attempting  to  rectify 
some  of  these  flaws  through  reanalyses . 

-  Nevertheless,  with  respect  to  the  more  technically  adequate 
report  issued  by  the  ftc's  Bureau  of  Consumer  Protection  (bcp)  in 
Washington,  a  number  of  comments  can  be  made  regarding:  (1) 
the  general  reporting  of  results;  (2)  the  assumptions  underlying 
various  analyses  and  findings;  (3)  the  design  and  analysis  strate- 
gics employed;  (4)  the  testing  of  hypotheses;  (5)  the  logic  in- 
volved in  drawing,  inferences;  and,  (6)  the  reasonableness  of 
results.  Needless  to  say,  perhaps,  these  categories  may  have  sub- 
stantial overlap, 
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Reporting  * 

In  terms  of  style,  the  bcp  report  is  generally  well-written,  with  a 
minimum  ojt  technical  jargon.  However,  four  relatively  minor 
poiats  might  be  made. 

•  The  report's  title,  "Effects  of  Coaching  on  Standardized  Ad- 
mission Examinations,"  seems  to  suggest  that  the  results  of 
the  study  pertain  to  a  variety  of  standardized  admissions  tests, 
which  include  both  aptitude  arid  achievement  measures,  and 
to  a  variety  of  coaching  methods  and  courses.  Since  the  study 
has  been  restricted  to  specific  types  of  coaching  and  to  one  par- 
ticular aptitude  test  (the  sat),  a  title  more  adequately  reflecting 
the  narrower  focus  of  the  study  would  have  been  more  appro- 
priate. 

•  The  report's  executive  summary  is  selective  in  focusing  on  the 
results  at.only  one  of  the  two  schools  involved.  Inclusion  of  a 
statement  concerning  the  lack  of  effectiveness  of  the  second 
school  would  have  been  appropriate. 

•  The  report's  summary  of  an  average  effect  of  25  points  "on 
both  the  verbal  and  math  sat  exams"  at  one  school  obscures 
some  important  information  about  the  effects,  namely  that  the 
effect  on  Verbal  scores  was  somewhat  higher  than  the  effect  on 
Math  scores.  

•  Detail  for  some  especially  relevant  descriptive  information  is 
omitted  from  the  report.  Table  1  of  the  bcp  report,  which  shows 
demographic  profiles  of  coached  and  uncoached  students,  fails 
to  provide  the  statistics  for  psat  scores,  which  are  acknowl- 
edged in  the  narrative  to  differ  for  cqached  and  noncoached  stu- 
dents. The  omission  of  data  on  the  psat  is  glaring  because  of  the 
report's  contention  that  self-selection  is  based , primarily  on 
These  earlier  test  scores. 


Assumptions 

Like  most  quasi-experiments,  the  ftc  study  rests  on  a  number  of 
assumptions,  both  explicit  and  implicit,  that  can  be  examined  for 
reasonableness: 

•  The  BCP  repoi  t  states  on  page  2  that: 

Conversely,  a  non-experimental  control  group  may  lead  to  an  un- 
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dercstimate  of  coaching  benefits;  that  iS;  the  uncoached  students 
may  in  fact  have  received  some  form  of  coaching  other  than  formal 
.enrollment  in  a  commercial  coaching  course.  They  may,  for  exam- 
ple, have  attended  a  course  offered  by  a  school  in  the  not-for-profit 
segment  of  the  industry  or  have  engaged  in  extensive  self-prepara- 
tion. These  unmoniiored  efforts,  if  they  occur  and  if  they  are  effec- 
tive, would  tend  to  increase  the  average  test  scores  of  the  "un- 
coached" students.  These  increaBcd  scores,  containing  a  compo* 
nent  properly  attributable  to  coaching,  would  tend  to  shrink  the 
apparent  benefit  from  commercial  coaching. 

In  the  absence  of  any  data,  this  assumption  would  seem  rea- 
sonable. However,  some  reworked  data  (Table  1)  from  the. 
study  of  the  effects  of  the  booklet  Taking  the  SAT  suggest  that 
coached  students  may  be  more  likely  than  uncoached  students, 
except  for  the  use  of  College  Board  publications,  to  also  engage 
«  in  other  methods  of  preparation.  Thus,  by  ftc  reasoning,  their 
analyses  would  actually  be  more  likely  to  overestimate  the  ef- 
fects  of  coaching  by  failing  to  account  for  the  other  ways  in 
which  coached  students  may  have  prepared. 

Moreover,  the  fact  that  coached  students  may  prepare  more 
diligently  than  uncoached  students  would  seem  to  suggest  a 
motivation  to  do  well  on  the  sat  that  was  probably  not  cap- 
tured by  any  of  the  variables  included  in  the  ftc  study.  [It 
should  be  noted  that  the  coached  students  in  Table  1  reported 
''attending  coaching  sessions  outside  school,"  but  not  neces- 

 sarily  commercial  coaching  schools-ofthctype^studied-by  the 

FTC.)  Hence,,  the  reasonableness  of  this  ftc  assumption  thai 
preparation  efforts  on  the  part  of  the  uncoached  students 
tended  to  shrink  the  apparent  benefit  from  commercial  Qoach> 
ing  may  be  questioned. 

'  •  The  assumption  that,  compared  to  nonexperimental  studies, 
experimental  studies  of  the  effects  of  special  preparation  are 
impractical,  unethical,  expensive,  and  time-gonsuming  can  be 
questioned  by  citirig  the  recently  completed  experimental 
study  of  special  preparation  programs  offered  by  secondary 

schools  by  Alderman  and  PcKvers. 

i  ' 

•  The  FTC  study  attends,  to  the  importance  of  self-selection,  but 
apparently  implicitly  assumes  that  all  students  use  the  same 
basis  for  choosing  to  attend  coaching  schools,  i.e,,  that  self- 
selection  is  uniform.  This  assumption  attributes  a  simplicity 
to  self-selection  that  may  not  be  warranted.  - 
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Use  of  Various  Preparation  Methods  by  Coached  and  Uncoached  Students 


Method  of  Preparation 


U) 
Answited 
Questtons  in 


(2! 
Read 


131  141  15) 

Reviewed 

ReviewedMath      Vocahuhtyor     Reviewed  Other 


161 
Read  Test 
Preparatoiy 
Books 


\7\  181 
Attended  -  Attended 
Piepatatoty  Coachinx 

Session  at  School  Outside  School 


{9] 
Other 


Group 

N 

N 

% 

% 

N 

% 

N 

% 

N 

% 

N 

% 

N 

Coached 

46 

74.2 

28» 

82.3 

34 

54.8 

^  43 

69.4 

10 

16.1 

44 

71,0 

17 

27.4 

62 

100.0 

10 

16.1. 

N==62 

Uncoached 

978 

76.5 

563» 

92.0 

361 

28.2 

545 

42.6 

110 

8,6 

636 

49.7 

189 

14.8 

00 

0.0 

147 

11.5 

N  =  1279 

Total 

1024 

76.3 

S9V 

91.5 

395 

29.5 

588 

43.8 

120 

8.9 

680 

50.7 

206 

15.4 

62 

4.6 

157 

11.7 

1. 

69 

•  3.84 

20 

.16 

.18  ^ 

4. 

10 

10 

.67  ■ 

7. 

27 

1. 

23 

P 

P  = 

n.s. 

P< 

.05 

P< 

.001 

p< 

.00.1 

P< 

.05 

P< 

.05 

P< 

.01 

P  = 

n.s. 

»Ba^ci*34.  «Hs^-i$612.  »Bascis646- 


Source.  Powc/$,  D.  t.St'udents  Useof  and  Reacttons  to  Alternative  Methods  oi  Preparing  for  the  skt  Inpio^c«. 
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Design  and  Analysis  '  .  . 

The  FTC  presents  the  inherent  limitations  of  the  non-experimen- 
tal nature  of  the  design  used.  The  application  of  multiple  regres- 
sion analysis  as  the  primary  data  analysis  technique  seeins  ap- 
-  propriate.  However,  the  following  additional  refinements  in 
analysis  might  have  been  useful: 

•  A  more  careful  entry,  perhaps  serially,  of  variables  or  sets  of 
variables  in  the  analyses,  instead  of  entering  all  of  them,  simul- 
taneously, might  have  been  even  more  informative.  A  careful 
examination  of  the  collinearity  of  variables  might  also  have 
been  desirable. 

•  Additional  analyses  of  possible  interactive  effects  might  have 
proven  useful .  The  ftc  researchers  did  test^for  psat  coaching  in- 
teractions and  concluded  that  they  need  not  be  taken  into  ac- 
count. However,  a  number  of  other  interaction  effects  could 
have  been  included  in  the  analyses,  such  as  the  interaction  of 
coaching  with: 

—number  of  previous  psats 
—number  of  years  of  math,  and 
—high  school  grades. 

,  •  Including  m9re  interaction  terms  would  presumably  have 
resulted  in  a  better  feel  for-the-joim-effeGt^f-coaching-and 
other  important  variables  or  the  conditions  under  which  coach- 
ing is  most  effective. 

•  Separate  analyses  for  each  coaching  school,  and/or  more  so- 
phisticated procedures  for  pooling  data,  could  have  been  con- 
ducted, given  the  acknowledged  differences  between  the  stu- 
dents attending  the  two  coaching  schools,  important  effects 
may  have  been  obscured  by  merely  combining  togetlier  data  for 
all  students  at  both  schools  as  in  the  demographic  profiles. 


Hypothesis  Testing 

At  times  the  ft.c  study  is  too  selective  in  the  testing  of  plausible 
hypotheses.  This  defect  is  especially  evident  in  the  analyses  of 
self-selection  bias. 
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As  one  ej^ample,  on  page  18  of  the  bcp  report,  the  hypoThcsiS-l^ 
presented  that  students  who  are  coached  before  they  take  the 
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SAT  for  the  first  time  arc  serious  and  do  not  plan  to  take  it  a  sec- 
ond time,  while  those  who  are  not  coached  are  not  as  serious 
because  they  do  plan  to  take  it  a  second  time.  This  hypothesis 
is  tested  by  showing  that  coached  students  were  more  likely 
than  their  uncoached  counterparts  to  take  the  sat  a  second 
time  and  that,  therefore,  the  issue  was  not  a  cause  for  concern. 
How(2ver,  no  Cv)nsideration  is  given  to  the  counter-hypothesis 
that  because  coached  students  were  more  likely  than  un- 
coached students  to  take  the  exam  a  second  time,  they  are 
more  serious  and  more  determined  to  persist  until  they  obtain 
s'atisfactory  scores. 

The  FTC  study  acknowledges  the  potential  for  biased  estimates 
of  effects  resulting  from  student  self-selection.  However,  the 
study  focuses  on  only  one  possible  type  of  self-selection  bjas, 
i.e.,  that  students  choose  to  attend  coaching  schools  on  the  ba- 
sis of  how  their  first  score  (sat  or  psat)  compares  with  what 
might  be  expected  from  their  high  school  rank,  their  parents' 
income,  etc.  This  hypothesis  is  tested  by  regressing  first  sat 
score  (and  psat  score)  on  demographic  variables  and  showing 
that  coached  students,  on  the  average,  obtained  slightly  lower 
than  expected  sat  and  psat  scores,  whereas  noncoached  stu- 
dents did  slightly  better  than  expected.  However,  similar  anal- 
yses using  each  of  the  dtjmographic  characteristics  (instead  of 
PSAT  and  SAT  scores)  as  dependent  variables  might  very  well 
have  shown  similar,  or  even  more  dramatic,  differences  be- 
tween-coached anduncoached  students.  Suggesting^ self-selec- 
tion on  other  variables. 

One  plausible  alternative  hypothesis  is  that  self-selection 
operates  primarily  on  the  basis  of  family  income,  an  hypothesis 
that  is  supported  by  the  demographic  profiles  which  show  a 
very  strong  relationship  between  attending  coaching  schools 
and  family  income.  It  seems  highly  likely  that  regressing  fami- 
ly income  on  other  demographic  characteristics  and  psat  scores 
would  show  that  coache^ students  come  from  families  whose 
incomes  are  higher  than  expected  from  jOther  demographic 
characteristics,  and  that,  therefore,  self-selection  might  well 
be  based  primarily  on<parental  income  (i.e.,  on  one's  family's 
ability  and  willingness  to  pay  for  coaching).  The  same  analyses 
could  be  applied  to  any  of  the  other  available  student  character- 
istics. 

The  following  observations  suggest  that  self-selection  on  the 
basis  of  family  income  is  not  only  consistent  with  the  ftc  data 
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but  also  at  Uast  equally  plausible  to  self-selection  based  on  ex- 
pectations for  PSAT  (sat)  scores; 

(1)  One  wonders  how  precisely  students  can  estimate,  or  de- 
velop strong  expectations  for,  how  well  they  should  per- 
form on*the  PSAT  or  sat  according  to  their  personal  demo- 
graphic profiles^  i.e.,  how  closely  statistical  expectations 
correspond  to  student  expectations.  As  an  example,  would 

,    a  student  having  a  particular  demographic  profile  (white 
,    male  ranking  in  theitop  tenth  of  his  class,  from  a  family 
,   earning  $21,000  a  year,  having  taken  four  years  of  math  and 
>  obtaining  an  excellent  grade  in  his  latest  math  course)  ex- 
pect to  get  a  psAT-M  score  of  56,  as  would  be  predicted  frO'm 
'the  FTC-gcnerated  regression  equations?  How  likely  would 
he  be  to  seek  coaching  if  his  actual  score  was  below  this,  or 
to  fo;:ego  coaching  If  his  actual  score  exceeded  56? 

(2)  Differences  between  cpached  and  noncoached  students  on 
\yariables  other  than  family  income  could  be  explained  on 

j^l^e  basis  of  incidental  selection.  If  students  were  to  base 
thftir  decisions  to  attend  coaching  schools  solely  (explicitly) 
on  their  parehts'  ability  to  pay,  differences  on  most  other 
demographic  variables  (e.g.,  psat  scores,  grades,  attendance 
|it  private  schools)  couid  be  merely  incidental  because  of 
the  positive  correlation  of  each  of  these  variables  with  par- 
ental inconie.  ' 

(3)  Differences  m  self-selection  were  detec^d  for  students  at^ 
^    Itending  the  two  coaching  schools  in  the  pre  study.  ISelf^ 

selection  of  theXtype  hypothesized  in  the  study  was  noted 
for  School  A,  which  charges  $225,  but  not  for  School  B, 
•  which  charges  oniy^^ZS.  This  pattern  is  consistent  with  the 
alternative  hypothesis  that  family  income  is  the  major  self- 
selection  variable.  V 

Testing  other  types  of  self-s^ection  bias  seenis  very  important 
in  light  of  the  ftc  conclusion  that  coaching  is  effective  for  ''un- 
derachievers,"  which  is  defined^in  the  report  as  being  the  same 
as  self-selection. 


Logic  and  Inferences 

--^Scveralof-the^conclusions  drawn  in  the.FTC^eport  areppen  to  fur- 
ther consideration. 
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The  analysis  of  self-selection  bias  shows  that  coached  students 
had  unexpectedly  low  scores  on  both  a  previous  sat  and  the 
PSAT,  from  which  it  is  concluded  that  students  who  tend  to  en- 
roll in  coaching  schools  are  those  who  do  worse  than  expected 
-on  standardized,  tests.  The  fact  that,  on  the  average,  those 
choosing  coaching  schools  do  worse  than  expected  on  both 
previous  exams  (sat  and  psat)  is  used  to  infer  that  self-selection 
is  not  on  the  basis  of  scoring  lower  than  expected  by  chance 
(i.e.,  that  because  the  phenomenon  is  noted  for  two  tests,  it  is 
not  by  chance). 

However,  this  analysis  rules  out  only  that  self-selection  is  ^ 
not  based  solely  on  obtaining  by  chance  an  initial  sat  score  that 
was  lower  than  expected.  It  does  not  rule  out  the  hypothesis 
that  self-selection  is  based  on  scoring  low  by  chance  twice  (on 
both  the  PSAT  and  the  first  sat).  That  is,  those  students  who  are 
unlucky  twice  may  be  the  ones  choosing  to  select  coaching. 
Using  the  ftc  technique,  we  can  reason  that  if,  say,  about  one- 
fifth  of  all  students  tend  to  be  unlucky,  i.e.,  score  below  expec- 
tations on  each  exam,  then  about  one  in  twenty-five  would  be 
expected  to  be  unlucky  both  times.  Given  the  relatively  small 
percentage  of  all  examinees  who  attend  commercial  coaching 
schools,  coached  students  could  very  well  come  primarily  from 
this  doubly  unlucky  grc^up. 

A  major  conclusion  of  the  study  that  rests  on  the  analysis  of 
self-selection  is  that  ''coaching  can  be  effective  for  those  who 
-do-Tioirscore-well  DTI  standardized  tests''  {p.  35),  and  that  "if 
only  underachievers\can  be  helped,  it  is  possible  that  coaching 
^t  the  second  school  Would  be  effective  for  such  students"  (ex- 
ecutive summary).  Because  of  its  policy  implications,  this  con- 
clusion deserves  critical  analysis.  The  reasoning  from  which 
this  conclusion  results  is  faulty  because  self-selection  of  the 
test  underachievement  type  was  noted  for  only  one  of  the  two 
schools.  That  is,  there  are  underachievers  at  one  school  but  not 
at  the  other.  This  confounding  of  particular  school  with  typ_e  fit 
student  does  not  allow  the  type  of  conclusion  made^n  the  ftc 
report.  It  is  not  possible  to  conclude  from  the  ftc  analysis  of 
only  two  schools  whether  the  nature  of  the  program  or  the  type 
of  student  in  attendance  is  responsible  for  the  apparent  effect 
on  test  scores.  An  analysis  of  the  effects  for  under-  and  over- 
achievers  within  schools  is  needed  to  make  an  inference  of  this 
nature. 

Related  to  the  major  conclusions  listed  abovi  is  the  extremely 
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weak  argument  that  because  self-selection  was  not  detected  at 
School  A  for  one  exam  (the  1975  Verbal  exam,  for  which  coach- 
ing was  effective],  then  coaching  at  School  A  can  be  effective 
for  all  students,  not  just  underathievers.  Not  onlyis  this  infer- 
ence not  justified,  but  the  reasonableness  of  the  finding  upon 
which  it  is  based  [i.e.,  that  sell-selection  was  not  detected  for 
one  portion  (Verbal)  of  one  exam  (the  1975  administration)  can 
be  questioned].  It  is  difficult  t6  understand  how  or  why  self- 
selection  should  be  different  in  ^ne  year  for  only  one  par.t  of^the 
exam. 


Findings 

A  number  of  the  report's  findings,lwhile  possibly  corre^ct,  can  be 
classified  as  either  counterintuitive,  curious,  or  needing  further 
explanation  or  clarification. 

•  The  finding  that  the  effects  of  coacfiing  on  the  Verbal  part  of 
the  SAT^were  as  large  as  (in  some  instances  larger  than)  the  ef- 
fects on  the  Math  section  is  counterintuitive  to  what  we  know 
about  the  developntent  of  verl)al  and  math  abilities  as  mea- 
sured by  the  sat.^  This  somewhat  unexpected  finding  could 
have  been  given-further  attention  in  the  report. 

•  Table  3^  on  page  20  of  the  ftc  report  shows  two  estimates  of 
effects  that  are  significantly  different  statistically  for  subsam- 


ples/but  these  differences  are  not  nientioned^mtHe  report.  The 
first  is  the  difference  between  estimates  for  Verbal  ei£ccts  for 
subsampies  1  and  2  for  School  A,  suggesting  that  School  A  was 
hiore  effective  in.  1976  than  in  1975.  Since  School  A  was  well 
established  before  1975,  this  difference  may  deservt  some 
attention. 

The  second  significant  difference  is  between  subsampies  5 
and  6  for^  Math  at  School  A,  suggesting  that  School  A's  instruc- 
tion is  more  effective  for  second-time  sat  takers  than  for  first- 
time  SAT  takers.  Possibly,  these  significant, differences  merely 
reflect.the  relatively  large  number  of  significance  tests.  How- 
ever, at  least  the  very  large  difference  in  year-to-year  effects  on 
Verbal  scores  for  School  A  should  have  receivedisome  mention. 
Or  should,.we  believe  that  such  fluctuations  are  typical  of  this 
kind^of  study?  X 

As  mentioned  above,  the  analysis  of  self-selection  discussed  in 
the  final  sectibn  of  the  report  concludes  that  self-selection  was 
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examS;  with  the  sole  exception  of  the  1975  verbal  ekam"  (p. 
35).  This  is  a  curious  finding,  since  there  should  be  no  reason 
'  ^  to  believe  that  that  self-selection  would  be  different  for  thjs 
particular  exam,  especially  since  selT-selection  was^detect^d  for 
the  Math  portion  of.the  same  administration.  \ 

•  The  finding  that  School  A  is  more  effective  than  Schoo|  B 
deserves  more  attention.  This  r-sult  seems  reasonable  siixce 
School  A  offejs  a  longer,  and  more  expensive,  course  than  does 
School  B.  However,  another  hypothesis  can  be  offered  to  ac- 
count for  the  apparent  difference  in  estimates  of  the  effective-^ 

'  ness  of  ^:he  two  schools.  Since  the  tu'tion  jpr  School  A  is  three 
times  that  of  School  B  (and  assuming  selection  is.jelated  to 
cost),  it  seems  likely  that  the  uncoached  control  group  is  more 
like  the  students  coached  at  School  B  than  those  coached  at 
School  A,  an  hypothesis  that  can  be  easily  tested  with  the  ftc 
data. 

If  this  is  so,  then  the  analysis  employed  by  the  ftc  would  be 
less  likely  to  yield  biased  estimates  of  effects  for  School  B  than , 
for  School  A,  since  the  coached  and  uncoached  students  would 
also  be  less  likely  to  differ  on  some  other  yncontroUed  varia- 
ble(s)  related  to  sat  scores  and  to  attending  coachik  J  schools. 

•  Several iof  the  analyses  in  the  ftc  report  yielded  larger,  though 
less  precise,  estimates  of  effects  for  the  variable  newspsat  (de- 

^fjnedraSrth€Jiumbor-of^i?SATi4;a^  tbajaJpJL. 
coaching  at  either  School  A  or  School  B.  These  estimated  are 
summarized  in  Table  2  but  not  mentioned  in  the  ftc  report. 
Such  large  (and  iri  the  case  of  subsample  5,  significant)  esti- 
mates of  the  effect  of  taking  a  second  psat  seem,  intuitively, 
muck  too  high,  I^owever,  if  they' are  correct,  they  place  the 
smaller  estimate^  of  the  effects  of  coaching  in  a  much  different 
perspective.  It  seems  more  probable,  however,  that  the  large 
effects  attributed  to  retaking  the  psat  may  be  overestimates  be- 
cause, of  some  other  factor  that  covaries  with  both  sat  scores 
and  the  tendency  to  repeat  the  psat  and  also  qtfite  possibly, 
with  attending  coaching  schools.  It  may  also  r^milt  from  small 
samples.  In  any  event,  if  we  are  asked  to  take  the  results  of  the 
ftc  analyses  at  face  value^  the  appropriate  ,(and  much  less  ex- 
pensive) recommendation  to  students  preparing  for  the  sat 
I     would  be  simply  to  repeat  the  psat. 

Finally,  such  a  large  psat  effect  does  not  seem  reasonable  be- 
cause tnost  of  the  coaching  courses  place  a  premium  on  prac- 
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Table  2 

Effects  of  P5AT  Practice  and  Coaching 
\    (Summarized  from  ftc  report) 


Variable 

Sample  No  /Test 

Test 

NlWSrSAT 

C<Mch  t 

C<Mcb  2  * 

'  2/First 

Effect^ 

43.8 

44.5 

3.5 

Verbal 

54,9 

6,0 

6.9 

^2/First 

Effect 

23,4 

26.5 

0.2 

'Math 

G,E. 

58.4 

6.4 

7.3 

5/First  ^ 

Effect 

41  7 

297 

-1.8 

Verbal  « 

S.E. 

14.4 

4/4 

57 

5/First  ; 

tneci 

5.4 

*                Math  .  '  ; 

S,E. 

14.8 

45 

'     2/hrsi  , 

Effect 

65  9 

26,8 

0,8 

Verbal 

(mr  deleted) 
* 

SS 

83.9 

9>i 

10.6 

2/First 

Effect 

8()>6 

7,5 

8:8 

Math 

^           (PSAT deleted) 

S.E, 

85.4 

9.3 

107 

'S/First 

Effect 

.  68,2 

11.5 

-2.3 

Verbal 
iP5AT  deleted) 

S.E, 

22.7 

6.9 

87 

5/First 

Effect 

517 

0.5 

13.4 

'Math'- 

S,E 

22  3 

67 

8.6 

(VsAT  deleted) 


ticc,  which  is  distributed  over  time,  and  might  be  expected  to 
be  more  effective  than  an  additional  psat. 

•  Table  5  of  the  ftc  report  contains  an  apparent  error.  The  value 
of  the  estimate  of  the  impact  on  the  Math  sat  for  School  A, 
sample  5,  has  been  recorded  as  5.5.  However,  the  correspond- 
ing regression  analysis  in  the  appendix  indicates  a  value  of  0.55 
|p:C-10). 

The  fact  that  the  ftc  study  has  stimidated  discussion  of  an  "Im- 
portant issue  and  has  raised  many  additional  questions  may  bc^ 
one  of  its  ma)or  contributions.  The  critical  attention  that  the 
report  has  attracted  should  help  us  better  understand  the  effects 
of  coaching  on  admissions  tests. 
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Critical  Notes  on  the  FTC  Coaching  Study 


Donald  A.  Rock,  December  17, 1979 


The  FTC  analysis  (Boston  Memorandum)  and  reanalysis  (Washing- 
ton  Report)  of  the  effect  of  commercial  coaching  on  admissions 
test  score  gains  applied  standard  ancova  procedures  in  an  attempt 
to  statistically  equate  two  different  populations.  The  nrc  report 
itself  documented  thatijie  two  populations  differ  pn  both  demo- 
graphic and  ability  variables.  Conclusions  based  on  such  analyses 
.are  only  valid  if.  (1)  strong  assumptions  can  be  made  about  the  ap- 
propriateness of  the  statistical  correction  used  in  eliminating  the 
measured  pre-existing  differences,  and  (2)  all  unmeasured  pre- 
existing differences  are  unrelated  to  observed  differential  gains 
over  the  time  periods  in  question.  Subsequent  reanalyses  at  the 
Educational  Testing  Service  suggest  that  (1)  ^nd  (2)  above  are 
likely  to  be  untrue  in  some  cases  and  only  partidlly  true  in  others 
S^oineof  the  failures  to  meet  assumptions  were  empirically  dem- 
onstrat^d^App^cndix  3)  and  their  consequences^  with  respect  to  in- 
terpretations ouTl7ncdrPiro51"cnls  v/ith  the  ftc  analysis  and  reanal- 
ysis, some  statistical  and  some  logical,  are  as  follows: 

(1)  The  FTC  authors  report  that  approximately  600  scores  for 
coaching  school  enrollees  were  not  found  in  the  sat  files. 
This,  I  think,  has  serious  consequences  for  their  conclusion 

,  If  these  600  individuals  cancelled  their  scores  because  they 
did  not  think  they  did  well,  ^hen  one  would  expect  the  esti- 
mates of  coaching  effects  to  ht  biased  upwards. 

(2)  The  ETS  reanalysis  of  test  scores  at  three  points  in  time  sug- 
j  .  gests  that  the  standard  ancova  approach  used  by  the  ftc  v/cr 
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inappropriate  for  the  verbal  data  because  of  self-selection^ 
effects  which  were  at  least  partially  captured  in  differeritial 
group  growth  rates.  More  appropriate  growth  related  adjust- 
xment  models  yielded  verbal  coaching  effects  about  one-half 
the  size  reported  by  the  ftc  report. 

The  mathematics  data  Iwere  found  to  be  more  consistent 
with  the  standard  ANCOVAjmodel  and  thus  more  likely  to  yield 
reasonable  estimates  of  ccjaching  effects  given  the  available 
control  variables,  This.is  not  to  say  that  the  ftc  and  the  ets  re- 
analysis  estimates  of  the  mathematics  coaching  effect  are  not 
overestimates,  since  the  only  self-selection  causes  that  have 
been  controlled  for  were  those  reflected  in  differential  growth 
rates  and/or  available  demographics.  One  missing  piece  of  in- 
formation is  the  reliability  of  the  pretest  scores.  When  indi- 
viduals self-select  to  treatments,  commonly  held  psychomet- 
ric wisdom  suggests  that  the  standard  ancova  model  can  be 
expected  to  underadjust  to  the  extent  that  the  pretests  are  less 
than  perfectly  reliable,  thereby  yielding  an  overestimate  of 
the  coaching  effect. 

(3)  The  FTC  concludes  that  the  students  . . . 

who  attended  the  most  "effective"  sehool  tended  to  be  under- 
achievers  on  standardized  exams,  i.e.,  they  scored  lower  on  stan- 
dardized exams  than  would  have  been  predicted  given  their  per- 
sonal and  demographic  eharactcristics  (including  such  factors  a6 
grades  in  school  and  class  rank).  If  this  underachieving  was  ran- 
dom rather  than  systematic,  the  results  showing  the  benefits  of 
the  coaching  received  at  School  A  might  have  been  overstated. 
Analysis  was  conducted,  however,  showing  that  the  underachieve- 
ment  by  the  students  was  not  due  to  chance,  and  probably  would 

■         have  continued  in  the  absence  of  coaching. 

(Executive  Summary) 

The  above  conclusions  were  based  on  examining  the  size  and 
direction  of  the  deviations  from  the  weighted  pooled  regression 
lirje.  The  regression  slope  and  intercepts  for  this  pooled  regres- 
siop  line  were  primarily  determined  by  the  noncciached  popula- 
tioi^  since  the  ratio  of  noncoached  to  coached  individuals  is  ap- 
proxrmately  4.1  in  this  sample.  The  ftc  report  of  larger  mean  de- 
viatic^ns  for  the  coached  group  is  therefore  not  unexpected  The 
directions  or  sign  of  the  deviations  would  depend  on  the  way  in 
which\the  regression  hyperplanes  differ.  The  ftc  analysts  do  not 
appear  tp  have  tested  the  critical  assumptions  of  homogeneity  of 
the  within  population  regressions  before  they  carried  out  and  in- 
terpreted ^e  difference  in  mean*  residuals.  It  would  appear  that 
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any  conclusions  nbout  coaching  as  working  best  for  "under- 
achievers"  is  not  warranted  based  on  this  type  of  analyol^. 

A  more  satisfactory,  yet  still  inconclusive,  analysis  would  be 
centered  on  the  coached  population  only,  and  would  include  the 
regression  of  the  first  sat  on  the  psat  score  and  significant  demo- 
graphics as  control  variables.  This  analysis  would  be  repeated  for 
the  second  sat.  That  is,  the  second  sat  would  be  regressed  on  the 
first  SAT  and  control  demographics.  The  comparison  of  the  rela- 
tive sizes  of  thexegression  weights  associated  with  the  psat  and 
the  first  SAT  would  indicate  if  a  particular  subgroup  of  the  coached 
population  benefits  more  from  coachingf  The  problem  here  is 
that  this  comparison  would  only  be  valid  if  one  first  shows  that 
the  growth  rates  of  subsets  of  the  coached  population  are  the  same 
in  the  absence  of  intervention. 


•c.j; ,  If  the  Mw  score  regression  weijjhi  is  greater  than  10  for  the  i'sat  hut  less 
than  i  0  Kir  the  ti:st  sat,  then  one  could  infer  that  when  hackground  variahlcs  arc 
controlled^  low  scorinj;  individuals  gam  more  from  coaching  Since  we  don't 
have  reliability  estimates  for  the  fsat  and  sat  for  this  population,  such  conclu 
sions  would  have  to  be  tentative. 
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Appendix  2 
Stroud  Report 

Rcanalysi*  of  the  JFcdcral  Trade  Commission  Study  of 
Commercial  Coaching  for  the  SAT 


XW.R  Stroud 
Abstract 

Sat  scores  of  students  attending  three  commercial  coaching 
schools  are  compared  with  those  of  uncoached  students  by  means 
of  multiple  regression  techniques.  The  techniques  differ  from 
those  used  in  the  Federal  Trade  Commission  (ftc)  reanalysis  in  a 
number  of  ways  which  are  described  in  this  report.  One  essential 
difference  is  that  the  sat  scores  were  predicted  using  a  multiple 
regression  equation  based  on  uncoached  students  rather  than 
pooled  across  coached  and  uncoached  students.  Residuals  from 
predicted  values  based  on  this  equatioa  were  then  computed  for 
coached  students;  these  residuals  were  averaged  within  peak  test 
administration  months  within  coaching  schools  to  produce 
coaching/ self -selection  effects.  Bayesian  methods,  utilizing  the 
concept  of  "borrowing  strength"  or  "smoothing"  to  obtain  esti- 
mates for  smaller  schools,  were  employed  to  estimate  the  overall 
effect  at  each  of  the  three  schools,  averaged  out  over  years. 

The  general  impression  given  by  this  analysis  is  similar  in  spir- 
it to  that  given  by  the  ftc  reanalysis:  for  the  school  with  the 
strongest  coaching/self-selection  effects,  smoothed  estimates  of 
the  effects  averaged  over  years  range  from  16.9  points^on  sat- 
Math  for  Juniors  to  28.5  points  on  sat- Verbal  for  juniors,  with 
standard  errors  in  the  range  9.2  to  18.6;  for  other  schools  the 
smoothed  estimates  of  the  effects  tend  to  be  smaller.  . 

In  exploring  interactions  between  the  coaching/self-sclection 
effect  and.  various  background  variables,  it  was  discovered  that  at 
one  school  showing  overall  negligible  effects  black  students  ex- 
hibited a  much  higher  average  coaching/self-Selection  effect  (46 
points)  than  whites.  This  interaction  appeared  to  be  separate 
from  an  interaction  with  parental  income,  which  was  also  found 
to  be  statistically  significant. 

97 

1018 


1014 


Summary  of  Background  ' 

This  report  is  a  reanalysis  of  data  which  wci/first  analyzed  by  the 
Boston  Regional  Office  of  the  Federal  Trade  Commission  (ftc) 
(1978)  and  then  reanalyzed  by  the  Buwfau  of  Consumer  Protec- 
tion (bcp)  (1979)  in  the  ftc  central  oUiCem  Washington,  D.C.  The 
purpose  of  the  original  study  was  to  determine  how  much  effect 
preparation  under  the  guidance^ commercial  coaching  schools 
had  on  the  Scholastic  Aptimdc  Test  (sat)  scores  arid  the  Law 
School  Admissions  Test  J£sat)  scores  of  the  clients  of  those 
schools.  The  reanalysis^t  the  sat  data  was  undertaken  by  the  bcp 
because  serious  defect^  had  been  discovered  in  the  original  Bos- 
ton office  analysis/  specifically,  observational  studies  had  been 
made  on  two  groups,  coached  and  uncoached  students,  and  re- 
gression lines  of  sat  score, on  Preliminary  Scholastic  Aptitude 
Tests  (psat)  score  had  been  compared'  with  no  attempt  either  to 
present  staiidard  errors  or  to  correct  for  values  of  background  vari- 
ables. There  are,  in  fact,  systematic  differences  between  coached 
and  uncoached  students  with  respect  to  such  background  charac- 
teristics as  high  3chool  achievement,  race,  and  self-reported  par- 
ental income.  There  are  also  systematic  differences  in  the  distri- 
bution of  these  variables  for  students  attending  the  two  schools 
included  in  the  ftc{1979)  reanalysis. 

The  purpose  of  the  present  study  is  an  independent  investiga- 
tion of  the  SAT  data  analyzed  and  reanalyzed  by  the  ftc.  Extensive 
use  is  made  here  of  background  variables,  as  was  done  in  the  ftc 
reanalysis.  However,  this  reanalysis  differs  from  the  ftc  reanaly- 
sis in  a  number  of  ways.  These  ways  will  be  described,  following 
a  summary  of  the  ftc  reanalysis. 

The  FTC  data  set  began  with  about  2000  enrollees  at  two  coach- 
ing schools  in  the  metropolitan  New  York  area  during  the  period 
1974-77  for  whom  sat  scores  and  background  data  were  available 
There  were  600  enrollees  whose  names  were  not  found  in  the  ets 
file  of  test-takers  in  certain  zip  code  areas  of  Connecticut,  New 
Jersey,  and  New  York  which  were  considered  to  be  primary  mar- 
ket areas  for  the  participating  coaching  schools.  Most  of  these, 
presumably,  had  not  previously  and  did  not  subsequently  take 
the  SAT  or  did  not  take  it  in  the  metropolitan  New  York  area. 
There  was  also  a  third  coaching  school  whose  enrollees'  data 
were  not  analyzed  by  the  ftc,  because  the  numj)er  6f  individuals 
involved  was  considered  too  small.  A  control  group  of  about  2500 
uncoached  students  was  chosen  from  among  persons  taking  the 
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SAT  during  the  same,t1iree-year  period  in  the  same  geographical 
area  using  a  systematic  sample  of  every  150th  student  in  the  file 
provh-ied  by  Educational  Testing  Service  (ets). 

In  the  FTC  feanalysiS;  multiple  regression  analyses  were  per- 
formed on  six ^ubsamples: 

1.  High  sc)iool  juniors  taking  the  sat  for  the  first  tim^e  in  April 

1975.  (76  coached  and  607  uncoached  students) 

2.  High  school  juniors  taking  the  sat  for  the  first  time  in  April 

1976.  (247  coached' and  617  uncoached  students) 

^.  High  school  seniors  taking  the  sat  for  the  second  time  in  No- 
vember 1975.  (98  coached  and  396  uncoached  students) 

4.  High  school  seniors  taking  the  sat  for  the  second  time  in  No- 
veml)cr  1976.  (177  coached  and  387  uncoached  students) 

5.  All  high  school  students  taking  the  sat  for  the  first  time  on 
any  of  the  test  dates  over  the  3-year  period.  (417  coached  and 
1 763  uncoached  students) 

6.  All  high  school  students  taking  the  sat  for  the  second  time  on 
any  of  the  test  dates  over  the  3-year  period.  (316  coached  and 
1267  uncoached  students) 

Background  variables  included  in  all  regression  analyses,  in 
roughly  decreasing  order  of  importance,  were:  pretest  score  (psat 
Verbal  or  Math  when  satI,  the  first  sat  taken,  was  being  pre- 
dicted, SAT  1- Verbal  or  -Math  when  sat2,  the  second  sat  taken, 
was  being  predicted,  using  the  Verbal  pretest  to  predict  the  Verbal 
score  and  the  Math  pretest  to  predict  the  Math  score),  self- 
reported  grade  in  English  or  math,  self-reported  rank-in-class, 
self-reported  years  of  high  school  instruction  in  English  or  math, 
.self-reported  parental  income,  sex,  race,  high  school  type,  and 
number  of  psats  taken  (for  predicting  satI).  Coaching  school 
(School  A-or  B)  was  entered  as  a  dummy  variable.  Time  between 
pretest  and  test  was  also  entered,  but  it  did  not  increase  predic- 
tion significantly.  Only  those  students  with  complete  data  were 
entered  in  the  regression  analyses. 

The  analyses  showed  that  students  from  School  A  scored  signif- 
icantly higher,  on  the  average,  than  uncoached  students.  Ninety- 
five  percent  confid<incej|Knits  for  the  differences  in  adjusted 
means,  based  on  the  median,  lowrer  confidence  limit  and  median 
upper  confidence  limit  over  the  1 2  analyses  (6  subsamples.  Verbal 
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and  Math  scores);  were  14  and  38.  Coached  students  from  School 
B  did  not  earn  significantly  higher  scores  than  uncoached  stu- 
dents, with  median  confidence  limits  of -12  and  -MP. 

The  Ffc,{1979)  report  tlien  presented  a  regression  analysis  pre- 
dieting  PSAT  scores  from  the  same  background  variables  as  above. 
When  actual  and  predicted  psat  scores  were  compared,  the  stu- 
dents coached  between  the  psat  and  satI  had  significantly  lower 
residual  scores  on  the  psat  than  the  uncoached  students.  They 
thus  appeared  to  be  "underachievers  on  standardized  tests."  A 
similar  analysis  was  carried  out  for  satI  scores.  Tlj^iinding  was 
that  students  coached  between  satI  and  sat2  had  significantly 
lower  residual  scores  on  satI  than  uncoached  students.  The  con- 
clusion, as  reported  in  the  ftc  reanalysis,  was  that  obtaining  pre- 
test scores  that  were  lower  than  predicted  firom  background  vari- 
ables might  have  been  a  factor  in  enrollees  selecting  themselves 
for  coaching  schools.  Since  pretest  was  the  strongest  predictor 
variable  m  the  coaching  regression  analysis,  this  self-selection 
effect  could  account. for  some  of  the  difference  between  adjusted 
means  of  the  coaj:hed  and  uncoached  groups. 

The  FTC  reanalysis  then  attempted  to  control  for  this  self-selec« 
tion  by  recomputing  the  original  regression  analysis  with  the  pre- 
test removed  from  the  set  of  covariates.  In  this  analysis  the  ad- 
justed means  for  coached  students  at  School  A  were  above  those 
of  uncoached  students,  but  the  difference  was  not  significant  at 
the  5%  leveL(median  confidence  limits  of  *5  and  4  30).  Finally, 
in  an  effort  to  see  whether  this  self-selection  in  the  form  of  under- 
achievement  on  standardized  tests  was  consistent  or  random, 
both  PSAT  and  satI  scores  were  predicted  for  students  who  were 
coached  between  satI  and  sat2.  Since  residual  scores  for  both 
PSAT  and  satI  for  these  coached  students  were  found  to  be  nega- 
tive and  significantly  lower  than  residual  scores  for  uncoached 
students,  this  was  taken  as  evidence  that  the  underachievement 
was  "consistent"  rather  than  "random  "  Hence,  when  the  scores 
of  these  students  improved  after  attendance  at  coaching  school, 
the  improvement  was  attributed  to  coaching  rather  than  to  any 
self-selection  effect.  ^ 

It  seems  quite  plausible,  however,  especially  since  the  coached 
groupjs  are  so  small,  that  students  may  have  selected  themselves 
for  coaching  on  the  basis  of  negative  measurement  errors  in  both 
PSAT  and  satI.  In  any  case,  we  are  dealing  with  an  observational 
study  where  the  self-selection  effects  are  likely  quite  complex 
and  It  IS  not  possible,  from  the  data  provided,  to  disentangle  the 
effects  of  self-selection  from  the  effects  of  coaching.  How  much  is 
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a  coaching  effect  and  how  much  is  a  self-sefection  effect  may  be 
speculated  upon;  but  it  cannot  be  determined  from  the  data  


Differences  Between  This  Analysis  and  the  FTC  Reanalysis 

In  the  FTC  (1979)  reanalysis,  verbal  background  variables  (e.g  , 
PSAT-V,  grades  in  English,  years  of  English)  were  used  to  predict 
SAT-Verbal  scores  axid  quantitative  background  variables  were 
used  to  predict  SAT-Math  scores.  It  was  found,  however,  that  both 
Verbal  and  Math  psat  scores  were  important  in  predicting  both 
SATl-V  and  SATl-M.  Similarly ,  :both  sat1-V  and  -M  scores  were 
valuable  in  predicting  both  sat2-V  and  sat2-M  for  the  seniors. 
•The  number  of  years  of  English  taken  did  not  additionally  con- 
tribute to  the  predictive  value  of  any  regression  equation  when 
the  other  variablcJ^verc  already  entered. 

The  FTC  reanalysis  dealt  with  the  six  subsamples  given  earlier 
The  analysis  presented  here  deals  with  the  peak  1975  month  and 
peak  1976  month  only— subsamples  1,  2,  3,  and  4  in  the  ftc  study 
—and  omits  the  combined  subsamples  5  and  6  which  were  re- 
garded as  too  heterogeneous. 

An  additional  difference  is  that  missing-value  techniques  were 
used  here  so  that  students  who  did  not  report  parental  income, 
race,  or  rank-in-class  could  nevertheless  be  included  in  the  pres- 
ent analysis;  such  students  were  excluded  from  the  regression 
equations  in  the  ftc  reanalysis.  Furthermore,  in  the  ftc  reanaly- 
sis, students  from  the  coaching  schools  who  did  not  receive  their 
coaching  prior, to  the  sat  administration  irt  question  were  added 
to  the  sample  of  unuoached  students.  Since  this  destroys  the  rep- 
resentativeness of  the  systematic  sample  of  every  150th  un- 
coached  student,  they  were  excluded.in  the.present  analysis 

Although  the  ftc's  data  set  involved  three  coaching  schools, 
only  Schools  A  and  B  were  used  in  the  ftc  reanalysis,  because  the 
enrollment  in  School  C  was  considered  to  be  too  small.  Further- 
more,  the  student  populations  from  Schools  A  and  B  were  fre- 
quently amalgamated  so  that  the  report  refers  to  "coached  stu- 
dents/' The  position  taken  here  is  that  each  coaching  school  is  a 
separate  population  and  thus  the  three  coaching  schools  are  iden- 
tified separately.  Estimates  are  provided  for  these  three  schools 
which  utilize  the  empirical  Bayes  concept  of  borrowing  strength, 
and  which  also  allow  for  the  possibility  of  predicting  coaching/ 
self-selection  effects  in  the  same  schools  in  future  years  (under 
certain  assumptions). 
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Aims. of.  Tins  Analysis  and  Summary  of  Statistical  Methods  _  __ 

Students  who  select  a  coaching  program  at  a  commercial  coach- 
mg  school  tend  to  differ  in  two  major  v/ays  from  the  vast  majority 
who  do  not  do  so,  namely, , motivation  and  financial  means. 
Those  who  do  not  have  highci-than-ayerage  financial  means 
must  be  even  more  strongly  motivated.  Although  there  are  many 
students  who  do  not  obtain  coacliing  who  are  highly  motivated  to 
do  well  on  the  sat,  there  are  also  many  wHose^motivafion  is  poor." 
A  reduced  motivation  was  concluded  to  be  one  of  the  factors  in- 
volved in  the  SAT  score  decline  of  reqent  years  (Wirtz  et  aK,  1977). 

The  view  taken  in  the  present  analysis  is  that  the  data  provide 
no  way  of  distinguishing  the  effect^of  coaching  from  the  effect  of 
self-selection  or  motivation.  There  is  a  rough  proxy  for  financial 
means  (self-reported  parental  income)  but  there  is  no  proxy  for 
motivation.  There  may  also  be  other  factors  an  the  self-selection 
into  coaching  which  we  have  not  pinpointed.  Therefore,  differ- 
ences in  SAT  score  after  coaching  between  coached  students  and 
uncoachcd.students  will  be  called  combined  coaching/self-selec- 
tion effects. 

Because  of  the  obvious  differencesj^n  character  between  the 
coached  and  uncoached  populations  (e.g.,  higher  grades  and  rank- 
in-class,  higher  parental  income,  and  higher  percent  enrollment 
,  in  privxUe  schools  for  coached  students),  it  would  be  unreasonable 
to  suppose  that  the  mean  sat  scores,  after  controlling  for  all  co- 
variates. imaginable,  would  be  exactly  the  same.  Hence,  an  hy- 
pothesis of  no  coaching/self-selectlon  effect  was  avoided.  In- 
steady  the  coaching/self-selection  effect  at  each  coaching  school 
was  estimated  along  with  a  standard  error  for  the  estimate.  A 
coaching/self-selectiqn  effect  whose  magnitude  exceeds  a  certain 
number  of  standard  errors  (say  2  or  2.5)  would  be  regarded  as 
being  "significant"  in  the  traditionaj&^sense. 

The  analyses  contained  herein  were  performed  separately  on 
four  dependent  variables.  SAt1-V  scores  of  juniors,  sat1-M  sdores 
of  juniors,  sat2-V  scores  of  seniors,  and  sat2-M  scores  of  seniors. 
As  mdicated  earlier,  analysis  was  restricted  to  students  whose  sat 
was  taken  in  the  peak  month  (April  for  juniors,  November  for  se- 
,  niors)  of  1975  and  1976. 

The  first  stage  of  the  analysis  was  to  obtain  a  multiple  regres- 
sion equation  for  juniors  and  a  multiple  regression  equation  for 
seniors  for  each  dependent  variable  based  on  the  sample  of  un- 
coached students.  Next,  these  equations  were  applied  to  the 
coached  students  in  order  to  predict  the  sat  scores  for  the  coached 
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students  as  if  they  had  been  uncoached  students  with  the  same 
values  pf  predictor  variables.  Residuals  from  these  regressions 
were  calculated.  The  coaching/self-selection  effect  is  thought  of 
as  the  typical  value  of  these  residuals.  Separate  coaching/self- 
selection  effects,  together  with  stand^d  errors,  were  calculated 
for  each  of  the  two  administration  years  for  each  of  the  three 
coaching  schools.  The  third  and  final  stage  of  the  analysis  was  an 
empirical  Bayes  smoothing  of  the  effects  across  administration 
years  and  coaching  schools.  The  analysis  is  described  in  greater 
detail  in  the  following  three  sections.  ; 

The  basic  aim  of  these  analyses  was  to  estimate  the  magnitude 
of  the  coaching/self-sclection  effects.  If  these  combined  effects 
are  small,  this  puts  a  ceiling  on  the  effects  due  to  coaching  at  the' 
three  schools  considered.  If  these  combined  effects  are  large,  one 
can  only  speculate  on  how  much  of  the  effects  can  be  attributed 
to  coaching  and  how  much  to  self-selection. 


Regression  Equations  for  the  Uncoached  Students 
The  modcHorthe  dalaTo'rffie  uncoached  students  is 


where  Y,  represents  the  score  on  the  dependent  variable  sat1-V, 
SATl-M,  SAT2-V,  or  SAT2-M  of  the  ith  student  (junior  or  senior,  de- 
pending on  the  dependent  variable),  N  is  the  number  of  un- 
coached students,  and  X,,  represents  the  score  on  the  ]th  predictor 
variable  of  the  ith  student.  The  set  of  p  predictor  variables  in- 
cludes a  dummy  variable  representing  the  administration  year. 
The  error  e,  is  assumed  to.have  constant  variance  a^. 

Although  the  Y,  were  measured  for  all  students,  some  students 
had  X„  missing  for  one  or  more  j.  Thus,  instead  of  obtaining  the 
coefficients  j8,  in  equation  |1)  from  a  least-squares  regression 
program,  the  following  method  was  .used.  The  maximum-like- 
lihood estimates  of  the  means,  variances,  and  covariances  of 
(Y„  Xn,  X,2,.w,X,p)  were  computed  using  the  program  based  on  a 
multivariate  normal  model  for  all  variables  with  some  observa- 
tions missing  (Rubin,  1974).  Estimates  of  the  coefficients  j3o  and 
j8,  (j  =  1,...,P)  were  obtained  from  the  resulting  estimates  using  the 
sweep  operator  (swp)  on  all  predictor  variables,  li  all  variables 
were  observed  on  all  individuals,  the  estimated  /3s  so  obtained 
would  be  the  least-squares  estimates.  This  method  is  more  effi- 


.Y,  =  /Jo  +  Sr=i/3|X,,V+c. 
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cient  than  that  of  computing  covariances  using  pairwisc-obscrved 
data  and  provides  consistent  estimates  under  more  modest  condi- 
tions (Rubin,  1976).  I 

Regression  coefficients  were  also  computed  :for  use  v^ith 
coached.^tudents  who  had' one  or  more  of  the  predictor  variables 
of  race,  hi^h  school  rank,  and  parental  income  missing.  For  exam- 
ple, Jor  a  student  who  had  all  three  of  these  variables  missing  a  re- 
gression eq^uation  which  did  not  involved  these  three  predictors 
was  used.  To  obtain  this  equation,  one  begins  withjthe  matrix  of 
maximum-likelihood  estimates  referred  to  in  the  preceding  para- 
graph and  applies  the  swp  operator  to  the  set  of  all  predictor  varia- 
bles excluding  race,  rank,  and  parental  income.  This  yields  the  re- 
gression coefficients  presented  in  the  last  column  of  Tables  la  to 
Id,  which  show  all  regression  coefficients  for  predicting  sat1-V, 
^at1-M,  SAT^-V,,and  sat2-M,  respectively.  Columns!!  to  7  give  re- 
gression coefficicn^b  for  other  missing  variable  patterns^  and  col- 
umn^l-givcs  Che  complete-data  regression.  The  list  of  all  predictor 
variables  studied  appears  in  Table  le.  ; 

,  Estimates  and  Standard  Errors 
^  '     of  the  Coaching/Seif.-Selection  Effect 

The  next  step  is  to  predict  the  sat  scores  of  coached  students 
using  the  equation  (1)  which  was  developed  for  uncoached  stu- 
dents. Denote  by  bo,b,,...,bp  the  estimates  of  )3o,)3i,.  .,/3p  obtained 
from  that  analysis.  Define 

YM,  =  bo  hSf.ibjXstn  (2) 

for  the  ith  student  from  coaching  school  s  taking  the  sat  in  year  t 
whose  background  data  |Xsi,„  Xsii2,  Xsi.pl  is  complete.  For  a 
student  v^ith  missing  data,  background  variables  comprise  a^' 
smaller  set  of  predictor  variables  having  subscripts  iri  the  subset 
A  C  [1,2,. ..,pl  (and  whose  scores  are  missing  in  the  complemei^'- 
tary  set  A^j,  define 

Y,„  =  b^+  Ebl'Xsn,  ^      __        :  (3! 

where  bf  are  the  regression  coefficient  estimates  ])ased  on  an, 
equation  using  only  the  variables  in  the  set  A.  The  values-of  i)^. 
and  b,^  for  the  subsets  A  being  considered  are  the  values  presented 
in  Table  la  to  le.  Ysi,  represents  the  predicted  score  of  the  {s,t,\]th^ 
coached  student,  ignoring  the  fact  tha{  he  was  coached,^  ^ 
For  each  coached  student,  the  quantity  d^i,  =  Y^u  -  Ys„  is  theri 
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computed.  This  is  the  residual  of  hi^  actual  score  from  his  pre- 
dicted score  and  represents  the  estimated  coaching/self-selection 
effect  for  that  one  student.  The  average  of  these  residuals  within 
the  (s,t)  cell,  denoted  by  ds*i,  is  ah  unbiased  .estimate  of  the 
parameter  5si,  which  is  defined  as  the  average  difference  between 
the  value  of  E(Y|X)  under  a  ^'correct"  model  for  coached  students 
in  the  (s,t)  cell  (vrfiich  rnay  be  a  different  value  for  each  student  in 
the  cell)  and  the  value  of  E(Y|X)  under  the  uncoached  model  (1). 
If  one  assumed  a  strictly  additive  coaching/self-selection  effcfct 
according  to  the  model  • 

where  j3o,  /3,,...,j3p  are  the  same  parameters  as  in  the  uncoached 
model  then  it  would  be  better  to  use,  instead  of  dsi,  a  weighted 
average  which  would  be  minimu/h-variance  unbiased  under  this 
model.  However,  as  pointed  oufj-in  Cochran  and.  Rubin  (1973, 
p.  42'4),  dsi  is  an  unbiased  estimite^of  even  when  Po,P\,  ',Pp' 
take  on  different  values  in  the  cojched  model. 

Tables  2  and  3  show  thGS^pU  sizes  for  the  uncoached  stu- 
dents and  the  coached  stu<rcnts,  respectively.  Table  3  also  shows 
the  number  of  students/who  were  removed  from  the  analysis  of 
coached  students  becayse  of  rare  or  extensive  missing  data  pat- 
tern?. To  have  includedjhese  data  patterns  in  thefenalysis  would 
have  made  the  computing  task  much  more  onerous  and  was  not 
deemed  to  be  worthwhile. 

Table  4  shows  the  estimated'coaching/self-selection  effects  dst, 
together  with  estirnated  standard  errors.  These  standard  errors 
are  calculated  on  the  assumption  that  model  (3)  holds  for  the 
coached  students. 


Smopthed^  Estimates  fox  the  Three  Coaching  Schools 
and  Predictive  Distribution^' for  a  Future  Year 

Bayesiar^methods  are  recommended  to  pf edict  the  coaching/self- 
selection  effect  in  a  future  year.  The  strx)ngest  advantage  of 
Bayesianxprediction  is  that  a  predictive  distributio^lox  a  future 
valqe  can  be  obtained,  which  can  be  made  to  incorporate  uncer- 
tainty due  to  the  effects  of  sampling  in  the  observed  data,  uncer- 
tainty due  to  year-to-year  fluctuation,  and  uncertainty  due  to  not 
knowing  certain  quantities  such  as  variances  between  schools 
and  variances  between  years.  An  additional  advantage  is  that  in- 
formation from^  schools  with  large  numbers. of  students  can  be 
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used  to  improve  the  estimates  for  schools  with  smaller  numbers 
of  students.  (In  problems  involving  hirger  numbers  of  groups,  a 
general  improvement  c^n^be  brought  about  by  smoothmg  all 
predictions  toward  the  grand  mean.]  In  this.section  the  Bayesian 
analysis  is  incorporated  into  the  model  and  the  smoothed  esti- 
mates of  the  Verbal  and  Math  coaching/self-sclection  ^ffects  for 
each  school  averaged  over  years  is  presented.  These  smoothed  es- 
timates also  serve  as  point  predittors  for  a  future  year.  Standard 
errors  for  these  prediction?  are  also  shown.  The  validity  of  these 
predictions  and  standard  errors  depend,  upon  the  following 
assumptions: 

1.  The  observed  d^  are  unbiased  estimates  of  the  coachirg/self- 
selection  effects  5^i,  the  standard  errors  shown  in  Table  4  repre- 
sent thejdncertainty  of  these  estimates, 

2.  The  quantities-^st  within  school  s  for  different  t,  both  past  and 

future,  are  nprmally^distribuied  about  the  expected  effect  b* 

for  thaC  school,  which  ^remains  constant  within  the  future 

range  being  predicted.  The  variance  of  the  6st  about  6*  is  the 

same  for  each  school  s.  The  value  being  predicted  is  5st  wl^ere  t 

represents  a  future  year. 

a      ^  '  .  -  \' 

In  the  3ayesian  analysis,  the  prior  distribution  of  the  expected 

effects  6s  is  a  normal  distribution.  The  standard  deviation  of  this 

distribution  anJ  the  standard^eviation  of  the  5^  within  school 

have  independent  prior  distributions  which  arc  each  aj^proxi- 

mately  constant  over  the  range  of  plausible  values.  The  posterior 

means  and  standard  deviations  of  the  5*  are  shown  in  Table  5. 

The  means  and  standard  deviations  of  the  predictive  distributions 

for  each  S^t  (s  =  A,     C>  t  =  a  future  year)  for  the  four  dependent 

variables  juniors'  sj^ii-V  and  sat1-M,  seniors'  sat2-V  and  sat2 

-M)  are  shown  in  Talile  6. 

Interactions  between  Coaching/ Self -Selection  Effects 
and  Background  Variables 

Tfre' question  now  arises,  is  the  co«ich  ig/se]f-selection  effect 
greater  for  some  subsets  of  the  student  pppuhition  than  for 
others?  To  explore^possible  evidence  of  such  interactions,  a  mul-^ 
tiple  regression  analysis  of  the  Verbal  and  of  the  Math  individual 
coaching/sclf-selection  effects  was  performed  on  the  set  of  vari- 
ables which  had  been  used  to  predict,  the  sat  scores.  This  was 
done  /or  the  three  largest  cells  of  coached  students,  namely  the 
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SAT2'seniors  of  School  A  and  the  satI  juniors  of  Schools  A  and  B, 
all  from  the  1976  peak  month  administration.  Only  students 
with  no  missing  values  on  background  variables  were  entered  in- 
to this  exploratory  analysis;  the  sample  sizes  were  102,  103,  and 
85,  respectively.  For  the  two  School  A  cells,  the  sums  of  squares 
and  degrees  of  freedom  for  multiple  regression  and  for  residual  are 
sho^n  in  Tabled;  theF-values  of  L106  (Verbal)  and  1.119  (Math) 
for  seniors  and  the  F-values  of  0.606  (Verbal)  and  0.735  (Math)  for 
juniors  are  not  significant*. 

For  the  School  B  juniors,  the  sums  of  squares  and  degrees  "of 
freedom  for  multiple  regression  and  for  residual  are  also  shown  in 
Table  7;  the  F-value  of  2.112  (Verbal)  is  significant  at  the  .05 
level,  while  the  F-value  of  1.587  (Math)  is  not.  To  discover  which 
variables  contributed  most  to  the  analysis  of  the  Verbal  individ- 
ual coaching/self-selection  effects,  the  squared  correlation  coeffi- 
cient (r^)  was  calculated  between  this  dependent  variable  and 
each  of  the  predictor  variables;  these  are  shown  iii  Table  8.  The 
most  significant  predictor  variable  is  RACE2n[=  1  for  black,  0  for 
nonblack)  with  r^  =  .0830.  The  square  of  the  partial  correlati(^n 
coefficient  (r?RACF.2)  was  calculated  between  every  other  predictor 
variable  and  the  Verbal  individual  coaching/self-selection  effect 
and  is  also  shown  in  Table  8.  The  most  important  predictor  varia- 
ble after  race2  is  entered  isjNCOME,  with  r%j>,cii  =  .0664,  or  r,RACE2 
=  -.258.  This  differs  little  from  the  r^  =  .0626  (r  =  -.250)  ignor- 
ing RACE2,  indicating  that  the  effect  of  self-reported  parental  in- 
come and  the  effect  of  black  vs.  nonblack  are  essentially  separate 
from  each  other.  Both  these  effects  are  statistically  significant  at 
.the  .05  level. 

The  remainder  of  this  section  is  devoted  to  the  stud^of  differ- 
ences in  the  coaching/self-selection  effect  across  races  or  minor- 
ity groups. 

*  Table  9  shows  values  of  background  variables  and  of  the  indi- 
vidual coaching/self-selection  effects  for  coached  students  who 
identified  themselves  as  blacks  w.ho  took  satI  as  a  junior  or  who 
took  sat2  as  a  senior  during  the  peak  administration  month  (and 
who  were  thus  included  in  the  analysis  of  this  rej)ort).  Theje  is  a 
strong  tendency  for  both  the  Verbal  and  Math'coaqhing/self- 
selection  effects  to  be  above  the  average  (cf.  Table  4).  For  the  Ver- 
bal effects  the  pattern  is  striking,  thirteen  out  of  fifteen  effects  are 
above  average  and  the  reniaining  two  are  only  very  slightly  telow 
average. 

A  significance  test  was  performed  blftWeen  the  blacks  and 
whites  from  Coaching  School  B,  since  13  but  of  15  coached  blacks 
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were  coached  at  that  school.  The  variable  studied  was  the -Verbal 
individual  coaching/self-selectic^'n  effect,  the  null  hypothesis  was 
that  the  'mean  for  blacks  equals  the  mean  for  whites.  Since  the 
overall  Verbal  averages  for  the  three  SchooJ  B  cells  (1976;juniors, 
1975  seniors,  1976  seniprs)  were  within  a  fairly  narrow  range 
(4.16  to  11.12,  from  Table  4|,  the  students  from  these  cells  were 
pooled.  ^ 

The  results  of  this  black-white  cdpiparison  are  shown  in  TablQ 
.10.  (The  data  set  used  excludes  18  s^tudents  who  identified  them- 
selves as  belonging  to  other  nonblack  minority  groups  and  who 
are  among  those  listed  in  Table  12|.)^Equality  of  population  var- 
iances for  black  and.  white  coachmg/self-selection  effects  was 
not  assumed.  The  Welch  approxinjate  t-test  was  used  (see,  e.g/, 
Brownlee,  1965,  p.  299).  The  2-sided  test  showed  significance  at 
the  .001  level,  with^the^average  for  blacks  being  46,7  points  above 
that  for  whites.  The  average  Math  Icoaching/self-selection  effdct 
for  blacks  also  exceeded  that  for  whites.,  but  the  difference  \yas 
not  statistically  significant.  / 

There  were  five  black  juniors  taking  satI  and  one  black  senior 
taking  sat2  at  times  other  than  pe  ik  administration  months,  so 
their  scores  have  not  been  include  !  in  any  analysis  described  so 
far.  A  tabulation  of  their  data  appe  irs  in  Table  11.  The  Verbal  ef- 
fects are  higher  than  the  corresponding  cell  averages  in  five  Cases 
out  of  six;  the  average  of  these  six  Verbal  effects  is  52.6  .points 
above  the  average  of  the  corresponding  cell  average  values.  The 
Math  effects  are  higher  than  the  (jell  ayevagesiour  tim^eslouL-oi-- 
six,  averaging  13.6  points  above  cell  average.  This  pattern  is  vir- 
tually the  same  as  that  observed  fcjr  the  blacks  who  took  the  sat 
in  the  j^eak  administration  months 

Finally,  the  data  for  students  who  identified  themselvefe  as  be- 
longing to  minority  groups  other!  than  black  are  presented  in 
Table  12.  Both  peak-month  and  ilonpeak-month  SAT-takbrs  are 
included.  The  individual  coachii^g/self-selectiori  effects  bear 
more  resemblance  to  those  of  white  students  than  to  thipse  of 
black  students.  1 


Conclusions 


The  year-by^year  estimated  effects  for  coaching  schools  A  and 
as  given-in  Table  4,.are  of  a  similar  4ize  to  those  presented  in  the 
FTC  report  (1979),  in  that  for  School  A  the  coaching/self'Selcctioi\ 
effects  range  from  20  to  34  sat  poihts  (from  3  to  6.9  standard*^ 
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errors)  and  for  School  Bsihc  effects  are  nonsignificant  except  for 
the  seniors'  sat2-M  in  1^5  |26  points  =  2.38  standard  error§). 
For  School  C  the  estimates^fluctuate  markedly  from  year  to  year, 
the  strongest  effect  being  the  juniors'  sat1-M  in  1975,  + 1,2  stan- 
dard errors  ^as  compared  with  -1,5  standard  errors  in  1976.  S 

The  smoothed  estimates  of  the  school-by-school  effects  aver- 
aged over  years,  given  by  Table  5,  are  only  slightly  smaller  for 
School  A  than  the  unsriioothed  estimates.  However,  the  standard 
deviations  shown  in  Table  5  are  larger  than  the  within-year  stan- 
dard errors  of  Table  4,  reflecting  the  year-to-year  fluctuation  ex- 
hibited in  the  data,  '^or  a  future  year  one  v/ould  predict  a  positive 
coaching/self-selection  effect  at  all  schools  (Table  6),  but  with  a 
standard  errorgreater  than  the  value  o£  the  predicted  effect  except 
for  SAT-V  at  School  A  ]predicted  effect  =  1.8  standard  errors  for 
)uniors,  1.3  for  seniors)  and  sat-V  for  juniors  at  School  C  (pre- 
dicted effect  =  L3  standard  errors).  ,  . 

It  is  impossible  to  judge  the  extent  to  which  each  of  these 
effects  IS  due  to  the  coaching  program  or  rather  to  personal  char- 
acteristics underlying  self-selection  of  the  coached  students 
However,  in  a  randomized  experiment  (Alderman  and  Powers, 
1979;  Rubin,  1979)  which  was  designed,to  be  free  of  self-selection 
effects,  special  preparation  programs  offered  in  eight  high  schools 
had  estimated  coaching  effects  ranging  from  6  3  to  12.5  sat 
points,  or  0.9  to  1.9  standard  errors.  The  larger  estimates  derived 
from  thcdata  analyzed  in  this  report  are  consistent  with  the  pos- 
sibility that  both  the  motivation  to  do  well  on  tests,  as  exempli- 
fied by  enrollment  in  a  commercial  coaching  school,  and  the 
coaching  program  itself  contribute  to  a  small  gain  in  sat  scores 

There  is  a  clear  and  strong  positive  difference  in  the  coaching/ 
self-selection  effect  of  blacks  over  whites  at  School  B,  as  shown 
by  Table  10.  Whereas  the  average  effect  for  the  132  whites  ana- 
lyzed hejre  was  virtually  nil,  the  average^coaching/self-selection 
effect  for  the  13  blacks  was  46  points,'or  4.47  standard  errors 
(Sx/vT?  -  10.39).  One  possible  interpretation  of  this  phenome- 
non is  that  blacks  have  an  initial  disadvantage  in  test-taking  that 
can  be  overcome  by  coaching.  However,  it  is.also  possible  that 
there  IS  a  greater  difference  in  personal  factors  such  as  motivation 
between  blacks  who  enroll  in  a  coaching  school  and  blacks  who 
do  not  than  between  whites  ^ho  enroll  and  whites  who  do  not. 
We  caution  that  it  would  be  unwarranted  to  take  the  relative  un- 
importance of  the  coefficients  for  race  in  the  multiple  regressions 
(Table  1)  as  evidence  against  the  hypothesis  that  blacks  are  disad- 
vantaged in  test-taking.  The  strongest  predictor  variable  in  the 
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multiple  regression  is  the  pretest  (psat  or  satI),  arid  a  race  effect 
could  conceivably  be  operating  there.' 

To  summarize,  this  study  has  shown  certain  relatively  small 
but  unmistakable  effects  of  coaching  and/or  of  self-selection. 
Further  study  is  needed,  perhaps  ixi  the  form  of  additional  ran- 
domized experiments,  to  shed  more  light  oh  the  subject  of  what 
portion  of  these  effects  is.duc  to  coaching. 
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Table  la. 

Regression  Coefficients  for  Predicting  sat1-V  Scores  for  Jiiniors 
(April  Administration) 
For  Compicie  Data  and  Various  Combinations  of  Missing  Variables 
,  (For  nathes  of  predictor  variables  see  Table  lc| 


EijUitinui  Numffcf  . 

VanahkNo 

/ 

2 

? 

4 

5 

6 

7 

8 

•  0 

-113 

-136 

112 

-136 

-109 

-133 

-108 

-132 

1 

.37 

-  19 

.33 

-.23 

.99 

.44 

.97 

.41 

2 

1.692 

1.908 

L680 

1.896 

1J45 

1.958 

1.730 

L945 

-.033 

.181 

-:042 

.173 

-.052 

.161^ 

-.069 

.146 

4 

-3.14 

-3.99 

-3.04 

-3.87  ' 

-377 

-4:61 

-3.59 

-4.42 

5 

,4817 

.4786 

.4958 

.4940 

6 

-6.1 

-6,5 

-8.5 

-8,9 

•  i 

-J.l 

'  -1.4 

-3.8 

-4.0 

8 

.3131 

.3151 

.3107 

.3136 

9 

13.3 

14,1 

13.4 

14-2 

13.4 

14.2 

13.6 

14.4 

10 

.174 

199 

.182 

.208 

.232 

.257 

.247 

.273 

11 

L093 

1.197 

L096 

1.201 

1.142 

1.245  . 

L153 

1.258 

12 

7,122 

7,217 

7.126 

7.222 

7.140 

7.235 

7.148 

7.244 

Table  lb 

Regression  Coefficients  for  Predicting sat1-M  Scores  for  Juniors 
(April  Administration) 
For  Complete  Data  and  Various  Combinations  of  Missing  Variables 
(For  names  of  predictor  variables  see  Table  1  e) 


Equation  Number 

VathsbkNo 

/ 

2 

3 

5 

6 

7 

«  . 

0 

-61  6 

-85  7 

-65.0 

-88.9'^ 

-60.2 

-84.2 

-63.5 

-87  4 

1 

-8.43 

-8.99 

-8.43 

-8.98 

-8.19 

-875 

-8.19 

-8.74 

2 

.028 

.246 

.063 

.278 

.049 

.265 

.082 

.296 

3 

1.575 

1.792 

1  571 

1.785 

1.567 

1784 

L561 

1.775 

4 

-8.67 

-9  52 

-8.39 

-9.23 

-8,92 

-976 

-8.60 

-9.43 

5 

,1889 

1858 

1870 

.1853 

6  _ 

.  18.1 

17  6 

17.1 

J6.1 

0" 

7  ^  ' 

''-16.8 

-17  1 

-17.8 

-18.1 

8 

.3163 

.3135 

.3153 

,3130 

9 

-14.1 

-13,4 

-14.4 

-137 

-14.1 

-13,3 

7I4.4 

-13.6 

10 

7.984 

8.00>> 

7.968 

7,993 

8.006 

8.03i\ 

7.992 

8.018 

:  IK 

6.871 

6.976 

6.904 

7.009 

6,890 

6.994  \ 

6.926 

7.030 

12 

1.478 

1.575 

L474 

1.571 

1.485 

1.582 

1.483 

K579 
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Table  Ic 

Regression  Coefficients  for  Predicting  SATl-V  Scores  for  Seniors 
(November  Administration) 
For  Complete  Data  and  Various  Combinations  of  Missing  Variables 
(For  namesof  predictor  variables  sec  Table  le) 


£4/ujn(m  Number 

8 

i 

z 

4 

5 

6 

7 

0 

-24.3 

-24,2 

-26.8 

-26.7 

-27:6 

-28,3 

-30.1 

-307 

1 

8.53 

8.53 

8.51 

8.51 

8.20 

8.19 

8.17 

8M6 

2 

.568 

.568 

.590 

.589 

,586 

.591 

.609 

.613 

3 

>-,128 

-.129 

-.149 

-.151 

-.148 

--.L41 

-.167 

-.160 

-,56 

-.55 

-.14 

-.13 

-.17 

-.19 

.23 

.21 

5  . 

-.260 

-.260 

-.256 

-.256 

6 

2.3 

2.-3 

4.0 

4.0 

7 

-13,2 

-13.2 

-12.5 

-12.5 

8 

-,001' 

-.002^. 

.008 

.008 

9, 

4.99 

4.98 

4,85 

4.85 

5.03 

5.05' 

4.86 

4.88 

10 

-.974 

/-.973 

-1.04 

-1.04 

-767 

-775 

-.843 

-.851 

11 

.709 

708 

.730 

.729 

.675 

.678 

.695 

.697 

12 

3.358 

3,358 

3,363 

3,362 

3.375 

3.377 

3.379 

3.381 

13 

.5706 

,5706 

,5698 

.5698 

.5651 

.5652 

.5643 

.5643 

14 

.0110 

.0110 

.0141 

,0141 

.0111 

.0111 

.0141 

.0141 

Table  Id 

Regression  Coefficients  for  Predicting  sat2-M  Scores  for  Seniors 
(November  Administration) 
For  Complete  Data  and  Various  Combinations  of  Missing  Variables 
(For  names  of  predictor  variables  sec  Table  Ic) 


Etiuauon  Number 

Vatidble  No 

1 

2 

J 

4 

6 

7 

8 

0 

-8.8 

-14.3 

-12.2 

-17.7 

-11.9 

-18.2 

-15.2 

-21.4 

1 

-2.59 

-2.65 

-2.61 

-2.67 

-2.90 

-2.97 

-2.92 

-3.00 

'2 

-  356 

-,313 

:,^r 

-.284 

-.340 

-  291 

«310 

-.262 

3 

.686 

746 

.656 

715 

.668 

734 

.640 

.706 

4 

-9.33 

-9.53 

-.8  73 

-8.94 

-8.96 

-9.19 

-8.40 

-8.63 

5 

^.240 

-.246 

-.232 

-.237 

6 

2.2 

2.2 

3.8 

3.8 

7 

-18  3 

-18>3 

-17.7 

-177 

B 

.074 

.073 

.083 

,082 

9 

-9.37 

-9.16 

-9.53 

-9.33 

-9>32 

-9.10 

-9.52 

-9.30 

10 

8.627 

8.55 

8.54 

8.46 

8.82 

8.74 

872 

8.64 

n 

1652 

3,675 

3,681 

3704 

3.621 

3.646 

3.650 

3.674 

12 
!3 

=-.026 

-.010 

-  019 

-  003 

-.010 

-.008 

-.004 

.014 

.0972 

.0980 

.0960 

.0969 

.0920 

.0929 

.0910 

.0918 

14 

.5329 

,5332 

.5371 

.5374 

.5329 

,5333 

.5371 

.5375 

m 
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Table  le 

Predictor  Variables  Used  m  Regression  Equations 


ViitidhJc  Notnc 

fx 

V 

y-Intcrcept 

1 

Aciministration  year  ju  —  iv/D,  i  —  ly/ oj 

I 

Coif  woM/^w*^^!  C*M*1trK  nri/}^  f/\iit  ml  ifVll 

ocii«reportco:cngiisn  ^raac  loiii  oi  iwj 

"% 
O 

qeit'reportcu  jviatngraoc  |Oui  oi  i\ryj) 

4 

High  School  type  (0=public^  1  =^other) 

5 

Self-reported  parental  income  (in  thousands) 

6 

RACEl  (1  if  Oriental,  Native,  etc.;  0  if  otherwise) 

7 

RACE2  ( 1  if  black;  0  if  otherwise) 

8 

Self-reported  rank  (scaled  out  of  100) 

9 

Sex 

10 

Years  of  mathematics 

11 

PSAT-M- 

]^ 

PSAT-V  , 

13 

SATl-V 

14 

SATl-M 

Taye2 

Numbers  of  Uncoached  Students  With  Complete  Data 

and  With  Various  Missing  Data  Patterns  . 
Jj975and  1976  combined,  peak  administration  months) 

,                                   Number  of  funwrs         Numljer  of  Seniors 
Ojm  Pattern  ^  TakwH^^Ml  Taking  iKtl 

Complete.........                                       711  517 

Missing:  Income,  Race,  Rank  ......                  1  *  - 

Income,  Race 9  6 

Income,  Rank  k                -                1^  ^ 

Income,.....,  143  94 

_         Race,  Rank. ,Q.  .  I 

Race.,,                                    .     10  7 

Rank                                       ^        19  15 

,  Other  Background  Variables 56  37 

PSAT./..\......                     -        0  67 

PS  AT  &  Background  *   0  -11 

Total  Students  Used  in  Analysis                       961  768 

)in  jnaly^i^  «l  moioit,  only  %luJcni*  wiih  f<AT  ^cwev  were  included  \ 
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Tabic  3 

Numbers  of  Coached  Juniors  With  Complete  dnU  With  Ir.^omplete  Data 


School  A 

School  n , 

School C 

Data  Pattern 

I97S 

1976 

1970 

1975 

J  976 

49 

103 

85 

16 

9 

Missing:  Income,  Race,  Rank  . . . 

*  f\ 

It 

1 

0 

0 

o 

A 
0 

] 

0 

3 

1 

z 

0 

0 

Inrnmi*                      .  » 

14 

19 

12 

3 

2 

Race,  Rank  »  ...  «... 

0 

1 

0 

0 

0 

1 

4 

2  ; 

1 

1 

1 

1 

6 

0 

1 

Total  Students  Used  in  Analysis. . 

71 

134 

108 

21 

13 

Other  Data  Patterns 

^  (not  used  in  analysis)  

5 

4 

3 

3 

1 

Total  Coached  Students  with  psat 

and  some  background  data  . .  - , 

76 

138 

111 

24 

l4 

Numbers  of  Coached  Seniors  With  Complete  and  With  Incomplete  Data 


SchiKilA  School  H  Sc1hH)1C 


197S 

1976 

1975 

1976 

1975 

1976 

45 

102 

15 

24 

7 

4 

Missing:  Income,  Race,  Rank  . .  ^ 

0 

"  0 

0 

0 

0 

0 

2 

1 

0 

0 

0 

0 

2 

2 

1 

0 

0 

0 

10 

13 

2 

9 

1 

2 

Race,  Rank 

1 

0 

1 

0 

0 

0 

5 

3 

0 

0 

0 

0 

Rank  

0 

2 

2' 

1 

0 

1 

Total  Students  Used  in  Analysis. 

65 

123 

2) 

34 

< 

9 

5 

Other  Data  Patterns 

0 

(not  used  in  analysis) 

5 

7 

0 

0 

1 

Total  Coaehed  Students  with  psat 
and  some  background  data  .... 

70 

130 

21 

34 

10 

5 

114 
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luniors 


Tablc.4 

Coaching/Self-Selection  Effects  and  Their  Standard  Errors 


SAT- Verbal 


1975SAT1.V 
School   Effeci  SE 


A 

B 
C 


27,44  6.66 


17:88  11.19 


1976SAT1-V 
Bfffct  IE 

34.13  5.23 
4,16  6.38 
25.64  14.10 


SaT-MaTH 


1975  SAT  I'M 
School   EfUci  SE 


A 

B  , 
C 


22.36  7.45 


27.68  12.52 


1976SAT1-M 
Effect  S.E^ 

20.37  5.85 
3.71  7.14 
-23,32  15.79 


Seniors 


1975sat2'V 
School   Effect  S.E 


1976sat2-V 
Effeci  S^E 


A  32.07  5^86  31,34  4.51 
B  11,12*  10.16  4.76  8.05 
C  -10.47  14702  ^0.30  18:70 


1975SAT2-M 

School   Effect  SB 


1976SAT2-M 

Effect  SE 


A  22.54  •6.41  32.62  4.93 
B  26.40  inO  8.07  8.80 
e"-24;34  15r33  --21,57  20,44 


Tables 

Smoothed  Estimates  of  Coachmg/Self-Selection  Effects 
,  I  Posterior  Means  and  Standard  Deviations) 
JUNioKs  Taking  satI 


Verbal 

Quanmative 

SchtH)l 

Mctw 

Sul  Pevtatton 

Mean    StJ  Deviation 

A 

28.5 

9,2 

16.9  ,  18«6 

B 

9.7 

12.8 

7.8  23.0 

C 

20.9 

10.7 

8.4  19.5 

Seniors  Taking  sat2 
Vcriul  Quantitntive 


SchtHil 

Mt'tin 

StJ  Ocvhitton 

Mctw 

Std  Dcvtattan 

A 

ISA 

llA 

24.0 

15.1 

B 

9.4 

12  3 

17.2 

15.3 

C 

6.1 

15.0 

12.0 

17.6 

ERIC 
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Tabk6 

Predictive  Means  am'  Standard  Standard  Deviations  of 
Coaching/Sclf-Selection  Effects  for  a  Future  Year 

Juniors  Taking  SAT  1 
Verba!    .        ^  Quanmativc 
School        M(an    StJ  Deviation         Mean    Sid.  DeviaUon 


*  A 
B 


School 


A 

B 
C 


28.5 
9J 
20.9 


28.4 
9.4, 
6-1 


15.7 
18.0 
16.7 


2K6 

21>8.  . 
23.4;'  . 


16.9 
7.8 
8.4 


24  J) 
17!2 
12.0 


35.9 
38.4 
36.4 


28.7 

30.1"  ^  , 


Seniors  Taxing  sat2 
Verbal  Quantitative 

Meo    StJ.  Devtaiton         Mean    SlJ,  Deviation 


Table  7 

Multiple  Regression  Statistics  for  the  Regression  of  the  Individual 
Coachmg/Self-Selection  Effect  on  Pretest  and  Background  Variables 
(1976  Peak  Month  Administration) 

School  A  tumots  School  A  Sentots  School  B  tuniors 


smI-V 

SATlQ 

$at2-V 

$at2Q 

$ATl-V 

SMiQ 

Regression:  SS 

.  21396 

23353 

27461 

32367 

61005 

40070 

Regression:  DF 

10* 

10* 

13 

13 

11 

11 

Residual:  SS 

324662 

292338 

168088 

195754 

191707 

167531 

Residual:  DF 

92 

92 

88 

88 

73 

73 

R^ 

.062 

.074 

.140 

.142 

.241 

.193 

R 

.249 

.272 

.374 

.377 

.481 

.439 

F 

.606 

.735 

1.106 

1.119 

2.112 

1.587 

*  the  picdutt)!  vjrubk  KAi^t  Z  (bijck  v>  nunbUckl  wi%  omutcd  since  thirc  wire  nu  hljkk  »ttiilint>  m  this  cell 
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'Tables 

Squared  Correlation  Coefficients  between  the  Individual 
Coacjim^/Self-Selcction  Effects  and  Each  Predictor  Variable  Zero-Order 
Correlationjr^)  and  Partial  Correlation  after  Entering  race2  \r^^^ca\ 
{School  B  luniors,  April  1$>76  jPeak)  Administration,  Verbal  Only| 
Ptcihcwi  VjuohU  ^  ^  '    '  ^'wACtl 

Self-reported  English  grade  - 1  .0001  .0005 

Self-repot.tcd  Math  grade  t  . .  .0006  .0002 

High  school  type  I  0598  .0524 

Sclf-rcportcd  parental  income  ^  I  -0626  .0664 

raceL......,-..*.......  «  .  -0304.  ,0429 

«    RACE2,                                i  ^. . '  4  .-0830  ^  — 

Self-rJportedranlc.TT   ,  ...7...  \0168  .0093 

Sex   •!  -0492  .0433 

Years  of  mathematics. . ,    i  '0121  -0140 

rsAT-V             '  .0211  '  .0282 

psat-m'.;.  


•10^8 


227 


ERIC 


/ 


Juniors 


Seniors 


Table  9 


Background  Variables  and  Individual  Coaching/Self-Sclection  Effects  for  Coached  Students  Identified  as  Black 


B 
B 

b' 

B 

B 
B 

C 

A 

B 
B 
B 

B 


Adm. 
Date 

C/adc 

Math 
Ctade 

TVpe* 

Potential  ^nk  in 
Inconic  Class 

'  Ma'fh" 

V 

SAT  I 

-  V  M 

V  M 

tM  Effect 
V  M 

 _ 

'4/76 

85 

95 

NP 

7 

"  70- 

F 

r 

39 

33 

^  390 

380 

-0.7. 

4/76 

85 

75 

NP 

— 

70 

r 

4U 

4Z 

'  460 

450 

48,4 

64,7 

4/76 

85 

85  " 

NP 

.  5 

70 

M> 

4  \ 

31 

43 

400 

360 

69.3 

-62,9' 

4/^6 

85 

95 

p 

"17 

70 

M 

4  ! 

19 

49 

610 

560 

136.0 

42.6 

4/76 

85 

85 

.  p 

10 

— 

M 

4'  1 

49 

36 

480 

400 

24.0 

-10.2 

4/76. 

85 

95 

p 

— 

70  " 

rpr 

33 

58 

450 

550 

66.9 

8.6 

4/76  ^ 

*  95 

75 

NP 

35 

85 

F 

2 

45 

43 

500 

500 

20.2 

91.5 

4/76 

95 

85 

NP 

35 

85 

F 

3 

53 

**40. 

'  610 

510 

767 

86.6 

4/76 

85 

85 

NP 

10 

70 

3  ^ 

*31 

31 

390 

310 

70.2 

-23.3 

n/76 

85 

95 

P 

29 

95 

M 

4  . 

35 

46 

40b 

460 

4^0  560 

35.9 

.  78.5 

n/75 

85 

85 

NP 

8 

M 

2' 

38 

48 

460 

580 

500  560 

69.2 

•  29.0 

n/76 

.  75 

85  - 

NP 

30 

F 

'  4^ 

41 

38 

440 

390 

460  360 

36,5 

^34.5 

11/76 

85 

85 

NP 

35 

50 

M 

4 

32 

34 

290 

350 

340  ^330 

39.3 

-17.5 

11/76 

85 

85 

NP 

5 

70 

F 

35 

29 

290 

250 

320  "280 

M 

'4.8 

11/76 

85 

85 

NP 

50 

F 

3 

33 

33 

270 

280 

320  390 

17.4 

98.4 

•«.p^-  Public,  NP  *  Nonpublic 
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'    Table  10 

Test  of  Equality  of  Mean  Verbal  Coaching/Self-Selection  Effect 
for  Blacks  vsl  Whites  for  Coaching  School  B 
(Peak  Administration  Months,  1975  and  1976,  junior  satI  and  Senior  sat2  pooled) 

Bhcks^  Whitesy 

Sample  Size. ........  .       =  13         ^Ny  =  132       ^  v. 

Average  Effect. X  =  46.494      Y  =  -.255 
Sample  Variance   s^  -^  14^47      sj  =  2370.5 


'4 


X  -  Y 


=  4.165 


Degrees  of  Freedom  (Welch)  =  16.28 
•  P  <  .001  (two-sided) 
t  tKx,5  =  4.00 


Table  11  ^ 
Data  for  Six  Black  Coached  Students  Who  Took 
the  SAT  at  Tipes  OthcrThan  Peak  Administrations 

/umorWorSemorfSt  /  /    ,  /  ( 

Adminis;.rationDaic......i:,..;  6/75  12/7  5^  6/76  12/7  6 

Coaching  School   A  B.  B  B 

^nglish Grade     87  85  75  85 

Math  Cradel .  - . . .   85  95  85  95 

High SchoolType  .........   0  *1  1  0 

Parcniallncqmc  ..............  10  19  —  29 

RankinClasL...-......^....-  85  85  70  85 

Sex   1  1,2  1. 

Years  of  Math............   3  3  4  4 

PSAT-V......1<....   29  32  39  33 

i>SAT.M...v->U....   ,41  41  43  38 

SATl-V  ...... U.»-  '  450  -  400  410 

SATl-M..,...^   490  3§p  430  47.0 

sat2^V    -  -  -  - 

SAT2-M  \  . . .  *  —  —  "~ 

c/ssEffect(V)»........ .........  82.7  103.4  11.9  51.5 

Average  c/ssEf  feet  (VP...   27.4  4.2  4.2  4.2 

C/.SS  Effect  (M)»  I 68.9  -45.8  8.1  44.8 

AvJragcc/ss  Effect  IMP........  22.4  3.7  3.7  3.7 

'CjIcuUicJ  from  rcKrw5u»n  equation  based  onnc^icsi  I'cak  Administration  Dale 
Mvcfa^c  V-or  M*<ffcci  for  CoachinxSchtwIat  nearest  Peak Adminis-atiot*  Date 


6/75 
C 
95 
85 
0 
35 
70 
1 

3 

54 
47 
550 
490 


17.2 
17-9. 
-9.4 
27.7 


6/75 
A 
95 
85 
0 
8 
50 
2 
1 

r  33 
34 
280 
360 
450 
\430 
138SS 
32.1^ 
98.6 
22.5 
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Table  12 


iJackground  Varublcsian3  Individual  CoacJung/Scl^Sclcction  Effects  tor  O^acbi 


Schawl 


rucftoRic^n 


Seniors 


Ptue 


EnnUsh  Math     HS    PoifiltuJi  Rankin 
Ctmie   Ctade    Type'  Income     Ch$s  Sfx 


Mi 


Scniofs 


Other  Nonbljick 
hiniofs 


A 

4/ '6 

9S 

p 

.^5 

95  ^ 

^t  / 

0 

4/76 

9> 

95 

p 

/to 

8S 

F 

u 

r> 

4/76 

9^ 

95  ' 

p 

M  / 

4/76 

9^ 

9^ 

p 

1(1  . 

.95 

At  / 

A 

11/76 

75 

95 

NP 

A 

JI/76 

V5 

95 

95 

A 

11/75  » 

85 

95 

1' 

21 

Mi 
i'l, 

B 

.II/7S 

85 

8t 

2^ 

7(1 

M 
i>« 

C 

11/76 

95 

NP 

^5 

A  . 

4/76 

85 

9^ 

NP 

B  • 

4/76 

/  7S 

75 

NP 

> 

5(1 

M 

5  / 

12/75 

'  85 

-85 

NP 

7^) 

B  ' 

4/76 

V5 

8S 

NP 

70 

B 

12/76 

8S 

65 

NP 

i  ^) 

H 

4/76 

8S 

75 

NP 

)5 

4/76 

85 

8^ 

NP 

in 

6/76 

95 

95  . 

NP 

5 

'  S 

f 

g 

^^6/76 

95 

85 

NP 

7 

85 

F 

B 

1 1/75 

9v5 

85 

1 

in 

'  F 

^ 

1  i>'76 

.  95 

95 

KIP 

r* 

95 

I  F 

B. 

l)/76 

95 

9S 

NP 

|4 

9^ 

,'  F 

B 

1 1/76 

8^ 

85 

NP 

17 

1  P 

B 

i  I/7S 

9'> 

9S 

MU 

iNr 

M 

A 

,4/76 

87 

85 

P 

8^ 

F 

A 

4/76 

95 

95 

P 

25 

9> 

M 

A 

4/76 

95 

,  8^ 

NP 

29 

70 

M 

A 

4/76  . 

95 

-  85- 

P 

70 

A 

4/.76 

95- 

95 

P 

16 

95 

M 

A 

4/7S 

95 

95 

P 

^5 

f 

A  . 

4/76 

8^ 

8S 

NP 

1  ?  ' 

A 

4/7") 

85 

^5 

'II 

M 

A 

4/7^ 

95 

85 

P. 

8 

95  ' 

p 

B 

4/76 

95 

95 

NI* 

F" 

B 

4/76 

95 

95 

NP 

21 

«  1 

B 

4/76 

85' 

75 

NP 

7 

50 

F 

B 

4/76 

85 

7.5 

NP 

21 

5J)  ! 

M 

C 

.4/76 

9? 

9S 

P 

16 

95  ; 

M 

A 

11/76 

85 

95 

P 

15 

85  : 

M 

A 

11/76 

85 

NP 

14 

M 

A 

n/7S 

95 

05 

NP 

17 

fa 

M 

A 

I2/7S 

85 

85 

NP 

•70  i 

F 

B 

11/76 

85 

95 

NP 

70  i 

F 

B 

12/76 

7S 

.  825 

NP 

5(J  1 

F 

d  Students  Idcnuhcd  ds  Nonbl.ick  Mmuruy  Croup  Members 

» /\\  Bitca 


nat2 


V 

Af 

V 

40 

^4 

^80 

^  )u 

46 

58(i 

690 

V) 

450 

4*>0 

* 

40 

66 

470 
> 

68(1 

44 

71 

500 

?1(^ 

55' 

50 

610 

710 

oZO 

)0 

4^ 

30() 

52( 

450 

50 

41 

5.V1) 

JilO 

'>40 

49 

51 

520 

610 

510 

29  . 

34 

' 

40 

^8 

m) 

)8 

35 

420 

450 

44 

41 

5^0 

480 

4^ 

^5 

^80 

ill! 

^5 

)(K) 

•HO 

41 

^7  " 

4 

44 

4^ 

440 

440 

V 

■  V 

v;o 

4(K1 

^4 

46 

440 

)S0 

'44 

^9 

)20 

tin 

)50 

4  ?  . 

5^ 

if!l 

4ftO 

)1 

uo 

^5(1 

41 

190 

48 

5i 

480 

4W 

41 

55 

460 

6«I 

45 

5^ 

540 

560 

42 

46 

480  * 

550 

4) 

460 

^7 

54 

570 

65 

4) 

UiO 

420 

J8O 

450 

52 

547 

69iJ 

540 

4) 

55 

490 

5  V) 

44 

51 

450 

510 

44 

45  ' 

45t) 

44() 

20 

24 

260 

240 

49 

48 

490 

40 

7(,  ^ 

400 

(xMi 

4(KI 

\7 

51 

450 

480 

"450 

44 

58 

470 

6(K) 

'560 

?8 

46 

420 

480 

4)0 

24 

M) 

2  VI 

^80 

»220 

20 

M 

260 

270 

250 

•^p  *  Public,  NP  •  Nort^uMic 


104i 


760 
770 
550 
520 
560 


4VI 
i!lO 
570 

S50 


7(X) 

'  660 
520 
UO 
)10 


V 

Al 

15)  1 

>54  6 

74  \ 

*io  \ 

94  0 

.51  .) 

24  9 

1  4 

25  9 

>|  ^ 

9)  7 

1  ^9  8 

,)4  0 

)  6 

29  1 

- 1  ^ 

"52  5 

0 

16  6 

20  \ 

-45  8 

49  1 

4  )  ' 

\)  \ 

wr6 .  ^ 

-  io  9 

89  0 

-S2 

,  M  6 

W9 

-1  7 

~I29 

-4^6 

-y  ,\ 

-16  6 

•45  8  • 

-5).2 

-42  8 

28  9 

-4)  1 

-49J 

- 10  0 

28  7 

-68  4* 

24  4 

8*7 

-7U4 

12  ^ 

)8  6 

75  2 

*  H-0  ' 

25  0 

62  9 

)0  2 

-90  8 

7 

51.7 

2*  5 

-U8 

8j[t  7 

45  0  ,^ 

165  0 

>0  6 

4 

-26  9 

*19  2 

-2.)  6 

^\  \ 

»6  9 

U  6 

-51  9 

-2  2 

,>71  4 

\ 

'  110 

6  8 

)8  8 

79  5 

50  K 

4  \ 

n  1 

80  5 

-2  \ 

1)5 

u  \ 
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Appendix  3 
Rock  Rep^ort 


Disentangling  Coaching  Effects  and  Differential  Growth 
jn  the  FTC  Commercial  Coaching  Study 


Donald  A.  R05CK 


The  pre  studyjis  a,  pretcst/posttest  design  where^ subjects  are  not 
randomly  assigned  to /groups.  In  the  nomenclature  of  Campbell 
and  Stanley  (1^63);  we  have  a  special  case  of  a  quasi-experimen- 
tal design  known  as  the  noneguivalent  control-group  design  In 
the  classic  exp^^riment  vyith  random  assignment  the  only  rival  e'x- 
planation  to  the  treatment  being  the  causal  factor^s  sampling 
error.  However,  for  thcLnonequivalent  control-group  design,  both 
sampling  error.and  possible  seleci;^pn  bias  are  plausible  rival  hy- 
potheses. \ 

'  The  FTcBostpn  Regional  Office  analysis  (19^8)  and  the  rrc  Bu- 
reau df  Consumer  Protection  rearialysjs  (I979i)  relied  heavily  on 
the  ability  of)  the  traditional  analysis  of  clovariance  model 
Iancova)  to  rule  out  rival  hypotheses.  In  order  to  accept  the  ftc's 
interpretation)  of  their  ancova  results  JS  providing  reasonable 
estimates  of  jthe  treatment  effect  (coaching),  rather  strong 
assumptions  Have  to  be  made  about  the  appropriateness  and  com- 
pleteness of  their  covarlance  adjustment-model  for  the  data  set 
The  reanalysis  p'resented-in  this  paper  will  show  in  some  detail 
that  the  verbal  data^do  not  support  the  strong , assumptions  re- 
quired to  arrive  at  their  point  estimates  of  the  verbal  coaching 
effect.  The  mathematics  data  will  be  shown  to  be  more  consis- 
tehtlwith  thei/j  specification  of  the  analysis  of  covariance  model 
and  Ihus  more  liKely  to  produor  reasonable  estimates  of  the  math 
coac  iing  effecjs.  An  adjustment  procedure  approprij^te  for  the 
Verbil  data  will  be  outlined  and  applied  to  the  data.^New  esti- 
matck  of  the  coaching  effect  will  be  computed  and  compared  with 
the  rcsults  bascd  on  the  standard  ancova  model.  j 
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The  statistical  design  and  data  base  used  in  the  ftc  analysis  can- 
best  be  depicted  in  the  Campbell  &  Stanley  framework  as  follows. 

Treatment  (coaching)       Oi    I  O2 

Control  Oi  O2 

tl  h 

where  the  O's  are  observations  on  the  treatment  and  control  sub- 
jects at  two  different  points  in  time,  ti  and  t2.  The  I  indicates  a 
formal  intervention  has  taken  place  for  the  treatment  group  at 
point  in  time  between  the  first  and  second  observation.  The 
ANCOvA  model  traditionally  used  in  estimating  the  intervention 
effect  in  this  type  of  experiment  can  be  formulated  in  terms  of  the 
general  linear  model  ^ 

Y.(t2)  =  b,Y,(t|)  +  b2  0  +  e,    ,  (1) 

where  Y|  (ti)  =  posttest  score, 

Y,  (t,)  =  pretest  score, 

<^  =  dummy  variable  (1  =treatment,  O=control)  indicat- 
ing presence  or  absence  of  treatment,  and 

e,  =  random  error  term  that  is  assumed  to  be  uncorre- 
lated  with  treatment  group  membership. 

The  size  of  the  regression  weight  hz  in  relation  to  its  standard 
error  leads  to  a  judgment  about  the  presence  or  absence  of  a  statis- 
tically significant  treatment.  The  sign  of  b2  indicates  the  direc- 
tion of  the  effect.  In  this  particular  example,  a  finding  o(a  signifi- 
cant positive  b2  would  be  interpreted  as  evidence  for  the  presence 
of  a  coaching  effect.  A  finding  of  a  negative  b2  suggests  that 
coaching  has  a  debilitating  effect  on  posttest  scores. 

A  more  realistic  model  might  be 

Y.(t2)  =  h,Y,(t,)  +  b2  0+d'z  +  e,   ,  (2) 

where  2  =  vector  of  variables  which  are  assumed  to  be  causes  of 
self-selection,  and  d'  =  vector  of  regression  weights  associated 
with  the  self-selection  causes.  Relevant  causes  of  self-selection 
might  be  negative  self-perception  of  test  taking  skills,  motiva- 
tion, ability  to  pay  for  formal  coaching,  etc. 

In  the  FTC  study  we  have  no  direct  measures  of  these  self-selec- 
tion variables  and  thus  must  rely  on  proxies.  To  the  extent  that 
the  pretest  Y(t,)  and  the  proxies  oijjy  incompletely  (or  incor- 
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rectly)  measure  the  causes  of  self  selection,  the  estimated  regres- 
sion weight,  bi,  will  be  biased.  In  statistical  parlance  the  assump- 
tion of  the  mdependence  of  the  error  (ej  and  the  treatment  no 
longer  holds.  Furthermore,  if  the  coached  group  has  an  initially 
higher  mean  on  the  pretext  and  if  the  pretest  and  the  other  causes 
of  self-selection  which  are  either  imperfectly  measured  or  not 
measured  at  all  are  positively  related  to  the  treatment  effect  and 
the  posttest  score,  then  we  can  expect  the  ancova  model  in  (2)  to 
overestimate  the  treatment  effect.  Conversely,  if  the  missing  or 
incompletely  measured  control  variables  are  in  general  negatively 
related  to  the  treatment  effect  and  posttest  score,  then  one  can 
expect  ANCOVA  to  underestimate  the  treatment  effect  If  they  are 
uncorrelated  with  the  treatment  a^d'the  posttest  (as  would  be  the 
expectation  in  random  assignment),  then  b2  would  give  an  unbi- 
ased estimate  of  the  treatment  efect.  Obviously  there  are  many 
other  more  complicated  patterns  of  relationships  which  could 
occur  and  for  which  no  simple  predictions  can  be  made  about  the 
direction  of  the  bias. 

Of  particular  concern  here  is  the  fact  that  motivation  is  either 
incompletely  measured  or  not  measured  at  all  by  the  available 
demographic  control  variables.  Since  onc  of  the  consequences  of 
.motivation  is  learning  performance,  one  would  expect  a  measure 
of  motivation  to  be  positively  correlated  with  both  performance 
at  the  posttest  and  self-selection- for  the  treatment  (coaching) 
One  might  argue  that  differential  motivation  would  be  at  least 
partially  captured  in  the  pretest  score  and/or  other  covariates  in 
the  vector  z  and  thus  be*  partially  controlled,  but  in  general  that 
will  not  be  true  if  the  differential  motivation  is  reflected  (as  is  the 
likely  case)  in  differential  learning  or  growth  rates.  That  is,  even 
if  differential  motivation  were  completely  measured,  the  statisti- 
cal correction  employ.ed  by  ancova  is  a  static  correction.  The 
ANCOVA  adjustment  only  makes  a  correction  for  differences  found 
at  the  time  when  pretesting  takes  place.  The  treatment  does  not 
occi2r  at  the  time  of  pretesting  but  at  some  later  date  when,  if 
there  is  differential  group  growth,  the  groups  will  be  further  apart 
than  they  were  at  pretest  time.  The  traditional  ancova  correction 
adjusts  for  the  differences  found  at  pretest  time  and  not  the 
greater  group  difference  that  would  occur  (because  of  differential 
group  growth  xates)  )ust  previous  to  the  intervention,  which  in 
this  case  takes  place  at  an  unknown  period  of  time  after  the 
pretest. 

This  underad)ustment  bias  in  the  presenxie  of  differential  group 
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growth  can  be  made  a  little  clearer  if  we  examine  the  ancova 
model  in  the  following  form: 

cc  -  (Yp(t,I  -  Yc(t2)l  -  b  |Yp(ti)  -  Yc(t,)l   ,  (3) 

where  Ypftj)  and  Ypjt,)  are,posttest  and  pretest  means  for  the 
coaching  program  group,  Yc(t2)  and  Ydti)  are  the  parallel  mea- 
sures for  the  control  group,  and  a  is  the  estimated  treatment 
effect.  The  pooled  within-group  regression  coefficient  b  is,  of 
course,  the  adjustment  index.  If  there  is  reason  to  believe  that  the 
following  differential  development  or  growth  process  is  taking 
place: 


tl 


*  Figure  I 

then  any  adjustment  based  on  the  initial  group  differences  at  pre- 
test time  (ti)  rather  than  at  t^  will  overestimate  the  treatment  ef- 
fect unless  b,  the  adjustment  index,  is  equal  to  di/di.  In  fact,  any 
adjustment  based  on  group  differences  at  time  t^  will  still  over- 
estimate the  treatment  effect  (although  substantially  less  than  an 
adjustment  at  t,)  unless  the  adjujtment  index  is  greater  than  10 
In  general,  most  pre-post  ancovas  based  on  data  from  nonequiv- 
alent  control  group  designs  yield  bs  =  1.0.  The  ^'net  effect"  of  the 
adjustment  made  by  the  ftc  analysts  using  an  ancova  model  sim- 
ilar to  that  outlined  in  equation  (2)  was  equivalent  to  using  a  b  of 
approximately  1.0  in  equation  (3)  for  the  verbal  data  and  some- 
what oyer  1.0  for  the  mathematics  data  Clearly,  the  traditional 
ANCOVA  model  as  posed  by  the  ftc  analysts  will  not  always  be  ade- 
quate if  individuals  are  growing  at  a  different  rate  over  time.  To 
deal  adequately  with  data  generated  by  growth  processes,  correc- 
tions for  initial  differences  must  take  into  consideration  (1)  the 
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time  variable  and  (2)  measures  of  differential  group  growth  rate  in 
the  absence  of  formal  intervention. 

The  FTC  analysts  did  not  investigate  the  possibility  of  differen- 
tial group  growth  rates  as  a  rival  hypothesis.  Their  verbal  ancova 
mgdel  implicitly  assumed  (and  its  validity  depended  upon  it)  that 
the  observed  group  differences  at  pretest  time  were  invariant  over 
time  in  the  absence  of  a  formal  treatment.  This  assumption  is  re- 
flected in  their  use  of  a  "net"  correction  index  of  b  a  1.0.  Con- 
versely, since  the  ftc  mathematics  ancova  yielded  a  "net"  cor- 
rection index  slightly  over  1.0;  the  ftc  mathematics  results  im- 
plicitly assumed  a  growth  model.  Campbell  (1969)  suggests  .t4iat 
if  two  groups  start  out  at  time  1  with  divergent  means,  those  with 
the  higher  mean  mature  or  grow  at  a  greater  rate  than-these-Ayith 
the  lower  mean.  Campbell  calls  this  the  interaction  of  selection 
and  maturation.  The  different  groups  are  members  of  different 
populations  living  in  different  environments,*  The  different  envi- 
ronments interact  with  differences  in  ability  and  create  and  main- 
tain different  levels  of  performance  and  different  rates  of  grov/jth 
A  special  case  of  this  differential  growth  phenomenon  is  the  so- 
called  "fan  spread"  model  which  postulates  that  increasing  varia- 
bility within  group  accompanies  increasing  mean  differences  over 
time  (Kenny,  1975).  The  "fan  spread"  hypothesis  is  only  one  pos- 
sible explanation  and  is  sometimes  used  to  arrive  at  a  correction 
index  when  group  growth  data  in  the  absence  of  intervention  are 
not  available.  In  its  strictest  sense  a  solution  is  obtained  by  the 
use  of  an  ov  er identifying  restriction  depending  on  the  stationarity 
over  time  of  the  ratio  of  mean  differences  to  changes  in  the 
within-group  variability.  Rather  than  make  any  such  assump- 
tions, we  will  use  the  obstrvtd  datalo  estimate  group  growth 
rates  in  the  absence  of  intervention. 

An  interrupted  time  series  design  could  provide  an  estimate  of 
the  relative  growth  rate  in  the  absence  of  a  formal  intervention. 
That  IS,  the  following  design  uses  growth  data  gathered  between 
time  to  and' 1 1  to 

P      O'         O    I  O 


•  ihc  Ffc  analysis  ui  the  gruup  dcmugraphic  variables  docs  provide  evidence  that 
individuals  injhc  j»clf-sclccted  population  tend  to  come  from  different  socio 
economic  environments  than  the  controls 
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yield  an  estimate  of  both  the  program  (P)  and  control  (C)  group 
rate  of  growth  in  the  absence  of  a  formal  intervention.  Fortunate- 
ly, the  majority  of  the  indiyiduals  who  attended  the  most  suc- 
cessful coaching  sc^hpol  (School  A)  had  three  testings  v/ith  a 
coaching  interventi6n  taking  place  between  time  t|  and  ti.  Fol- 
lowing the  growth  model  development  of  Bryk  and  Weisberg 
(1977),  we  assume  that  the  treatment  effects  a  constant  incre- 
ment for  each  subject  exposed  to  it.  Denoting  GJt)  as  the  actual 
.growth  for  individual  i  under  whatever  conditions  prevail,  we 
then  have  at  posttest 

Y.lta)  =  QN  +  <^,a    ,    "  '      (4)  ' 

where  =  1  if  the  subject  is  in  the  coaching  program  and  =  0  if 
the  subject  is  in  the  control  group.  G»(t2)  is  the  cumulative 
growth  of  the  itb  subject  at  the  time  of  posttesting  GJt)  is  com- 
pletely determined  by  two  parameters;  tt,  and    That  is: 

Gi(t)  =  7r,(t-ri);t^r,   ,  "  (5) 

where  tt,  is  an  individual's  growth  rate  and  r,  is  that  point  in  an 
individual's  development  at  which  he  achieves  a  prespecified  al- 
though arbitrary  level  of  performance.  For  the  purpose  of  this 
study,  the  E(r,)  =  r,  that  point  in  time  when  the  two  ^groups' 
growth  lines  intersect.  At  this  point  in  time,  the  groups  are  at 
equivalent  levels  of  knowledge.  (See  Figure  2). 


In  this  study,  we  are  interested  in  estimating  tt  fox  individuals  in 
both  the  coaching  program  group  and  the  control  group  based  on 
the  time  interval  between  the  first  and  second  testing,  i.e.,  before 
the  intervention  took  place.  Thus,  the  estimation  of  tt  for  the  ith 
subject  in  the  coaching  program  is 


7rpi  =  |Yp,  (tn)  -  Yp,(to,)l/(ei,  -  to,) 


(6) 
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That  IS,  the  g/owth  rate  is  the  difference  between  a  subject's. test 
scores  at  timd  to  and  t,  divided  by  the  time  interval  measured  in 
months.  The  expected  value  for  ^njndividual  selected  at  random 
from  the  treatment  group  (/*,p)  is  (Yp(t,)  -  Yp  (to)l/T,  where  T  is 
the  average  time  lapse  between  first  and  second  testings  for  indi- 
viduals in  the  coaching  program  group.  Similarly  can  be  esti- 
mated for  the  control  group  from  the  data  based  on  the  first;  and 
second  testing.  It  should  be  noted  that  in  the  case  of  random 
assignment  ft^p  =  Mttc 

A  more  appropriate'adjustment  index  which  takes  into  consid- 
eration the  possibility  of  differential  group  growth  rates  m^p  and 
fij^  as  well  .as  different  Ts  can  now  be  derived.  In  terms  of  the 
general  linear  covariance  model,  which  does  not  assume  differen- 
tial growth  rates,  v/e  have  the  estimated  treatment  effect  a  in 
large  samples  as 


Let  a  be  an  unbiased  estimator  of  the  treatment  effect  under  the 
assumption  of  a  differential  group  growth  model;  then 


where  Tp2  is  the  average  time  interval  between  r  and  the  third 
testing,  tj,  for  individuals  in  the  coaching  program.  Similarly  Tp, 
is  the  average  time  between  r  and  the  second  testing  for  the 
coached  individuals.  Parallel  notat  i  is  used  for  the  control 
group.  *  " 

Then  a  -  a  =  0  when 


Figure v3  presents  means  and  standard  deviations  of  the  verbal 
test  scores  at  three  points  in  time.  Similar  data  is  presented  for 
mathematics  test  scores  in  Figurij  4.  The  three  testings  consisted 
of  the  PSAT,  the  sat  taken  for  the  first  time  as  a  junior,  and  the  sat 


a  =  E(YpMl  -  E(Yc(t2)l  -  bUElYp(t,)l-ElYe(t,)jl  . 

(7) 


a  ={E(Yp(t2)-  M,pTp2l  -  ElYcN  -  M.cTc2ll  - 
bMElYp(t,)  -  M,pTp,l  -  ElYc(ti)  -  MxcTcill 


(8) 
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Figufc  3 

Vcrhal  Cains  Over  Three  Time  Periods  for  Four  Populations 

taken  for  the  second  time  as  a  senior.  Only  one  coaching  school 
(School  A)  had  a  large  enough  subject  population  to  furnish  suffi- 
cient subjects  with  all  three  data  points.  The  coached  sample  in- 
cluded>192  individuals  while  the  controls  numbered  684. 

The  verbal  data  in  Figure  3  suggests  that  the  observed  group  dif- 
ferences at.posttest  may  well  be  reflecting  differential  growth 
rates  as  well  as  treatment  effects.  The  classic  growth  phenome- 
non of  increasing  /means  is  demonstrated  for  both  the  coaching 
program  people  and  the  controls.  While  there  appears  to  be  a  sig- 
nificant differential  group  growth  rate  in  the  verbal  ar^a,  this  does 
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Figure  4 

Math  Gains  Over  Three  Tirhe  Pericxls  for  Four  populations 

not  appear  to  be  the  case  for  mathematics.  This  seems  reasonable 
since  mathematics  is  a  skill  which  requires  practice  if  one  in- 
tends to  maintain  or  increase  one's  level  of  achievement. 

Additional  plots  of  the  total  College  Board  sample  who  were 
tested  in  April  of  their  junior  year  and  retested  in  November  of 
the  senior  year  are  also  shown.  These.plots  are  presented  for  1975 
and  1976  populations.  Inspection  of  the  verbal  plots  suggests  that 
gains  of  1!^7  points  from  April  to  Noyeniber  appear  to  be  com- 
monplace foTjunTHt^^  rQtesters.  The  fact  that  the  control 
sample  shows  a  gain  of  11  points  over  approximately  the  same  in- 
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terval  suggests  that  they  are  rer^sonably  representative  of  junior- 
senior  retesters.  The  control  group's  rate  of  gain  is  consistent 
over  both  plotted  time  periods.  » 

Table  1  presents  ancova  and.growth  model  adjustment  indices 
and  coaching  effects,  as  well  as  the  mean  growth. rates  for  the 
coaching  program  and  coritrol  individuals  for  the  verbal  and 
mathematics  areas.  These  estimates  of  growth  are  based  on  the 
time  period  between  the  first  and  second  testing  and  thus  are  un- 
confounded  wif.  ajiy  formal  intervention.  Our  estimates  of 
growth  rates  assume  linearity  of  growth  but  this  would  seem  to 
be  a  reasonable  assumption  given  the  restricted  time  period  and, 
even  mori  importantly,  given  that  the  observed  data  for  the  con- 
trol group  conforms  quite  closely  to  a  linear  growth  model.  If  one 
were  to  expect  a  deviation  from  linearity,  it  wouldji(iore  likely  be 
in^thc  direction  of  a  steeper  slope  (in  the  absence  of  intervention) 
betwqcn  the  second  and  third  testing  since  the  motivational  level 
would  be  at  least  as  great  during  this  time  period  as  the  previous 
time  period. 

The  estimates  of  the  coaching  effect  under  the  growth  model 
are  about  17  points  on  Verbal  and  31  points  on  Math.  This  finding 
that  the  Verbal  effect  is  substantially  less  than  the  Math  effect  is 
in  marked  contrast  to  the  ancova  estimates  of  quite  comparable 
V  and^M  effects.  The  growth  model  appears  to  yield  an  estimate 
of  the  Verbal  coaching  effect**that  is  more  consistent  with  earlier 
studies  and  with  expectations  that  Math,  being  generally  more 
curriculum  related  than  Verbal,  might  be  more,  responsive  to 
coaching  or  special  preparation . 

The  Verbal  results  in  Table  1  call  into  question  the  ability  of 
the  standard;  angova  to  correct  for  selection  effects  when  they  are 
present  in  the  form  of  differential  growth  rates.  The  ancova  ad- 
justment index  (b)  is  approximately  1.0  for  the  Verbal  data  and 
somewhat  paradoxically  1.25  for  the  Math  data,  which  is  the  one 
situation  which  displays  little  or  no  evidence  of  differential  group 
growth.  However,  since'the  growth  rates  appear  to  be  static  for 
the  mathematics  data,  the  ancova  model,  which  controls  for  all 
available  measures  of  pre-existing  differences,  would  appear  to  be 
the  more  defensible  approach  for  estimating  the  mathematics 
"coaching"  effect.  ,  / 

An  additional  point  should  be  discussed  here.  The  original  ftc 
analyses  as  well  as  the  reanalysis  as  outlined  here  do  not  t^ke  into 
.  consideration  the  pos.sible  biasing  effect  of  using  a  fallible  covari- 
•  ate  (pretest)  in  adjusting  for  pre-existing  differences.  If  the  relia- 
bility of  the  tests  increased  with  each  testing,  one  would  expect 
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the  two*group;s  if  truly  from  different  populations  to  demonstrate 
increased  divergence  over  time  in  the  absence  of  intervention. 
This  phenpmeqon  would  not  seriously  affect  the  growth  mpdel 
approach  but  very  well  could  hgve  a  biasing  effect  on  the  ancova 
estimate  of  the  coaching  effect.  That  is,  ancova  would  yield  an 
overestimate  of  the  coaching  effect.  Similarly,  if  the  reliabilities 
are  constant  but  less  than  l.O  (as  surely  they- must  be),  then 
ANCOVA  would  underadjust  for  pre-existing  differences  on  the  pre- 
test, thereby  yielding  an  overestimate  of  the  coaching  effect  The^ 
data  were  not  available  to  investigajte  these  possibilities. 


Ta^lc  1  \ 

Mem  Growth  Ratcs,'Xd)ustmcni  Indices,  and  Estimated  ' 
Coaching  Effects  Under  Different  Model  Assumptions 

omt  Then  B\unuuc<  vfCiHidun^i  fffvcts' 
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Tabic  2  . 
Analysis  of  Covariancc  Models 
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Latest  Grade  in  English 
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Coaching 

Years  of  Math  .  , 
Years  of  English  ... 
Multiple  Correlation  > 
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VerM  hnttfst 

h 

h 

 f— 

.8024 

.0233 

.1538 

\0253 

.  .1307 

.0235  : 

,7760 

.0251 

..1286 

.1319 

.3201 

.1^03 

2.0659 

3.5128 

13.4507 

3.7389 

,5944 

.3134 

-.5246 

.3335 

-.,2336* 

.2559 

/.6165 

,2723 

6.4684 

3,6079 

-8.5227 

'1.8402 

-1.8385 

2.8870 

-.J.0852 

3.0728 , 

28.0658 

4.0403  ♦ 

27.6247 

4. .3004... 

-2.9292 

2.2961 

8.7692 

2,4400  . 

7.0633 

3.0307 

-2  8102 

3.2258  , 

R  - 

.8803 

R  = 

.8964 
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Summary  and  Conclusions 


The  FTC  data  based  on  individuals  who  ^tended  the  largc<^t  and 
most  successful  coaching  school  were  reanaiyzed.  The  examina- 
tioi?of  testings  at  three.points  in  time  suggested  that:  (1)  the  tra- 

•  ditional  ANCOVA  approach  used  by  the  ftc  was  inadequate  for  the 
Verbal  data  because  of  self-seleetion  effects  which  were  at  least 
partially  captured  in  k^fferential  group  growth  rates,  (2)  more  ap- 
propriate growth-refated  adjustment  models  yielded  Verbal 
coaching  effects  about  one-half-the  size  reported  by  the  ftc,  (3| 
"the^Mathdata  appeal td  to  be-^omewhat  more  consistent  with  the 

ANCOVA -model  and'  thui  the  resulting  ftc  Math  coaching-effect 
estimate  is  more  likely  to  be  reasonable  given  the  available  con- 
trol variables.  This  is  not.to  say  that  the  ftc  and  the  present  esti- 
mates of  the  mathemaUcs  coaching  effect  are  not  overestin^ates 
(or  underestimat'es),  since  the  only  self-selection  causes  that  have 
-  been  controlled  for  were  those  that  were  reflected  in  differential 
growth  raies  and/or  available  demograpjhics.  One  missing  piece 
of  information  is  thjr  reliability  of  the  te^t  scores  at  each  adminis- 
tration.. When  individuals  self-select  t^  treatments,  commonly 
held  psychometric  wisdom  suggest^  that  as  the  reliability  of  the 
pretest  becomes  significantly  less  than  |linity,  one  can  expect  the 
ANCOVA  model  t.o  underadjust,^therebyryielding  an  overestimate 
ot. coaching  effect.  In  general^  the  extent  of  this  source  of  error 
would  be  small  compared  to  the  corisequenccs  of  using  the  stan- 

•  dard  ancova  model  in  an  inappropriatelsituation* 

If  the  reliability  of  the  pretest  was  different  for  the  tWo  groups, 
V  t^en  almost  any  ancova  or  variation  ot  ANCOVA^would  in  general 
yield  biased^rcsults.  It  would  nor  be  expected,  however,  that  the 
group  reRal^ilities  would  he  sufficiently  different  to  significantly 
change  the  above  conclusions.  An  adpional  problem  with  any 
rehabihty  correction  is  tha,t  while  there  is^evidencc  here  that  the 
groups  are  from  different  populations  and  therefore  regressing  on 
different  means,  there  isno  way  of  kjiowing  from  the  available 
daia  what  the  appropriate  meaps  are. 
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Time  and  Method  in  Coaching  for  the  SAT 


Samuel  Mcssick  and  Ann  Jungcblut 
Educational  Testing  Service,  Princeton,  New  Jersey 


An  exhaustive  review  of  studies  of  coaching  for  theJScholastic  Aptitude  Test 
(SAT)  revealed  them  to  be  methodologically  flawed  in'a  variety  of  ways  Despite 
these  flaws  and  the  attendant  noise  Obscuring  the  results,  some  definite  regular- 
ities emerged  relating  the  size  of  score  effects  associated  with  coaching  to  the 
amount  of  student  contact  time  entailed  in  the  coaching  programs.  Rank^order 
correlations  between  rhese  two  variables  were  upwards  of  .7  for  both  SAT- 
V( Verbal  subscale)  and  SAT-M(Maih  subscale).  The  relationship  proved  to  be 
nonlinear,  howc*/er,  with  arithmetically  increasing  amounts  of  score  effect  being 
associated  with  geometrically  increasing  amounts  of  student  contact  time,  which 
in  these  data  may  also  be  serving  as  a  proxy  for  increasing  curriculum  emphases 
on  content  knowledge  and  skill  development  as  Opposed  to  item  review  and  prac- 
tice. Thus,  within  the  limitations  of  the  available  fragmentary  data,  there  appear 
to  \}c  diminishing  returns  in  SAT  coaching  effects,  especially  for  SAT-V.  Ac- 
cording to  the  logarithmic  models  tit  to  the  data,  the  student  contact  time  required 
to  achieve  average  score  increases  much  greiter  than  20  to  30  points  (on  a  200- 
to  800-point  scale)  for  both  SAT-V  and  SAT-M  rapidly  approaches  that  of  full-^ 
time  schooling. 


The  controversy  o\'cr  whether  or  not  the 
Scholastic  Aptitude  Test  (SAT)  is  coach  able 
is  fueled  by  both  misconceptton  and  miscom- 
munication.  The  misconception  centers 
mainly  around  the  nature  of  the  SAT» 
whereas  the  miscommunication  centcis 
.mainly  around  the  nature  of  coaching. 

The  SAT  ts  not  a  measure  of  sjbjcct-mat* 
tcr  attainment,  such  as  the  typical  educa- 
tional achievement  test  in  biology  or  Amer- 
ican history,  nor  is  it  a  measure  of  innate 
intelligence  or  fixed  endowment.  Thz  SAT 
measures  developed  abilities  of  verbal  and 
mathematical  reasoning  and  comprehension 
that  are  acquired  gradually  over  many  years 
of  experience  and  use  in  both  school  and 
nonschool  settings.  By  virtue  of  this  gradual 
development,  these  intellective  skills  appear 
to  be  relatively  difficult  to  improve  markedly 


NVe  wi»h  to  than^  Donald  Alderman.  Albert  Beaton, 
John  Carroll.  Robert  Linn,  Fredertc  Lord,  Donald  Pow 
cr\.  Lcdyard  Tucker,  and  Bary  Wingerskyforlheircare- 
fulvrevtew  of  ihe  manuscript  and  their  many  helpful 
comment!.  Special  thanks  go  lo  John  Tukey,  whose  sug- 
gestton  that  coaching  effects  be  examined  in  terms  of 
score  gam  per  contact  hour  provided  the  impetus  for 
ihis  ana^lysis 

Requests  for  reprints  should  be  jent  lo  Samuel  Mes- 
Sick.  Lducationa)  Testing  Service.  Princetom  New  Jer* 
sey0854r 


through  brief  courses  of  intervention  in  the 
final  year  or  2  of  high  school,  when  the  SAT 
is  typically  taken.  But  since  these  abilities 
are  learned,  albeit  in  manifold  ways  through 
both  education  and  experience,  one  would 
expect  high-quality  instruction  over  ex- 
tended periods  of  time  to  improve  them  and 
hence  to  increase  SAT  scores.  Thus,  the 
question  of  the  degree  to  which  the  SAT  is 
coachable  depends  on  what  is  meant  by 
coaching,  a  point  about  which  there  has  been 
not  only  marked  contention  but  lax  com- 
munication. Some  writers  restrict  their  usage 
of  the  term  to  practice  on  sample  items  and 
last-minute  cramming  (cf  Pike,  1978), 
whereas  others  include  under  the  same  ru- 
bric virtually  full-time  instruction  at  spe- 
cialized preparatory  schools  for  periods  of 
6  months  or  more  (cf.  Slack  &  Porter,  1980). 

In  an  effort  to  uncover  some  regularities 
in  the  results  of  coaching  studies  that  go 
beyond  a  simple  scorecard  of  significant  and 
nonsignificant  findings  or  a  conglomerate 
averaging  of  score  effects  from  different 
coaching  programs,  we  review  all  of  the 
available  studie's  of  coaching  for  the  SAT 
regardless  of  the  way  the  term  is  interpreted. 
We  view  the  issue  as  being  much  more  com- 
plicated than  the  simplistic  question  of 
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whether  or  not  coach m^wprks  for  the  SAT. 
Rather,  the  key  questions  arc  how  much  stu- 
dent time  devoted  to  what  kinds  of  coathmg 
experiences  yield  what  level  of  score  im- 
provements in  comparison  with  the  level  of 
experiential  growth  that  would  have  oc- 
curr»:d  anyway  without  those  coaching  ex- 
periences. This  latter  point,  that  coaching 
ellects  must  be  evaluated  relative  to  the  ex- 
periential growth  in  ability  that  may  occur 
regardle%s  of  the  coaching  program,  under- 
scores the  need  for  comparable  control 
ol  uncojched  students  in  studies  of  coaching 
ellectivenesN  but  comparison  with  equiva- 
lent control  groups  has  by  no  means  been 
the  rule  Since  this  point  is  critical  in  inter- 
preting the  import  of  experimental  findings, 
the  >uinmarie^  of  the  various  coaching  stud- 
ies draw  special  attention  to  the  strengths 
and  hinitalions  of  the  study  designs.  Before 
these  studies  are  examined  in  detail,  how- 
ever, lurther  clarilication  of  both  the  nature 
ol  the  SAT  and  the  nature  of  coaching  is 
offered. 

Coaching  for  Developed  Abilities  and 
Subject-Matter  Learning 

The  SAT  was  developed  as  a  measure  of 
academic  abilities  to  be  used  toward  the  end 
ot  secondary  school  as  a  standardized  sup- 
plement to  the  high  school  record  and  lettcis 
of  recommendation  typically  available  to 
college  admissions  officers.  The  SAT  was^ 
explicitly  desrgned  to  differ  from  achieve-" 
ment  tests  in  subject-matter  fields  in  the 
sense  that  its  content  is  drawn  from  a  wide 
variety  of  substantive  areas,  noi  tied  to  a 
particular  course  of  study,  curriculum,  or 
program,  It  assesses  intellectual  processes  of 
comprehension  and  reasoning  that  are  ex- 
ercised to  some  degree  in  all  subject-matter 
areas  at  all  levels  of  schooling,  as  well  as  in 
response  to  real-life  situations.  The  item  con- 
tent ol  the  SAT  attempts  to  sample  the  sort 
o!  generic  cognitive  skills  underlying  perfor- 
mance in  college,  reading  wirti  comprehen- 
sion, understanding  vocabulary,  verbal  rea- 
soning, computational  skills,  quantitative 
reasoning,  and  problem  solving. 

There  is  a  progression  or  ordering  of  ed- 
ucational tests  ranging  from  measures  of^ 
scholastic  abilities  at  one  pole,  with  content 


drawn  from  a  variety  of  siibstantive  areas, 
to  measures  of  academic  mastery  at  the 
other  pole,  with  content  specialized  by  sub- 
ject-matter field  (cf.  Anastasi,  1980,  Snow, 
1980).  The  SAT  falls  toward  the  first  ex- 
treme it  taps  general  cognitive  processes 
that  develop  gradually  over  many  years  of 
experience  and  use  both  inside  the  classroom 
and  in  everyday  life,  and  these  processes 
should  therefore  be  relatively  difficult  to  en- 
hance markedly  through  brief  courses  of  in- 
tervention. The  typical  educational  achieve- 
.ment  test  falls  toward  the  other  extreme- 
it  taps  specific  knowledge  and  skills  acquired 
through  the  normal  course  of  classroom  in- 
st."uction  or  independent  study,  and  such 
knowledge  and  skill  should  therefore  be  rel- 
B'tivcly  responsive  to  instructional  interven- 
tion, even  in. brief  courses  Similarly,  there 
IS  a  progression  of  types  of  preparation  for 
taking  examinations  ranging  from  simple 
practice  on  sample  items  at  one  extreme  to 
intensive  instruction  aimed  at  developing 
ability  and  knowledge  at  the  other  extreme. 
What  has  come  to  be  called  coaching  is  here 
considered  to  fall  anywhere  in  the  broad 
range  between  these  two  extremes  of  prac- 
tice and  instruction,  entailing  some  combi- 
nation of  test  familiarization,  drill-and-prac- 
tice  with  feedback,  training  in  strategies  for 
specific  item  formats  and  for  general  test 
taking  (including  advice  on  pacing,  guessing, 
and  managing  test  anxiety),  subject-matter 
review,  and  skill-development  exercises 
There  is  little  question  that  the  verbal  and 
mathematical  abilities  measured  by  the  SAT 
,  are  learned,  but  there  are  large  questions 
about  How  they  can  be  taught  Thus  the 
functional  characteristics  of  any  SAT  coach- 
ing programs  vhat  prove  to  be  effective 
would  have  important  implications  for  ed- 
ucational practice. 

The  effect  of  coaching  or  special  prepa- 
ration programs  on  SAT  performance  has 
become  a  question  of  increasing  concern  to 
students,  their  parents,  secondary  schools, 
and  colleges.  A  recent  survey  conducted  in 
seven  Northeastern  stales  (Alderman  <t 
Powers,  1980)  indicated  that  perhaps  as 
many  as  one  third  of  the  secondary  schools 
in  the  area  offer  a  program  of  special  prep- 
aration for  SAT-V(VerbaI  subscale),  with 
programs  in  SAT-M(Math  subscale)  prob- 
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abl>  at  iea^t  a!»  numerous.  Cotnmcrciai  or 
proprictar>  coaching  pro^ramj*  arc  abo quite 
wtdci>  available  in  urban  and  suburban  com- 
munities ( f  eoeral  Trade  CommisMon  [  I  TC  ], 
|97is;.  Studies  have  been  conducted  period 
ically  over  the  past  30  >earj>  io  investigate 
the  effects  of  both  school-based  and  pro- 
prietary programs  on  student  performance 
on  the  SAT.  The  results  of  these  studies  are 
c.^jMiined  with  particular  aiientton  to  prob- 
reseach  design. 

F'roblcms  of  Method  and  Interpretation  in 
SAT  Coaching  Studies 

in  the  evaluation  of  coaching  effective- 
ness, a  ke>  feature  of  research  design  is  ran- 
dom asMgnmeni  ol  cxanitntres  to  coaching 
treatment  groups  aiid  n^mcoaching  control 
groups,  lor  onl^  with  random  assignment  can 
wc  consider  treatment  effects  to  be  indepen- 
dent of  prior  status  un  an>  of  a  host  of  per- 
sonal or  background  characteristics.  With 
random  assignment,  no  s>.stematic  differ- 
ences are  expected  between  the  experimental 
and  control  groups  initially,  and  if  effective 
control  conditions  arc  maintained,  the  onl> 
systematic  difference  that  will  eventuate  is 
that  one  group  will  have  received  coaching 
and  the  other  will  not.  In  the  absence  of  ran- 
domi/ation»  there  is  an  inevitable  equivo- 
calit>  in  the  interpretation  of  the  results 
because  some  unmeasured  pcrs*jna!  char- 
acteristics might  have  influenced  both  the 
student  .s  participation  in  the  coachmg  pro- 
gram and  that  program  s  apparent  effec- 
tiveness. That  IS,  certain  per.sonal  factors 
characteristic  of  students  attending  a  par- 
ticular coaching  program,  such  as  motiva- 
tion or  career  aspirations,  ina>  be  responsi- 
ble,'at  least  in  part,  lor  subsequent  SAT 
pertormance  that  apptors  to  be  the  result 
oi  ihe  coachtng  experience.  Thus  the  effects 
uf  selection  or  of  self-selection  arc  con- 
lounded  with  effects  of  the  coaching  treat- 
ment in  nonrandomized  .studies.  Conse- 
quently, selection  factors  alfjKl  plausible 
rival  explanations  for  the  results  or  for  part 
ol  the  results  that  might  utherwi:>e  be  iden- 
tilted  as  coaching  elfects.  Selection  factors 
include  all  systematic  differences,  whether 
measured  uf^  un  measured,  between  the  ex- 
perimental and  control  groups  that  are  cor- 
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related  with  the  dependent  variable,  in  this 
case  SAT  performance  except,  of  course, 
that  the  experimental  group  received  the 
coaching  treatment,  whereas  the  control 
group  did  not.  If  these  systematic  differences 
result  from  student  i^hoicc  of  the  treatment 
rather  than  from  experimenter  choice  of  .the 
student,  they  are  called  self  selection  factors 

In  nonrt»ndomized  designs,  researchers 
usually  attempt  to  control  statistically,  using 
regression  techniques  like  anafjfsis  of  co- 
variance,  for  those  potential  selection  factors 
that  have  been  measured  Attempts  are  also 
frequently  made  to  analyze  the  data  in  al- 
ternate ways  to  assess  the  sensitivity  or  ro- 
bustness of  the  findings  under  various  plau- 
sible assumptions.  However,  there  is  no  way 
to  adjust  statistically  for  selection  factors 
that  have  not  been  assessed.  Since  very  few 
of  the  studies  reviewed  here  employ  random 
assignment  and  those  that  do  have  other 
problems  of  maintaining  realistic  control 
conditions,  the  specter  of  selection  bias  arises 
continually  as  a  plausible  altenative  inter 
pretation  of  apparent  coaching  effects 

As  our  review  underscores,  the  available 
studies  of  coaching  for  the  SAT  are  meth 
odologically  flawed  in  various  and  divergent 
way.s.  NJost  arc  subject  to  the  problem  of 
selection  bias  just  discussed,  which  severely 
compromises  interpretations  of  the  source  or 
determinants  of  score  effects  Others  were 
subject  to  disturbances  of  student  motivation 
or  of  control  conditions,  which  very  likely 
introduced  biases  in  estimati:ig  the  size  of 
score  effect.s.  Still  others  were  based  on  small 
.samples  of  coached  students,  vvhich  resulted 
in  estimated  score  effects  that  were  Impre- 
cisely bounded.  Several  studies  suffered  from 
combinations  of  two  or  more  of  these  prob- 
lems. In  searching  for  regularities  among  the 
findings,  especially  between  the  si/c  of  score 
effects  and  key  characteristics  of  the  coach; 
ing  programs,  we  attempt  to  discount  studies 
having  likely  biases  in  their  score  estimates 
while  at  the  same  time  trying  to  take  into 
account  the  greater  variability  uf  estimates 
from  studies  with  small  sample  sizes  Al 
though  the  statistical  significance  of  ,csults 
is  di>cumented  (sec  Table  I),  the  issue  of 
coaching  IS  addressed  more  in  terms  of  es- 
timation of  Swore  eftects  than  of  rejection  of 
the  null  hypothesis.  Finally,  we  turn  to  the 
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problem  of  interpreting  the  determinants  or 
sources  of  the  educed  relationships  and  con- 
front once  again  the  pervasive  confounding 
innuence  of  selection  bla^5. 

Although  there  was  considerable  variation 
in  the  score  increases  observed  for  particular 
groups  of  students  and  for  particular  coach- 
ing programs,  the  studies  conducted  in  the 
1950s  and  1960s  as  well  as  two  more  recent 
studies  (Alderman  &  Powers,  1^80.  Evans 
&  Pike,  1973)  yielded  average  score  in- 
creases relative  to  control  groups  of  about 
9  pomts  on  SAT-V  and  about  13  points  on 
SAT-M;  on  a  score  scale  ranging  from  200 
to  300  points  with  a  standard  deviation  of 
about  100  points  (Messick.  1980).  If  the 
average  effects  for  two  commercial  coaching 
schools  studied  bythe  F-TC  (1979.  sec  also 
Stroud.  1980)  are  added,  the  average  SAT- 
V  increase  becomes  14  points  and  the  av- 
erage SAT'M  increase  becomes  15  points. 
Studies  lacking^ahy, control  groups  whatso- 
ever yielded  larger  adjusted  score  effects  - 
on  the  average.  38  pojnts  on  SAT*V  and  54 
points  on  SAT-M-  but  sincp  they  differed 
from  control  group  studies  not  only  in  design 
characteristics  but  m  critical  program  char- 
acteristics as  well,  their  interpretation  is  es* 
pecially  problematic 

Studies  With  No  Control  Groups 

Three  studies  those  by  Pallone  in  1961, 
hy  Marron  in  1965.  and  by  Coffman  and 
Parry  in  1 967  lacked  any  control  group  for 
evaluating  unusual  patterns  of  score  change. 
Pallone  examined  the  effects  of  short-  and 
long-term  intensive  developmental  reading 

^courses  on  SAT  scores  of  J^tudents  in  a  pri- 
vate school  for  boys  The  courses  were  un- 
dertaken "for  students  m  iheir  final  year  of 
precollege  work,  including  a  large  number 
of  high  ^>chool  graduates  who  were  complet- 
ing a  year  of  post-liigh  school  study  in  prep- 
aration for  entrance  into  the  U.S.  govern- 
ment academies'*  (p  655).  According  to 

_Pallone,  to  improve  the  skills  measured  by 
the  SAT,  "not  'coaching'  methods,  but  in- 
struction of  a  developmental  nature-jn  read* 
ing  and  vocabulary  skills  was  indicated.  Im- 
provement in  scores  could  be  expected  only 
if  the  hasic  skilK  measured  by  the  test  were 
tirst  strengthened'^  (pp,  654  655 )<  This  pro- 
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gram  provided  focused  instruction  lo 
strengthen  reading  achievement  along  with 
mtensive  practice  m  reading  skills,  including 
such  special  skills  as  skimming  and  critical 
reading,  as  well  as  a  brief  analysis  of  typical 
verbal  analogy  test  Hems  Approxiniiilely  20 
students  participated  in  a  6-week  summer 
pilot  program  that  met  for  90  minutes  daily 
An  average  score  increase  of  98  points  was 
obtained  on  SAT-V  from  the  March  to  Au- 
eust  SAT  administrations  The  longtterm 
program  covered  a  6-month  period  with 
dail)  meelings  of  50  minutes  each  For  some 
80  students  who  completed  this  long-term 
course,  an  average  SAT-V  increase  of  109 
points  was  reported  over  a  l2-inonth  period 
from  pretest  lo  posttest,  although  the  dif- 
ference in  mean  scores  in  Pallone*s  T^e  3 
(p.  656)  IS  only  84.  The  students  who^ar- 
tigipaled  in  the  summer  program  also  com- 
pleted the  long-term  reading  course,  and 
tJieir  mean  increase  in  Verbal  score  over  12 
months  was  almost  122  points,  or  an  average 
of  about  24  points  over  the  increase  reported 
after  the  summer  course  The  special  quality 
of  the  sample  and  the  lack  of  control  gfOups 
severely  limit  the  implications  of  these  find- 
ings ^  is-a-vis  coaching  Furthermore,  the  in- 
structional focus  on  skill  development  and 
the  intensive  and  long-term  nature  of  the 
programs  put  Pallone's  efforts  close  lo  what 
ordinarily  would  be  considered  ''instruc- 
tion.'* in  contradistinction  to  ''coaching,"  as 
Pallone  himself  insisted 

In  the  absence  of  control  groups  of  similar 
students  at  this  preparatory  school  who  were 
not  taking  Pallonc*s  course,  it  is  difficult  to 
assess  the  import  of  these  score  gains  Pal- 
lone (1 96 1)  suggested  comparing  them  with 
normal  expectations  of  gains  of  about  35 
points  on  SAT-V  during  the  final  secondary 
school  year,  which  would  yield  an  insf  uc 
tional  or  program  effect  of  about  83  points 
for  the  summer  oilct  program  (prorated  for 
the 5  month,  bct^en  pre-  and  posttests) and 
about  74  points  for  the  long-term  program 
(which  had  12  months  between  pre-  and 
posttests).  Or.  if  the  difference  in  mean 
scores  is  taken  as  84  as  in  Tallone's  Table 
3,  the  long-term  instructional  effect  is  about 
49  points.  This  is  not  a  very  satisfactory  com- 
parison, however,  since  Pallone*s  students 
were  not  representative  of  students  in  their 
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iittdi  year  uf  high  SLhool  who  lake  ihc  SAT. 
In  a  rc«.cnl  rcv»cw  afl»^,I^;  on  ihc  SAT,  SKuk 
and  Poricr  ( i9<iO)  su^g^;^l^;d  voniparing  Pal 
(ones  results  with  av(;rag(;  gains  tn  national 
ailmtntstrations  of  junior-  to  scnior-ycar 
rctc&tcrs  havtng  ihc  same  initial  average 
sLore  hsch  .ts  Pallone's  .students,  whieh 
>ields  prorated  instruetional  effevts  of  85 
.ind  7V  ior  54)  puint.s,  respeeuvel>,  for  the 
suiuiiier  and  long-term  programs.  Again, 
this  IN  not  a  vcr>  satisfa»,lor>  eornparison 
be\,ause  I'altone'.s  priv.ite  sellool  students 
were  not  a  representative  s.iiTipie  of  the  na- 
tional population  of  test  repeaters.  Pike 
(I97i^)  suggested  ».omparing  Pallonc's  re- 
>uhd  With  average  gains  of  v.ontrol  students 
tn  ->upcrtor  s*,hiH>ls  from  other  studies  of  pro- 
prietary programs,  ami  this  \,onip.trison  leads 
to  tnsiruetion.il  effeets  of  about  73  and  53 
(or  2H>  points.  feApeetivel>,  for  the  .summer 
and  long-teriii  prograins.  If  compared  wtth 
sv,ore  gains  ot  v,untrol  students  in  other 
cuaehing  studies  wh^  had  average  imti.i! 
^  -  s»,ore^  levels  roughly  *,oniparablc  lo  Pallonc*s 
gioups,  the  adjusted  instruetiona,!  effects  are 
8U  and  65  (or  40)  points,  respcetivel>v 

The  point  is  that  m  the  absence  of  Lom~ 
parable  v.ontrol  groups,  no  generally  satis- 
f.ietorv  estim.ite  i>f  instruelional  effeets  ean 
be  obtained.  If  an  avenge  is  taken  aeross 
the  four  adjustments  just  suggested,  the  rc 
suiting  estimates  of  tnstruv^tional  effeets  are 
81  ajnd  68  (or  43)  points,  respectively,  for 
the  summer  and  long-term  programs.  These 
values  are  ver^  likely  still  overestimates, 
however,  beeau.se  none  of  the  v,umparisons 
ean  take  into  ae«,ount  the  highl>  >sclf-selceted 
nature  of  Pallone's(  1961 )  pr iv ate. school  stu- 
denu,  man>  of  whom  were  ^.ompleting  a 
post-high-sehool  year  particularly  motivated 
to  increase  their  chances  ol  entering  .service 
.leadeniies  oT  selective  colleges  Neverthe- 
less, given  the  overall  si/e  of  the  effe».ts,  even 
with  somewhat  larger  jjdjustnients,  it  seems 
likely  that  Pallone  s  intensive  summer  and 
long-term  efforts  at  instruction  of  a  devel- 
opmental nature  su»,ecedcd  in  strengthen- 
mg  basK  skills  rncisurcd  by  the  SAT. 

Marront  l')65>  exairunedSAT  score  gains 
for  students  at  10  well-known ^preparatory 
s*,huoK  that  specialized  m  preparing  high 
sv,hool  gi^ailuatcs  lor  .idmissiun  to  the  service 
acailemtes  and  selective  colleges   The  in- 


VNDMiniOD  195 

structional  programs  entailed  "six  months 
of  full-time  exposure  to  course  content  that 
is^irecily  related  to  the  veroal  and  mathe 
matics  College  Board  tests  (both  Aptitude 
and  Achievement)'*  (p,!).  A  special  admin- 
istration of  SAT  V  and  SAT  M  at  all  10 
schools  served  .is  the  pretest,  whereas  the 
posttest  was  a  regular  SAT  .idministratiun 
6  months  later.  It  should  be  noted  ^  .1  if  the 
level  of  motivation  and  effort  on  a  speci.il 
pretest  that  did  not  count  for  college  ad- 
mission was  not  comparable  to  th.it  Jn  the 
regular  posttcst,  the  instructional  effects  in 
M.irron's  study  would  likely  be  overesti- 
m.ited.  This  issue  did  not  arise  for  I\ilione 
(1961)  because  both  pre-  and  posttests  in  his 
study  were  regula^r  SAT  administrations. 

Since  6igniricant  differences  were  ob 
tained  among  the  10  schools  with  respect  to 
both  the  pretest  scores  and  the  posttest 
scores  and  these  l.itter  differences  remained 
significant  in  an.d>ses  of  cov.iriance  adjust 
ing  for  pretest  levels,  the  overall  results  were 
reported  separately  for  groups  of  schools 
havtng  nonsignificant  differences  within 
group.  Score  gains  on  SAT-V  were  77  points 
for  Group  1  (2  schools.  A'  =  83),  56  points 
for  Group  2  (6  schools.  A'  =  600).  47  points 
for  Group  3(1  school.  A'  -  5),  and  J5  points 
for  Group  4  ( I  school.  A'  =  26),  the  weighted 
average  SAT-V  increase  over  all  groups  w.is 
58  fA)ints.  Score  incre.ises  for  SAT  M  were 
83  points  for  Group  I  (4  schools,  A  -  232). 
78  points  forjQ/oiip  2  (3  schools,  A  405), 
and  72  points  for  Group  3(3  schools.  A'  ~ 
78),  the  weighted  average  SAT  M  increase 
over  .ill  groups  w.is  79  points,  .\g.iin.  in  the 
absence  of  control  groups,  it  is  difficult  to 
appraise  the  si/e  of  these  instructional  ef 
fects 

Marron  (1965)  .suggested  comparing  the 
SAT  score  gams^with  the  gains  consulered 
typi  al  for  males  in  their  senior  ye.ir  in  sec 
ondary  school,  which  he  reported  based  on 
College  Board  data  as  40  points  for  SAT  V 
and  43  points  for  SAT  M  over  a  10-month 
testing  interval.  Prorated  for  the  6-nionth 
testing  interval  in  Marron\s  stud),  this  yields 
an  adjusted  weighted  aver.tge  of  34  points 
for  SAT  V  and  53  points  for  SAT-M.  As 
wavdone  for  Pallonc's  (1961)  results,  the 
suggested  .idjustments  of  Slack  and  Porter 
(1980)  and  Pike  (1978)  were  also  applied 
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to  Marron's  figures,  along  wilh  an  adjusi- 
ment  based  on  score  gains  of  control  students 
in  other  coaching  studies  who  had  avemge 
initial  score  levels  roughl>  comparable  to  the 
scores  of  Marron\  groups.  Taking  the  av- 
erage of  all  four  of  these  adjustments,  the 
resulting  weighted  average  values  are  35 
points  for  SAT-V  and  54  points  for  SAT-M. 
But  again,  none  of  Ihese  adjustments  is  ver> 
satisfactory  because  none  of  the  suggested 
comparisons  Uikcs  inlo  au^ount  that  Mar- 
ron's  students  were  highly  sell-selected, 
thereby  leaving  important  factors  of  differ- 
ential motivation  and  growth  uncontrolled. 
In  any  event,  the  relevance  of  Marron*s 
study  to  the  issue  of  -oaching  is  arguable, 
since  6  months  of  full-time  exposure  to 
course  content  directed  at  verbal  and  math- 
ematical knowledge  and  skills  v,ou\6  ordi 
narily  be  considered  instruction. 

In  an  attempt  to  explore  further  the  ef- 
leclN  of  developmental  reading  instruction 
on  SAf-V  .scores,  especially  in  light  of  Pal- 
lone  s  { 1961 )  hnding.s.  Coffman  and  Parr> 
i  I V67)  studied  three  groups  of  college  fresh- 
men who  look  the  SAT-V  before  and  after 
completing  a  course  in  accelerated  reading. 
The  course  was  described  as  stres*iing  speed 
of  reading  with  relative  accuracy.  Pre-  and 
posltesl  scores  based  ort  special  administra- 
tions of  the  SAT  were  available  for  two  small 
groups  of  10  and  9  students  who  elected  to 
tii^^an  8-vyeek  course  that  met  6  hours  each 
week.  Pre-  and  postlest  SAT-V  scores  were 
also  available  for  25  students  whose  course 
met  3  hours  a  \yeek  for  15  weeks.  For  stu- 
dents in  the  8-week  course,  SAT-V  scores 
increased  3,5  points  in  one  group  and  9.9  in 
the  other.  A  28.9  mean  loss  was  observed  for 
the  group  taking  the  15-week  course,  pos- 
sibly because  of  problems  of  test  adminis- 
tration and  icore  equaling,  since  time  con- 
straints dictated  the  u.sc  of  a  shortened  SAT- 
V  for  that  group,  h  ma>  also  reflect  prob- 
lems in  the  motivation  of  students  who  take 
a  special  SAT  when  tbe>  are  already  in  col- 
lege, as  may  the  relativel>  modest  score  in- 
creases in  Ihe  other  two  groups  although 
ail  ol  these  students  were  presumably  mo- 
tivated to  enroll  tn  the  course,  which  e>tplic- 
itly  entailed  taking  the  SAT»  Again,  the  lack 
oi  control  groups  serioiisl)  impairs  the  use- 
fulness of  those  results. 


Studies  With  NonequivaUnt 
Control  Groups 

A  second  methodological  weakness  ob- 
tains in  four  other  coaching  studies*  Al- 
though each  incorporated  control  groups,  the 
control  students  attended  different  schools 
from  those  providing  special  preparation  for 
experimental  students  or  else  were  drawn 
from  other  extrinsic  %6urces  such  as  test- 
score  files,  thus  confounding  coaching  effects 
wilh  school  effects  and  with  myriad  other 
self-selection  factors. 

Dyer  (1953)  studied  seniors  at  two  highly 
selective  independent  schools  for  boys  225 
students  at  one  school  served  as  the  treat- 
ment group,  and  193  students  at  the  other 
school  served  as  the  control  group.  The  stu- 
dents ^t  both  schools  toc^J;  a  special  pretest 
SAT  and,  6  months  later,  a  regular  SAT, 
which  served  as  the  posttest.  The  experi- 
mental group  completed  12  verbal  practice 
exercises  in  30-  to  60-minute  sessions  and 
5  math  practice  exercises  in  60-  to  90-minute 
sessions.  The  control  variables  in  an  analysis 
of  covariancc  were  initial  SAT  scores,  num- 
ber of  years  each  student  had  been  enrolled 
in  school,  and  the  number  and  level  of  for- 
eign language  and  mathematics  courses  taken 
in  the  senior  year  The  estimated  increase 
in  score  for  the  treatment  group  over  the 
control  group  was  4  6  points  in  Verbal  and 
12.9  points  in  Math  When  the  students  were 
divided  into  those  who  were  not  taking  math- 
ematics courses  as  seniors  and  those  who 
were,  the  no-math  boys  who  were  coached 
gained  over  29  points  more  than  those  who 
were  not  coached.  In  contrast,  it  was  found 
that  the  boys  taking  mathematics  who  were 
coached  gained  3.3  points  more  than  those 
taking  ^mathematics  who  were  not  coached 
These  findings'  provide  the  first  example  in 
studies  of  coaching  of  an  interaction  between 
size  of  effects  and  student  background  char 
acteristics,  alerting  us  to  the  more  general 
possibility  that  coaching  programs,  like  other 
forms  of  teaching,  may  have  differential  ef- 
fects for  different  kinds  of  students 

French  (1955)  conducted  a  coaching  study 
employing  dual  tt^tment  and  control  groups 
at  three  schools.  The  1 5&  students  at  School 
A  pursued  their  regular  courses  with  no  at- 
tempt at  special  preparation  for  the  SAX  and 
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served  ab  a  control  group  for  coaching  tn 
both  Verbal  and  Math,  the  HO  students  at 
a  School  B  served  as  a  ticatment  group  for 
Verbal  and  as  a  wontrol  group  for  Math,  the 
i6l  students" at  School  C  !»erved  as  a  treat- 
ment group  for  both  Verbal  and  Math.  The 
special  preparation  program  in  Verbal  at 
School  B  differed  from  the  one  at  School  C 
in  that  the  former  primar.l>  omphasiijed  vo- 
cabulary for  a  total  of  hours,  whereas 
the  latter  reviewed  10  verbal  exercises  more 
representative  of  SAT-V  i»kills.  The  pretest 
was  a  special  administration  of  the  SAT,^ 
With  a  regular  admintstralion  6  months  later 
serving  as  a  posttest.  An  iUial>Ms  of  covari- 
ance,  using  pretest  Aorcs  as  the  control  vari- 
able and  posttest  ^cofes  as  the  dependent  or 
outcome  variable,  showed  an  advantage  in 
Verbal  score  for  the  coached  groups  of  18 
points  at  School  C  and  5  points  at  School 
B  (tlie  one  with  the  vocabutar>  coaching 
program).  The  score  increase  in  Math  vvas 
6  points  when  compared  with  icores.^of 
School  A  and  IS  points  when  compared  with 
scores  of  School  B.  When  broken  down  b> 
^ex  and  current  enrollment  in  math  courses^ 
the  SAT-M  data  indicated  that  coached 
bo>s'not  studying  math  at  the  time  of  coach- 
vixjg^  showed  greater  increases  over  control 
students  than  did  coached  fyjys  who  were 
studying  math,  b>  about  4  points  in  one 
school  and  10  in  the  other.  This  pattern  of 
higher  coaching  effects  for  boys  not  cur- 
rently studying  math  is  consistent  with  the 
Dyer  results.  In  contrast,  coached  girls  not 
studying  math  at  the  time  showed  smaller 
increases  over  control  students  than  did 
coached  girls  who  were  studying  math. 
Coached  girls  currently  studying  math  ex- 
hibited score  increases  of  about  20  and  30 
points  over  the  noncoached  girls  currently 
studying  math  in  the  twu  control  schools, 
whereas  the  coached  girls  not  i»tud>ing  math 
exceeded  their  noncoached  counterparts  in 
the  two  math  control  schools  by  only  I  and 
4  points*  The  interaction  between  si/e  of 
coaching  effects  and  current  enrollment  in 
math  courses  thus  appears  in  these  data  to 
be  moderated  by  the  student's  sex. 

Dear  (1958)  undertook  a  study  to  deter- 
mine whether  longer  periods  of  coaching  in 
small  groups  two  class  periods  a  week  for 
6  weeks  and  for  1 2  weeks    were  likely  to  be 


more  effective  than  the  shorter  term  coach- 
ing studied  by  Dyer  (1953)  and  by  French 
(1955).  In  Dear's  study,  six  public  and  four 
private  secondary  schools  were  chosen  ran- 
domly from  a  list  of  schools  in  which  at  least 
15  students  had  taken  the  May  sAt  as  ju- 
niors. A  treatment  group  from  each  school 
was  selected  at  random  from  students  who 
volunteered  for  coaching  A  second  group  of 
nine  schools  drawn  at  random  from  the  same 
geographical  region  the  New  York  New 
Jersey  Greater  Philadelphia  area  served 
as  control  schools.  Three  students  were  se- 
lected from  each  school  from  each  of  three 
ability  levels  90  coached  students  and  81 
control  students.  Of  these,  71  coached  and 
79  uncoachcd  students  took  the  SAT  at  reg- 
ular administrations  in  May  and  again  ton 
months  later  in  March.  The  coaching  pro- 
gram began  in  mid-November  and  continued 
through  mid-March,  with  weekly  coaching 
sessions  supplemented  by  1  additional  hour 
of  homework  each  week.  Most  students  re- 
peated the  SAT  in  January  (8  months  after 
the  Q|ftest),"which  was  halfway  through  the 
coaching  period,  and  again  in  March  (10 
months  after  the  pretest).  The  January  re- 
sults sliowcd  about  a  22-point  advantage  for 
60  coached  students  on  Math,  but  a  2f 
point  disadvantage  on  Verbal  (relative  to  (he 
average  adjusted  score  increase  of  the  con- 
trol group).  The  March  advantage  for  the 
coached  students  on  Math  was  about  24 
points.  The  Verbal  score  results,  unfortu- 
nately, were  not  determined  because  of  a 
significant  difference  in  the  slopes  of  the 
regression  lines  for  the  coached  and  un- 
coached  groups.  In  contrast  to  Dycr-s  (1953) 
results,  the  greatest  coaching  gains  on  SAT- 
M  were  for  students'currcntly  studying 
math,  but  no  comparison  can  be  made  with 
French's  (1955)  finding  of  a  sex  moderated 
interaction,  since  the  DcaAample  was  not 
broken  down  for  separate  analyses  by  sex  of 
student. 

An  ambitious  investigation  of  the  effects 
on  student  test  pciformance  of  commercial 
coaching  for  the  SAT  was  undertaken  by  the 
ITC  in  1978.  with  extensively  revised  sta- 
tistical analyses  being  issued  the  following 
year  (rTC,  1979)  Students  enrolled  in  two 
New  York  City  area  commercial  <;oaching 
schools  during  the  3  testing  years  of  1974 
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to  served  as  the  experimental  or  treat- 
ment group,  and  a  random  vmiple  from 
College  Board  tej,t-sLore  files  of  unLoached 
persons  who  took  the  SAT  during  the  s.imc 
3.>ear  period  m  the  same  greater  New  York 
metropolitan  area  served  as  a  eontrol  group. 
Si%  subgroups  were  examined  (a)  high 
school  juniors  taking  the  SAT  for  the  tir.st 
time  in  April  l*)7>  (76  coached  and  607  un- 
coached  sludenis).  ib)  juniors  taking  the 
SAT  lor  ihc  hrst  tune  in  April  l»)76  (247 
coached.  617  unLoached),  (c)  seniors  taking 
the  SA  r  lor  the  second  time  in  November 
l*)'?5  t')H  coached.  3V6  uncoached).  (d)  ic- 
niofs  taking  the  SAT  lor  the  second  time  in 
November  1976  (177  coached.  387  un- 
coached). (0)  all  high  school  students  taking 
ihc  SAT  h>r  the  hrsi  iime  on  an>  test,  date 
dunngthe  ^>cMr period  (417  coached.  1.763 
*  uncoached ).  and  ( M  ail  high  school  students 
taking  the  SAl  lor  the  second  time  during 
this  period  (3 16  coached.  1.267  uncoached) 
Statistical  anal>ses  were  actually  based  on 
smaller  samples  than  these  largely  because 
of  missing  student  descriptive  data 

When  demographic  and  personal  char- 
acteristics of  the  experimental  and  control 
groups  were  contrasted,  it  was  found  that 
the  coiicjjcd  group  wa^  significantly  higl\er 
ihaimlTe  uncoached  group  in  high  school 
class  rank,  parental  income,  most  recejit 
hnglish  grades,  most  recen*  math  grades, 
and  number  of  years  of  math  taken.  In  ad- 
dition, the  coached  group  included  signifi- 
cantly more  nonpublic  school  students  than 
the  uncoached  groap  Although  statistical 
adjustments  were  in  ide  for  these  and  other 
preexisting  group  differences  for  which  mea- 
:>ures  were  available,  there  was  no  way  to 
take  into  account  unmeasured  factors  also 
hkely  to  differentiate  the  groups,  such  as 
motivation  or  level  of  parental  education.  In 
the  absence  of  random  assignment  of  stu- 
dents to  coached  and  uncoached  groups  and 
especially  m  view  of  the  large  and  extensive 
differences  confounded  in  the  nonrandom- 
ized groups  ultimately  analyzed,  any  score 
effects  derived  froni  these  data  must  be  in- 
terpreted as  combined  coaching/self-selec- 
tion  effects. 

The  I*TC  used  multiple  regression  tech- 
niques-to -control  for  group  differences  on 
the  Preliminary  Scholastic  Aptitude  Test 
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(PSAT)  or  on  the  first  SAT  when  two  were 
taken  as  well  as  for  differences  on  several 
relevant  background  variables  Although 
they  found  negligible  effects  for  students  at 
one  commercial  coaching  school,  statisti- 
cally significant  effects  were  obtained  for 
students  at  the  other  school,  where  the  im- 
pact for  SAT- Verbal  was  estimated  to  be  30 
and  27  points,  respectively,  for  first-  and  sec- 
ond-time SAT  takers  over  the  pooled  time 
periods  Score  effects  of  19  and  28  points, 
respcctivelv.  were  estimated  for  SAT- Math 
o*er  the  s.une  periods.  The  program  at  the 
school  m  which  students  exhibited  signifi- 
cant average  score  increases  (School  A)  in- 
voFved  10  4 -hour  sessions  for  a  total  of  40 
hours  ol  coaching,  whereas  that  at  the  school 
showing  negligible  overall  effects  (School  B) 
involved  a  total  of  24  hours  of  coaching 
Again,  because  of  uncontrolled  dilTcrences 
between  the  coached  and  uncoached  groups, 
these  estimated  score  increases  of  20  to  30 
points  for  both  SAT-V  and  SAT-M  at  one 
coaching  school  represent  combined  coach- 
ing/self-selectlon  effects. 
Two  major  reanalyses  of  the  FTC  (1978, 

1979)  data  were  subsequentlytundertaken  to 
address  a  broader  set  of  issues  with  more 
powerful  analytical  techniques  A  third  re- 
analysis  (National  Education  Association. 

1980)  reexamined  some  of  the  same  ground 
covered  by  the  FTC  analysis  but  in  a  rela- 
tively primitive  fashion,  adding  neither  novel 
findings  nor  better  controlled  or  more  precise 
estimates.  In  thc^  first  major  reanalysis, 
Stroud  (1980)  applied  an  analysis  of  co- 
variance  type  of  model  that  differed  from 
the  FTC  analysis  in  two  important  respects' 
The  FTC  analysis  used  a  pooled  regression 
equation  across  both  coached  and  uncoached 
students  using,  along  with  other  variables, 
verbal  pretests  and  background  measures 
(such  as  PSAT-V  and  English  grades)  m 
predicting  score  effects  on  SAT-V  but  quan- 
titative pretests  and  background  variables 
(such  as  PSAT-M  and  math  grades)  in  pre- 
dicting SAT-M  effects.  In  contrast,  Slroud 
employed  a  regression  equation  defined  by 
the  performance  of  uncoached  students  only 
aqd.  in  addition,  included  both  verbal  and 
quantitative  pretests  and  bacjcground  vari- 
ables in  predicting  coaching  effects  for  each 
area  on  the'SAT/This  UnrilysisJs.not  only 
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mure  precbcly  cuntruUcd  through  the  inclu- 
biun  of  additional  covanates.  hut  it  more 
a|)propr lately  tuntrasts  ihc  perforniantc  of 
cJachjcd  Mudents  with  predicted  score  levels 
they  ^4 would  have  expected  had  they  been 
unci/ached  students  with  thetr  *>ame  values 
on  predictor  variables.  This  approach  results 
in;  valid  estimates  with  fewer  assumptions 
ajlu  laciUtales  slra^jhlfurward  examination 

interactions  (Cochran,  1968). 

Stroud's  (1980)  reanalysis  indicates  that, 
given  thetf  background  characteristics  and 
pretest  levels,  students  enrolled  m  one  of  the 
two  coaching  schov)i&  studied  by  the  FTC 
(School  A)  obtained  significanljy  higher 
SAT  Scores  than  did  uncoached  students  by 
about  20  to  35  points  in  both  Verbal  and 
Math  the  same  neighborhood  as  the  FVC 
e>limates.  The  estimated  effects  for  students 
at  the  other  school  (School  B)  averaged 
about  5  points  in  Verbal  and  7  in  Math  and 
were  not  statistically  significant.  These  are 
estimated  combined  effects  due  to  coaching 
and  self-aclection,  since  it  is  not  possible,  as 
noted  previously ,  to  c^^timate  coaching  and 
self-seleciion  effects  separately  with  these 
data.  Stroud  also  investigated  the  possibility 
of  interactions  betwjsen  size  of  effects  and 
the  student  background  variaoles  included 
as  covartates.  No  interactions  were  uncov- 
ered at  Coaching  School  A  for  either  SAT- 
V  or  SAT-M.  At  Coaching  School  B,  how- 
cve;,  statistically  significant  and  indepen- 
dent interactive  effects  were  obtained  on 
SAF-V  fur  race  and  self-reported  parental 
income.  On  the  average,  even  though  their 
number  was  quite  small  (A  ^  13),  black  stu- 
dents at  School  B  exhibited  significantly 
larger  coach  tng/sclf-select ion  effects  on 
SAT-V  than  nonblacks,  and  students  re- 
|Hirting  low  family  inconu:  exhibited  signify 
ic^ntly  larger  coaching/ self-selection  Verbal 
effects  than  those  reporting  high  family  in- 
come (McssicL  1980,  pp.  46  51).  In  con- 
trast to  the  findings  of  Oyer  (1953)  and 
1  rench  (l^^S),  no jdiffciential  score  effects 
were  uncovered  for  SAT-M,  either  fts  a  func- 
tion of  years  of  math  taken  or  of  sex  or  of 
any  of  the  other  covariates. 

In  the  second  major  reanalysis  of  the  FTC 
data.  Rock  (1980)  employed  a  statistical 
model  that  takes  account  of  differential  rates 
of  growth  in  SAT  scores  over  time,  if  they 


occur,  for  the  coached  and  noncoached 
groups.  If  growth  is  occurring  in  the  depen- 
dent variable  (i,e„  in  the  verbal  and  math- 
ematical abilities  measured  by  the  SAT), 
then  one  of  the  key  ways  m  which  nonran- 
doml^ed  treatment  and  control  groups  might 
differ  prior  to  any  coaching  intervention  is 
in  the  rate  of  this  intellectual  growth.  The 
statistical  growth  model  employed  by  Rock 
docs  not  adjust  for  self-sejcction  factors  or 
other  group  differences  on  background  vari- 
ables unrelated  to  differential  growth,  as 
analysis  of.covariance  can.  However,  it  does 
correct  for  tliosc  self-selection  effects  em- 
bodied in  differential  group  growth  that 
were  not  predict<:d  fr^m  the  available  co- 
variates  used  (Bryk  &  Weisberg,  1977). 
Since  direct  application  of  the  model  re- 
quires estimation  of  differential  growth  rates 
from  time  scries  data,  even  if  only  linearly 
from  two  testing  occasions  prior  to  coaching, 
only  students  having  three  test  scores  could 
be  considered.  For  the  treatment  or  experi- 
mental group.  Rock  included  only  those  stu- 
dents at  the  largest  coaching  school  (School 
A)  for  whom  three  test  scores  were  available, 
a  PSAT  and  two  administrations  of  the 
Sat.  The  control  group  included  only  those 
uncoached  students  for  whom  these  same 
three  test  scores  were  also  available  The 
treatment  group  numbered  192  students  and 

'the  control  group,  684. 

.  The  coached  students  performed  better 
than  the  uncoached  students  on. the  PSAT 
and  were  higher  as  vtell  in  high  school  rank- 
in-class  and  family  inconlr.  As  would  be  ex 
pectcd,  the  coached  students  also  scored 
higher  than  their  uncoached  cohorts  on  the 
first  Sat  administration  but  in  the  case 
of  the  Verbal  arej  scored  diffcrenlially 
higher.  That  is,  during  the  period  from  tak 
ing  the  PSAT  to  taking  the  initial  SAT.  prior 
to  attendance  at  the  coaching  school,  the 
verbal  skills  of  the  studcnti  who  subscj- 
qucntly  were  to  be  coached  appeared  to  grow 
more  rapidly  than  those  of  the  uncoached 
students.  In  Math,  however,  both  the  coached 
and  uncoached  students  showed  similar  group 
growth  rates  during  this  prcintcrycntion  pe- 
riod. When  the  confounding  effects  of  dif- 
ferential group  growth  rates  were  controlled 
for,  the  estimated  coaching/self-selection 
effect  for  SAT- V  dropped  to  about  1 7  points. 
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whereas  thai  for  SAT-M.  b>  virtue  of  not 
exhibiting  differential  group  growth  rates  in 
these  dsla.  remained  at  -about  30  ^\n(^ 
Thus,  by  taking  differential  group  growth 
rates  into  a,ccount,  the  estimated  SAT-V 
effect  was^reduced  to  about  half  that  in  the 
bTC  (1979)  report  or  the  Stroud  (1980)  fe- 
<inalysis.  Furthermore,  the  fact  that  Rock's 
estimate  of  the  Verbal  effect  is  substantially 
less. than  the  Math  effect  is  consistent  with 
earlier  findings  and  wrth  expectations  that 
Math,  bejng  generally  more  curriculum  re- 
lated than  Verbal,  might  be  more  respousive 
CQ  coaching  or  special  preparation.  ^ 

Studies  IVith  AfatcheJ  Control  Groups 

A  third  methodological  problem  occurs  in 
studtes  in  which  control  and  experimental 
students,  although  from  the  same  school,  are 
not  assigned  randomly  but  are  matched  on 
selected  measures,  thereby  still  permitting 
systematic  differences  between  the  groups 
on  6ther  nonassessed  variables. 

frankel  ( 1960),  in  the  first  study  ever  pub- 
lished on  the  effects  of  commercial  coaching 
on  SAT  scores,  selected  45  high  school  stu- 
dents who  had  taken  commercial  coaching 
courses  and  matched  them  with  45  control 
students  from  the  same  high  school  on*the 
basis  of  (a)  having  taken  the  same  two  reg- 
ular SAT  administrations  to  serve  as  pretest 
and  posttest,  (b)  having  pretest  scores  within 
10  points  of  each  other  on  both  Verbal  and 
Math,  and  (c)  beingpf  the  same  sex  Within 
each  pair,  «ne  student  had  taken  a  com- 
mercial coaching  course  involving  roughly 
30  hours  of  coaching  in  classes  of  about  25 
students  during  the  7-  to  8-month  period 
between  pre-  and  posttests.  In  brief,  frankel 
-found  an  8.4. point  advantage  for  coached 
students  on  \  erbal  and  a  9,4  point  advantage 
on  Mith. 

'  Whitia  (1962)  compared  the  score  in- 
creases of  52  students  who  had  attended  a 
lO'hour  course  in  unproved  study  habits, 
reading  skills,  and  math  concepts  at  a 
prietary  school  in  Boston  v,,ih  the  scorfc  in- 
creases of  a  comparable  group  of  52  students 
from  the  same  area  who  had  not  t.nken  a 
coaching  course.  All  of  the  students  had 
taken  a  regular  SAT  in  March  or  May  of 


their  junior  year  and,  in  addition,  took  a  spe- 
cial SAT  ift  the  fall  of  their  senior  year  when 
the  study  began,  the  January  regular  SAT 
administration  provided  the  posttest  The 
average  Verbal  and  Math  scores  of  the  two 
groups  were  within  1  point  of  each  other  on 
the  spring  SAT  ajid  within  2  points  on  the' 
fall  pretcsi,  suggesting  that  the  two  groups 
were  not  only  well  matched  in  terms  of  initial 
level  but  also  in  terms  of  growth  rate  over 
this  period,  Whitia  found  :in  ll-point  ad- 
vantage for  the  coached  group  on  Verbal  but 
A  5-point  disadvantage  on  Math  when  the 
posttest  was  cpmpared  \vith^the  fall  pretest; 
there  was  a  lO-point  advantage  on  Verbal 
and  a  7-point* disadvantage  on  Math  when 
compared  with  the  spring  SAT.  Note  that 
the  term  disadvantage  docs  not  signify  a 
score  decrease  on  the  part  of  the  coached 
group,  but  rather  a  failure  of  their  scores  to 
increase  as  much  as  those  of  the  control 
group.  ^ 

Studies  With  Randomized  Control  Groups 

Three  coaching  studies  have  used  a  ran- 
domized dcwgn.  The  first  one.  by  Roberts 
and  Oppcnfieim  (I966r^,^  utilized  the  PSAT 
as-both  pretest  and  posttest.  In  contrast  to 
cariigf  coaching  studies  tl^at  involved  highly 
seiecTive  «nd  effective  private  schools  and 
specialized  or  suburban  public  schools,  the 
Roberts  and  Oppenheim  study  was  under- 
taken to  investigate  whether  students  re- 
ceiving, less  adequate  instruction  might  es- 
peiially  benefit  from  special  preparation. 
Data  were  collected  from  18  predominantly, 
if  not  entirely,  black  secondary  schools  in 
rural  and  urban  Tennessee.  In  6  schools 

.  coaching  consisted  of  fpecial  instruction  in 
verbal  material,  in  8  schools  coaching  was 
for  mathematics,  and  in  4  schools  no  special 
instruction  was  provided.  Within  the  treat- 
ment schools  students  were  assigned  ran- 
domly  to  coached  and  uncoached  groups 
The  instruction  was  prov.ded  in  15  half-hour 
sessions  over  a  4-  to  6-week  period.  The  re- 
sults^showed  small  increases  for  the  coached 
groups  Over  the  control  groups  about  1'-^ 
(1.44)  points  on  PSAT-V  a«d  less  than  I 

%(.81)  point  on  PSAT-M,  increases  that  cor- 
respond to  about  14  points  on  SAT-V  and 
8  points  on  SAT-M.  This  advantage  of 
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coached  over  control  groups,  however,  was 
(fuc  as  muth  to  score  deceases  on  the  part 
of-  the  control  students,  pussibl>  signaling 
problems  in*  motivation  or  attrition,  as  to 
score  increases  on  the  part  of  the  ^coached 
students, 

A  second  randomi/.ed  stud>,  conducted  b> 
LvansandlHke<I973.  Pike&  Lvans,  1972), 
cxammed  intensive  coaching  efforts  in  the 
math  area.  A  sample  of  509  students  m  12 
schools  participated  in  the  stud>.  The 
coached  students  received  21  hours  of  in- 
struction and'  21  hours  of  homework,  over 
a  7-week  period,  directed  at  one  of  the  fol- 
-  lowing  item  types.  Regular  Math  (RM), 
'^D.tta  Suft'icteqc>  (DS),  or  Quantitative 
^Comparisons  (QC).  jfiree  randomly  chosen 
groups  of  students  were  defined  in  each 
school,  one  tt^  be  instructed  in  QC'  onc^in 
either  RM  or  DS,  and  one  as  a  control  group. 
These  groups  took  the  SAT  firs^^in  October, 
which  .served  as  a  pr;test,  and  again  in  De- 
cember (posttesl)  and  the  following  April 
(delayed  posttest).  The  pretest  and  posttest 
were  :>pccial  administrations  of  the  SAT, 
whereas  the  delayed  posttest  was  a  regular 
administration.  Thr  three  experimental 
groups  were  given  special  preparation  during 
November  and  December,  and  the  control 
group  received  instruction  after  the  Dccem- 
»  ber  posttest  and  prior  to  the  April  delayed 
posttest.  On  this  schedule,  all  groups  re- 
ceived instruction  in  test-taking  skills  be- 
coming familiar  ^ah  test  direction^,  pacing, 
and  appropriate  strategies  for  guessing  and 
using  partial  information.  All  groups  also 
had  instruction  in  math  content  numerical 
facts,  numerical  and  basic  algebraic  skills, 
and  in  particular  mathematical  areas  such 
as  inequalities.  In  addition,  there  was  prac- 
tice K)fi  one  of  the  Kcm  types  for  students  in 
each  respective  experiment*^!  group.  The 
study  revealed  acore  increase  ^.beyond  those 
experienced  by  the  control  group  for  each 
of  the  three  cxpcnment.tl  groups  coached  on 
a  particular  item  type  11  SAT-M  score 
points  for  QC.  19  points  for  DS.  and  25  for 
»RM.  However,  because  the  Evans  and  Pike 
(1973)  study  was  designed  to  investigate  the 
relative  Susceptibility  of  three  item  formats 
to  .special  instruction,  it  is  difficult  to  say  just 
how  large  the  effects  w  Juld  be  in  terms  ^( 
coaching  for  SAT-M.  Their  best  estimate  of 


score  increases  reflective  of  coaching  fur  all 
four  groups  over  the  total  period  from  Oc- 
tober to  April  was  about  25  points.  The  av 
erage  increase  over  the  control  group  for 
the  three  ij;ipcrimental  item-type  groups, 
weighted  according  to'^heir  respective  sam- 
ple sizes,  was  16.^  points  over  the  period 
from  the  October  pretest  to  th^  December 
posttest.  Pike  (1978J  later  conjectured  that, 
still  keeping  within  the  total  21  hours  of  spe- 
cial preparation,  a  judivious^ combination  of 
instruction  for  both  RM  and  DS,  the  two 
major  il.em  types  then  in  S^T-M,  would  be 
expected  to  yield  coaching  cir^spccial  prep- 
aration sffects;of  about  33  points. 

In  the  third  randomized  study.  Alderman 
and  Powers  (1980)  investigated  the  effec- 
tiveness of  existing  secondary  school  prg- 
grams  that  had  been  initiated  by  the  schools 
to  improve  the  performance  of  students  on 
the  SAT-V  scale.  Students  at  each  of  eight  ^ 
schools  for  whom  PSAT  scores  were  avail-  * . 
able  were  randomly  assigned  to  a  sj^'cial 
preparation  group  or  to  a  control  gcoup. 
Access  to  the  same  preparation  course  was 
delayed  for  control  students  for  the  purpose 
of  this  study.  A  special  administration  of  a 
retired  form  of  the  SAT  was  used  a^  the 
posttest.  Across  the  eight  schools  the  overall 
increase  in  SAT-V  attributable  to  special 
preparation  was  about  8  points,  which  ts  sta- 
tistically significant  at  the  .05  level  The  ac- 
tual effects  ranged  from  .  3  points  at  one 
schoof  to  28  at  another  Differences  in  ef- 
fectiveness among  the  coaching  programs 
were  not  statistically  significant  from  school 
to  school,  however,  and  the  besl  statistici(l 
estimate  of  the  range  was  from  4  to  16 
points.  Nor,  apparently,  did,  the  control 
groups  react  in  comparable  fashion  from 
school  to  school,, possibly  reflecting  differ 
cnccs-  in  motivation  or  seriousness  in  ap- 
proaching^ special  SAT  that  did  not  count 
for  college  admissions  The  largest  school 
effect  of  28  points,  for  example,  resulted  in 
part  from  a  control-group  decrease  almost 
equal  in  magnitude  to  the  treatment  group 
increase  (  1 1  score  points  in  going  from  tne 
converted  PSAT  to  the  SAT  for  the  control 
group  versus  13  score  points  for  the  treat- 
ment group,  which  yields  a  28-point  school 
effect  when  covariancc  adjustments  are 
madeK  An  attenuated  form  of  this  pattern 
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occurred  al  two  other  schools,  whereas  the 
remaining  five  schools  showed  varying  de- 
grees of  score  increase  for  both  ircalmcnl 
and  c^trol  groups. 

Ai^cr,  more  sublJc  m^lhodoiogieal 
problem  has  emerged  in  the  process  of  re- 
viewing these  coaching  studies  having  ran- 
domized control  groups,  namely,  the  prob- 
lem of  engendering  and  maintaining  realistic 
motivation  for  takii>g  the  posttest  SAT,  es- 
pecially for  uneoached  control  students.  De- 
veloping realistic, motivation  and  effort  for 
taking  pre-  and  posttcsts  is  a  common  re- 
quirement of  all  coaching  studies.  However, 
the  three  experiments  that  employed  ran- 
domized control  groups  also  used  as  the  post- 
test  a  special  administration  of  the  SAT  or 
PSAT  rather  than  a  regular  administration, 
so  thai  the  control  students  would  not  have 
scores  counting  on  their  record  before  having 
access  to, .special  preparation.  But  by  virtue' 
of  not  counting  for  college  admissions,  these 
special  admjnistrations  may  have  been  viewed 
to  some  degree  as  practice  tests,  th<freby 
eliciting  le'ss  motivation  and  effort  than 
^  would  a  regular  SAT  administration.  As  in 
the  study  by  Roberts  and  Oppcnheim  (1966), 
warning  signals  suggesting  this, possibility 
were  noted  in  the  Alderman  and  Powers 
(J 980)  study.  A»  discussed  earlier,  control 
groups  in  three  schools  were  found  to  exhibit 
score  decreases  in  going  from  a<  regular 
PSAT  to  a  special  SAT,  even  though  the 
expcelalion  is  for  a  score  increase  from  an 
October  PSAT  to  a  spring  SAT  of  upwards 
of  10  or  1 2  points  -  this  is  the  basal  estimate 
provided  by  national  administraiton  sam- 
ples. Such  control-group  score  decreases 
substantially  complicate  the  interpretation 
of  intercept  diffcrenccs>»as  ^estimates  of 
coaching  effects  (Mcssick,  1980,  pp.  20-  22). 

As  noted,  control-group  scores  also  de- 
creased in  the  Roberts  and  Oppcnheim 
(1966)  study,  which  similarly  employed,  a 
special  administration  posttest,  in  that  case 
a  special  PSAT.  Unhkc  Alderman  and  Pow- 
ers (1980),  who  used  a  regular  administra- 
tion of  the  PSAT  as  a  pretest,  the  Roberts 
and  Oppcnheim  pretest  PSAT  was  a  special 
administration  as  well.  None  of  the  nonran- 
domized coaching  studies  reviewed  earlier 
displayed  control-group  score  decreases,  and 
the  posttest  in  all  of  those  studies  was  a  reg- 


ular administration  of  the  SAT— although 
Dyer  (1953),  Freijch  (J^955),  and  Whitla 
(1962)  did  use  special  pretest  administra- 
tions and  thereby  introduced  the  possibility  ^ 
of  other  biases.  The  remaining  randomized 
study,  conducted  by  Evans  and  Pike  (1973), 
employed  special  administration  SATs  as 
both  pretest  and  posttest,  but  thei-  delayed 
posttest  was  a  regular;  SAT  administration 
Pike's  (1978)  subsc-^uent  interpretation  of 
score  increases  from  posttest  to  delayed  post^ 
test  as  reflecting  the  long-term  consolidation 
or  continuance  of  gains  due  to  coa<  hing  be- 
comes jeopardized  from  this  vantage  point 
by  the  plausible  rival  interpretation  that 
those  score  gains  instead  reflect  increases  in 
motivation  and  effort  in  going  froin  a  special 
administration  to  a  regular  one. 

Comparison  of  Results  Across 
'  Studies  of  Coaching 

For  numerous  reaS'ons,  iopluding  the  di- 
versity»of  design  limitations  and  the  differ- 
ences in  sample  sizes,  it  is  difficult  to'com- 
pare  results  acros^  these  several  studies  in 
a  meaningful  way  (tf.  Pikt,  1978).  Table  1' 
represent?  ont  such  aUcmpt  for  those  studies 
having  some  type  of  control  group.  The  size 
of  coaching  effects  reported  there  were  cal- 
culated uniformly  as  follows-  When  analysis 
of  covariancp  was  performed,  the  reported 
values  are  intercept  differences  between  the 
experimental  and  control  regression  lines, 
weighted  in  the  case  of  multiple  experimen- 
tal or  control  groups  by  their  ^speclive  sam* 
pie  sizes.  In  four  studies  not  reporting  anal* 
yses  of  covariance,  the  values  in  Table  I  are  ^ 
average  score  increases  of  experimental  over 
control  groups,  again  weighted  in  (he  case 
of  multiple  experimental  or  control  groups 
by  their  respective  sample  sizes.  Two  of  these 
latter  studies-  (by  Frankel,  I960,  and  by 
Whitla,  1962)  involved  statistical  matching^ 
and  two  (by  Roberts  Sc  Oppcnhdim,  I966r 
and,  by  Evans  &  Pike,  1973)  involved  ran- 
domization. Averaging  those  results  over  all 
of  the  stydies  in  Table  I,  weighting  in  each 
case  by  the  size  of  the  experimental  sample, 
yields  14.3  points  for  Verbal  and  15  I  points 
for  Math  (the  unweighted  averages  are  10  4 
for  Verbal  and  13.0  for  Math). 

For  those  studies  having  no  control  groups. 
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a  summary  is  provided  m  Tabic  2.  The^pc- 
ctai  preparation  programs  summarized  there 
focus  on  verbal  or  mathematical  content 
knowledge  and  skill  development  and  entail 
the  largest  amounts  of  student  contact  time 
^f  anyi  of  the  studies  reviewed,  which  would 
ordinarily  lead  one  to  characterize  them  as 
instruction  rather  than  coaching.  These  pro- 
grams range  from  45  hours  of  student  c(/n- 
tact  time  over  6  weeks  to  48  hours  ovei\8 
weeks  to  roughly  100  hours  over  6  montlX 
to  virtually  full-time  over  6  months  or  ap-j 
proximately  600  hours  (assuming  six  50j 
minute  periods  a  day  for  24  weeks)*  The 
45-,  48%  and  100-hour  programs  wcre/fc- 
votcd  solely  to  special  preparation  m^Vc/bal, 
whereas  the  full-time  progranis>#fvoIved 
both  Verbal  and  Math  pritparalfcnTpresum- 
ably  with  each  receiving  roughly  equal  300- 
hour  coverage.  In  contrast,  the  must  inten- 
sive ot  the  control-group  studies  summarized 
in  Table  1  were  40  hours  of  student  contact 
time  divided,  presumably  equally,  between 
Verbal  und  Math  (Slrojd,  1980)  and  2! 
hours  over-^  weeks  devoted  to  special  prep- 
aration in  Math  only  (Lvans  &  Pike,  1973), 
in  addition.  School  U  in  Alderman  and  Pow 
ers  ( y?80)  entailed  45  hours  of  student  con- 
tact time  over  10  weeks  m  Verbal  prepara 
tion  only. 

In  the  absence  of  control  groups,  instruc- 
tional or  program  effects  were  estimated  in 
Table  2  in  the  manner  described  earlier 
that  IS,  by  adjusting  the  average  score  gams 
reported  in  each  study  by  the  average  oi  fo,ur 
adjustments,  those  suggested  by  (a)  the  au- 
thors of  the  original  articles,  (b)  Slack  & 
Porter  (1980),  and  (c)  Pji;c  (1978),  as  well 
as  (d)  the  average  score  gams  of  control  stu 
dents  in  other  coaching  studies  who  had 
roughly  comparable  initial  score  levels.  Av- 
eraging these  estimates  over  all  the  studies 
in  Table  2,  weighting  in  each  case  according 
to  group  size,  yields  38  points  for  SAT-V 
and  54  points  for  SAT-M  (the  unweighted 
ave;agcs  arc  39  points  for  Verbal  and  53 
points  for  Math).  Given  that  the  adjustments 
were  dubious  and  provisional  and  that  the 
students  in  each  program  were  highly  self- 
selected,  these  values  arc  still  probably  ovcr- 
estimatcp  of  program  effects.  But  their  gen- 
cral  magnitude  suggests  that  the  verbal  and 
mathematical  reasoning  skills  measured  by 
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the  SAT  may  be  enhanced  to  a  measurable 
degree  by  long  term  and  intensive  instruc- 
tion, at  least  for  highly  motivated  students 
Granted  that  there  is  some  overlap  orblur 
ring  of  the  distinction  beiween  coaching 
studies  in  Table  1  and  instructional  studies 
m  Table  2,  the  two  types  seemed  sufficient!) 
different  X  j  warrant  separate  treatment  \c 
cordingly,  overall  averages  were  not  com- 
puted for  the  total  combined  set  of  studies 
because  possible  differences  in  impact  might 
thereby  be  obscured  In  contrast.  Slack  and 
Porter  (1980)  have  chosen  iO  combine  both 
types  of  studies  in  a  single  table  and  lo  report 
^  overall  weighted  average  score  increases  cf 
coached  groups  over  uncoached  control 
groups  or,  when  control  groups  were  not 
utilized,  over  norm  comparison  groups  This 
assumes  that  the  adjustments  applied  to  the 
score  gams  in  studies  lacking  control  groups 
were  large  enough  to  correct  appropriately 
for  the  xperiential  growth  of  self-selected 
students  that  would  have  occurred  regardless 
of  the  program.  And  in(*eed,  the  adjustments 
made  by  Slack  and  Porter,  being  derived 
from  normative  cata  of  dubious  relevance 
to  thc^' preparatory  school  students  in  ques- 
tion, were  smaller  than  those  based  on  the 
average  of-four  adjustments  as  applied  in  our 
Tabic  2.  Because  of  this  and  various  over- 
sights in  their  table,  the  combined  weighted 
averages  of  29  points  for  SAT-V  and  33 
points  for  SAT-M  that  they  report  are  more 
like  22  and  28  points,  respectively  (Messick, 
1980,  pp,  24  26)  Such  combined  averaging 
IS  misleading  not  only  because  the  adjust- 
ments may  be  questionable,  but  because  the 
combined  averages  obscure  -important  dif- 
ferences between  the  special  preparation  * 
programs  in  the  two  types  of  studies  As  in- 
dicated earlier,  a  comparison  of  the  brief 
program  descriptions  in  Tables  1  and  2  re- 
veals that  the  programs  in  studies  lacking 
control  groups  happened  also  lo  be  quite 
long-term  and  intensive  with  respect  to  stu- 
derS  contact  time^  whereas  the  programs  in 
control-group  studies  were  relatively  short 
terra  and  nonintensive  The  former  programs 
also  entailed  organized  curriculum  content 
and  skill  development  well  as  test  review, 
whereas  the  latter  programs  tended  to  em 
phasi/e  test  review  and  practice  exercises 
Rather  than  averaging  across  these  two 
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Tabic  1 

Uerafie  Difference  Between  Experimental  and  Control  Groups  tn  Sttuhes  of  SAT  Coaching  Intencntions 
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Tabic  I  (continued) 


SAT-MMh 

,  Sample  <)ur4ci(rmKt 

C)kif4<t(ri»tKt  of  lh<  special 

—  ^ 

[hffcfcrKc* 

y 

Dtffcrcflce* 

lever 

EiperiiTKAUl/ 
Control 

«XMrof  l<a  M:«rc  UAtcri 

School  A  ^OfKMirtcommerml 

CCi|<ht1| 

School  B  24  hours  oommfrcial 

■cOI 

UJ/1729 

3  V 

<0I 

U)/I?2t 

14  V 

^d<r  SAT  •  ScWaMJC  A^iJtwJc  Te»l,  M  »  mjk:  F  -  fcnuk,  ETS  »  C;t5*c4tioniIT(»tiA|  S<f>KC. «  *  noflwirti6c*A( 

'  tltc  eflco*  4rc  imciicpt  ^'ftcrciv^f  between rc|rcsfiOA<ioc»  J«  e«f<rime«ul  jixl  conuot  frwp*  vf  »J«  IrjtnkeL  iVtO.  Ahiiu.  ik^Oi.  Rybcui.  A  Upp<«hcim.  iVWj,  <n«i  pjkt  4c  1  ntyx.  iVh  ^veuic  Kore  iBci<«i«t 

if  ct;<rim<Afal  ovrr  coftlM  frcwpt  Vt^  wcrfhlfd  m  Ik  cai«  of  mvltiple  eipenmcAUl  o<  OMircJ  tfO«{«  b>  lh<if  rc>pc<lit«  uin;4<  urcs 

*Af  ShOVkft  r«<  COtCAlAJC  cffccU  rCfOflcd  fft  «flflMl  tClt 

*  Nof  €«lc«l4icii,  variance^  and  tttm\to^  %\ot<\  differed  SJ|tAi^4AiIjr  fof  eir<nm<Aial  ind  cottUiA  |r*v[« 

'Thnstttiy  (mpto>(d  (h«  frchmiiury  S^holaMic  Aptilkdc  Test  as  boih  frc*  and  poillcsi.  the  averages  sSov^abaxe  been  ivttvertrd    the  i»AT  score  M,ale  ranf)A|  /rom  200  tulOOpc^nts 

*  Wc>th(ed  mean  scwe  ef  feels  pix>/tAt  jvAKMiand  seAiors  aeross  lest  arfmimiiralto*  years  from  St  rood  s  rearvitysisof  federal  Trkde  Commission  tdC}  dila 

Kock >  il9tOi  esiiiTuies  iot  nCSehoUAof  16  V  (•«J>AT-<Verb4i  ai>4  J0  6  fot^AT'Math      *  i^infc  MtMUUicdiv*  6ifoud  »  u'')^U>  «>tim4ic»,  <he  wetfhted  jvcrafcs  bevvme  y  1      Vcrt»Und  i4iftft  Math 
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Tabic  2 


Adjusted  Average  Score  Gains  in  Studies  of  SAT  Instructional  Interventions  Without  Control  Groups 


ERIC 


SAT-Verbal 

SAT- Math 

Sample  characteristics 

Adjusted 
average  score 

Characteristics  of  the  special 
preparation 

Adjusted  average 
score  increase* 

Study 

School 

Level 

Sex 

N 

increase* 

Pallonc(I961) 

Private 

High  school  seniors 
and  graduates 

M 

90*min.  daily  instruction  and 
practice  in  developmental 
reading  skills  wer  6  weeks 

$1 

204^ 

PaIlonc(l96!) 

Private 

({igh  school  seniors 
and  tradualcs 

M 

50-min.  daily  instrucit^a  antS 
practice  in  developmental 
reading  skills,  with  stress 
on  logical  inference  and 
analogic  analysis  over  6 
months 

68  (43)* 

80- 

• 

Marron  (1965) 

Private 

High  school  seniors 
and  graduates 

M 

FuII'iime  daily  sessions  aimed 
at  verbal  and  mathematical 
content  and  test-taklng 
skills  over  6  months 

Croup  2  33  I 

OrOup  ^    LA  i 

Qroup  4    12  J 

83 
600 

26 

Croup  r   59  232 
Croup  r  53  405 

Cttawn  V    46  78 

Coffman  &  Parry 
(I967r 

Public 

College  freshmen 

M  and  F 

6>hours  .weekly  of  instruction 
in  accelerated  rciiding  over 
8  weeks 

4* 

19 

Average  weighted  by  \nc  of  experimental  sample 

38  (36)* 

54 

Ao/*"  Sat  ^  Scholastic  Aptitude  Test;  M  ^  male;  F female,  ...  rr      a  . 

'  To  cilimaie  instructional  or  program  ertccts.  average  score  increases  m  the  Pallone  1 196 1  >  and  Marron  (1965)  studies  were  adjusted  by  the  average  of  four  adjustments, 
those  suggested  by  (a)  the  authors  of  the  original  articles- Pallone  suggested  35  points  on  SAT- Verbal  as  normal  expectation  of  gams  during  the  final  year  of  secondary 
school  (15  points  for  the  S-month  interval  between  tests  m  the  short-term  program),  and  Marron  suggested  24  and  26  points.  respctl»vcly»  for  SAT  Verbal  and  S>AT- 
Math  ai  typical  gams  lor  high  school  seniors  over  6  months,  (b)  Slack  and  Porter  ll980j~  average  gams  in  national  administrations  of  junior  to-semor  year  releslers 
having  the  >ainc  initial  average  score  levels  as  Pallone's  and  Marron's  groups,  (cj  Pike  (I978j-  average  gains  of  control  students  m  superior  schools  from  other  studies 
of  proprietary  programs,  as  well  as.  (dj  avcr.ige  gams  of  control  students  m  other  studies  who  have  average  imtiai  score  levels  roughly  con  rarable  to  those  of  I  allones 
and  \iarron's  groups  -  ,  i.   nt.  <c*    *  .  vii 

"  Due  to  discrcpan«.ics  in  Pailone  s  lables.  there  is  some  uncertainty  as  to  whether  ihe  average  adjusted  s«.ore  effect  m  his  long  term  program  should  be  65  points  or  4i 

ahe^^^wcS^pro^ram  m  tollman  and  Parry  was  not  included  because  the  29-point  mean  decrease  ins«.ores  was«.onsideredal>pitjl  and  possibly  indicative  of  motivational 
and  tesi-administration  problems  i.  i.    .      .  i  u      i  e 

*  The  two  S-wcek  programs  in  Coffman  and  Parry  were  combined,  but  adjustments  were  made  only  by  the  Slack  and  Porter  procedure,  which  attenuated  by  only  a  few 
points  an  already  tenuous  effect.  None  of  the  suggested  comparison  groups  of  SAT  lakers  appeared  to  provide  even  remotely  reasonable  yardsticks  for  gauging  score  gains 
of  students  already  enrolled  in  a  college  not  requiring  the  SaT.  -|  -- 
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fcrenl  and  usually  unknown  amounts  of 
homework,  this  rank-correlation  procedure 
laculy  assumes  that  the  amount  of  home- 
work in  each  case  was  roughly  proportional 
Iv  the  number  of  student  contact  hours,  so 
that  the  overall  orderings  would  not  be 
markedly  changed  if  homework  were  taken 
into  account. 

In  interpreting  these,  sizable  monotonic 
relationships  between  student  contact  time 
and  score  effects,  it  must  be  remembered 
that  these  are  rank-order  correlations  be- 
tween average  values  of  different  samples  or 
groups,  and  correlations  between  averages 
are  typically  much  higher  than  correlations 
twlween  individual  differences  within  groups, 
r-urlhermore,  these  rank  correlations  are 
dominated  by  the  relative  consistencies  be- 
tween the  two  types  of  studies  with  respect 
to  the  ranking  variables— that  is,  the  con- 
trol-group studies  are  all  relatively  low  in 
both  student  contact  time  and  score  effects, 
whereas  the  uncontrolled  studiei>  are  all  rel- 
atively high  in  both  student  contact  time  and 
score  effects.  H  must  also  be  remembered 
that  the  relatively  high-contact  programs 
entailed  structured  curricula  emphasizing 
content  knowledge  and  skill  development, 
whereas  the  relatively  low-contact  programs 
emphasized  test  review  and -practice.  With 
this  confounding  of  program  characteristi:;s 
in  mind,  it  appears  that  increases  in  student 
contact  time  (possibly  serving  as  a  proxy  for 
increasing  curriculum  emphases  on  content 
knowledge  and  skill  development)  are  sys- 
tematically associated  on  the  average  with 
increases  in  SAT  scores.  However,  even 
though  the  time  dimension  is  covered  in  only 
a  fragmentary  fashion  by  the  available  stud- 
ies, when  the  magnitude  of  (adjusted)  score 
effect  IS  plotted  against  student  t-ontaa  time, 
the  relationship  docs  not  appear  to  be  linear 
Since  the  form  of  this  relationship  might 
enable  us  to  predict  the  rough  magnitude  of 
score  effects  expected  to  be  associated  with 
toa^hing  programs  entailing  given  levels  of 
student  contact  time,  these  data  plots  war- 
rant careful  examination. 

Diminishmg  Returns  in  Coaching  Effects 

Attempting  to  approximate  the  general 
form  of  the  function  relating  score  effects 


to  student  contact  time  in  coaching  pro- 
grams is  difficult  with  the  available  data  for 
two  reasons  One 'is  the  fragmentary  way  in 
which  the  time  dimension  is  covered  by  the 
existing  studies,  especially  in  the  range  be- 
tween 30  hours  and  300  hours.  iKe  latter 
representing  half-time  devoted  to  either  Ver- 
bal or  Math  coaching  in  a  6-month  full-time 
preparatory  school  program,  the  other  is  the 
inevitable  variability  or  noise  present  in  stud- 
ies having  methodological  flaws  Barring  the 
collection  of  new  data,  little  can  be  done 
about  the  first  difficulty  But  with  respect  to 
the  second,  we  can  attempt  to  mute  the  effect 
of  noise  to  some  extent  by  excluding  from 
consideration,  at  least  initially,  dgta  from 
studies  already  identified  as  being  particu- 
larly suspect  namely,  data  from  Roberts 
and  Oppcnheim  (1966),  from  Coffman  and 
Parry  (1967).  and  from  Schools  A,  B,  and 
D  of  Alderman  and  Powers  (1980).  Al- 
though these  suspect  data  points  will  not  be 
used  to  fit  any  functions,  they  will  be  plotted 
subsequently  to  see  how  aberrant  they  are 
with  respect  to  functions  based  on  the  re- 
maining data. 

for  somewhat  different  reasons,  the  data 
for  Pallones  (1961)  summer  and  long-term 
programs  will  also  be  excluded  initially  and 
subsequently.plotted  in  relation  to  identified 
functions  in  the  same  way  Here  the  primary 
reason  is  uncertainty  about  how  to  estimate 
student  contact  time  for  these  programs 
Pallone's  long-term  program  is  described  as 
50  minutes  of  daily  instruction  over  6  months 
or  approximately  100  hours,  but  since  the' 
students  were  also  attending  preparatory 
school  fulUtime  during  this  period,  it  seems 
,more  appropriate  in  ihe  absence  of  control 
groups  lo  estimate  their  contact  time  for 
Verbal  preparation  at  300  hours,  as  was  done 
for  Marron  &  (1965)  preparatory  school  stu- 
dcnb.  There  is  also  some  uncertainty .  arising 
from  discrepancies  m  Pallones  own  tables, 
as  to  whether  the  average  adjusted  score 
eltect  for  his  long-term  program  is  68  points 
or  43  points  (see  Table  2).  Moreover,  the 
summer  program  is  described  as  90  minutes 
of  daily  instruction  over  6  weeks,  or  approx- 
imately 45  hours,  but  since  the  students 
might  also  have  been  attending  other  sum- 
mer preparatory  courses  during  this  period, 
it  IS  impossible  in  the  absence  of  information 
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Tabic  3  {continufd) 
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points  (uvvaril  ihc  iow  end  of  the  time  scale, 
Ignoring  Marron  s  four  groups  for  the  mo- 
ment, IS  4.322  ^  J35/'.  (A  =  13,  r  - 
.37).  The  {Predicted  values  toward  the  low 
end  of  the  scale  are  now  more  in  line  with 
the  data  (e.g.,  4.7  score  points  for  I  hour  of 
contact  time,  IJ  for  iO  liours,  ll.O  for  20 
hours.  14.4  for  30  hours.  2L1  for  50  hours), 
but  the  predicted  values  toward  the  high  end 
are  out  of  line  Ir.g..  the  predicted  score  effect 
for  300  hours  of  contact  time  is  105  points, 
which  IS  three  times  as  large  .is  the  adjusted 
weighted  $A  F-V  effect  for  Matron's  four 
groups  and  almost  twice  as  large  as  thctr 
Gnadjusted  weighted  average).  Thus,  the 
regression  line  based  on  data  from  coaching 
programs  entailing  less  than  50  hours  of  stu- 
dent contact  time  projects  an  expected  score 
effect  for  programs  of  300  contact  hours  that 
is  two  to  ihree  times  higher  than  the  average 
effect -actually  associated  with  those  300- 
hour  programs  in  practice.  Consequently,  as 
student  contact  time  increases,  there  appear 
to  be  diminishing  returns  in  SAT-V  score 
effects  associated  with  coaching. 

simitar  picture  emerges  for  SAT-M. 
The  linCfir  regression  equ.ition  for  the  14 
Math  studies  is M  -  12.699  +  .134/,  (A'  - 
14,  r  ^  ,89).  Again,  th.is  equation  is  domi- 
nated by  Marron  A  ( 1965)  threcLMath  groups 
at  300  hours  of  student  contact  time,  for 
which  the  predicted  score  effect  of  53  points 
IS  close  to  their  adjusted  weight  average  (see 
fable  2),  But  once  more  the  predicted  values 
at  the  low  end  of  the  time  scale  are  out  of 
ttnc  With  the  data  -  for  example.  12.8  score 
points  for  1  hour,  14.0  for  10  hours,  15.4  for 
20  IjiiujSs,  16.7  for  30  hours,  and  .19.4  for  50 
\(^Ts.  The  linear  regression  equation  for  the 
n  data  points  toward  the  low  end  of  the 
time  scale,  ignoring  Marron's  three  groups 
momentarily,  is  A/  4.900  .713/,  (A  - 
II.  r  -  .49).  The  predicted  values  toward 
the  low  end  of  the  scale,  as  they  were  for 
Verbal,  are  now  more  in  line  with  the  data 
(e.g,,  5  (>  score  points  for  1  hour,  12.0  for  10 
hours.  19.2  for  20  hours.  26.3  for  30  hours, 
and  40.5  for  50  hours),  but  those  toward  the 
high  end  of  the  scale  are  out  of  line  (e.g., 
the  predicted  score  e fleet  for  300  hours  of 
contact  time  is  219  points,  which  is  over  four 
times  as  large  as  the  adjusted  weighted  SA T- 
M  effect  for  Marron  s  three  Math  groups 


and  nearly  three  times  as  large  as  their  un- 
adjusted weighted  average)  Clearly,  a\stu- 
dent  contact  time  increases,  there  appear  to 
be  diminishing  returns  in  SAT-M  score  ef- 
fects as  well. 

As  IS  frequently  the  case  in  situations  with 
diminishmg  returns,  a  logarithmic  transfor- 
mation of  the  time  dimension  provides  a 
much  better  representation  of  the  functional 
relationships,  as  is  seen  in  Figure  I  for  SAT- 
V  and  figure  3  for  SAT-M.  In  this  formu- 
lation, all  logs  are  to  the  base  10  The  solid 
line  in  Figure  1  is  the  regression  of  SAT-V 
score  effect  on  .student  contact  time  in  log 
h.iurs.  /-(7^),  based  on  all  17  data  points  dis- 
cussed previously,  its  equation  is  K  = 
-6.587  +  I5.155/.(r),  (A^-17,  r  =  .70). 
The  dashed  regression  line  in  Figure  1  is 
based  on  the  13  data  points  toward  the  low 
end  of  the  tune  scale,  omitting  the  values  for 
Marron's  (1965)  four  Verbal  groups,  its 
equation  is  K  =  -  7.768  +  1 6.4 1 8/.( T), 
(iV-  13,  r  =  .47).  In  contrast  to  the  dis- 
crepant regression  lines  obtained  when  a  lin- 
ear fit  in  real  time  was  attempted  for  17  and 
13  data  points,  these  two  regressioh  linCsS  in 
log  time  are  very  similar  to  each  other  for 
example,  the  predicted  SAT-V  score  effect 
corresponding  to  300  hours  of  student  con- 
tact time  (2.477  log  hours)  is  31  points  by 
the  first  equation  and  33  points  by  the  Sec- 
ond. It  should  be  noted  that  these  predicted 
^alucs^even  though  based  on  an  unweighted 
least  squares  solution,  closely  correspond  to 
the  adjusted  score  eTfcct  focMarron's  largest 
group  (iV  ^  600)  and  thatltTs  other^three 
more  deviant  groups  entailed  much  smaller 
sample  si/es  (A^  =  83,  5,  and  26  in  descend- 
ing order  of  score  effect)  According  to  these 
logarithmic  functions,  an  estimated  zero 
SAT-V  score  effect  is  obtained  at  somewhat 
less  than  3  hours,  suggesting  that  additional 
data  points  in  this  region  may  require  more 
curvature  in  the  function  or,  more  likely, 
that  a  threshold  or  critical  mass  of  coaching 
effort  must  be  attained  before  positive  score 
effects  are  exhibited.. 

The  triangle  in  Figure  I  corresponds  to 
Rock's  (1980)  estimate  of  the  SAT-V  score 
effect  taking  differential  group  growth  rates 
into  account  for  students  at  School  A  in  the 
FTC  (1979)  stMdy.  Even  though  these  two 
logarithmic  regression  equati^^ns  were  based 
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on  Siroud  a  U'>HO)  c^Umate  fur  School  A, 
ihc  Rovkotinuiic  clcarl>  more  consistent 
With  both  regression  hncj>.  The  regression 
equation  substituting  Rock  .s  estimate  of  the 
SA  F-V  effect  for  School  A  in  the  TTC  data 
for  Strouds  estimate  is  P  =  7,544  + 
15,221  /.(r).  (A'  -  17.  r  =  .74),  whieh  is 
very  similar  to  the  regression  equation  based 
on  Stroud's  estimate  but,  b>  virtue  of  the 
greater  conglruence  of  Rock*s  value,  reflects 
a  somuwhut  Itigher  correlation  among  the 
data  points  « 

I  igurc  2  expands  (he  data  base  reprc- 
.rented  in  I _*gure  i  b>jiddin^^ thejj^ta^^ 
excTutTeirTnUialiyrThe  five  circles  in  1  igure 
2  correspond  to  the  live  suspect  data  points 
of  Roberts  and  Oppcnheiin  ( 1 966),  Coffman 
»ind  Parr>  1 1967).  and  Schools  A,  B,  and  D 
trum  Alderman  and  Power^s  U980),  It  can 
be  Necn  thai  these  poinu  are  somewhat  nois 
ler  ihan  the  rest,  the  correlation  between 
SAT-V  effect  and  log  lime  being  .59  for  ^2 
data  points  but  .70  for  17  points.  However, 
as  ts  apparent  in  \  igure  2,  the  regression 
equation  based  on  22  data  points  does  not 
differ  dramaticall)  from  the  other  equa 
tions.  P  -  2.405  +  I2.566M7),  (.V  = 
22.  r  -  .59). 

Imall>,  the  squares  in  figure  2  corre- 
spond to  the  two  discrepant  estimates  of  ad 
justed  SA  I-V  effects  for  Pallones  (1961) 
long-term  program  (sec  Table  2),  When 
plotted  at  300  hours  (2.477  log  hours),  as 
previously  argued,  the  smaller  of  these  es- 
timates (4J)  IS  quite  consistent  with  the  log 
arithmic  regression  system  for  13,  17.  and 
22  data  points,  whereas  the  larger  estimate 
(6ii)  is  deviant  but  not  incompatible.  The 
logarithmic  regression  equation  for  the  23 
data  points  including  (he  43-point  estimate 
at  300  huuVs  of  student  contact  time  is 
^  -  "4.025  *■  14.253a  T),  (^  -  23,  r  - 
t}(>K  substituting  the  larger  68-point  esti- 
mate at  300  hours  for  the  smaller  value, 
the  equation  becomes  V  -  6.673  f 
17.089/.(  /).  (A -23,  r-  .66).  The  first 
equation  is  quite  similar  to  the  three  plotted 
in  f  igure  2  and  the  second  equation  is  not 
markedly  different.  As  compared  with  ihc 
1-igure  2  estimates  of  33.  31,  and  29  points 
for  a  benchmark  300  hours  of  student  con- 
tact time,  the  regression  equations  including 
Pallone  s  data  yield  31  and  36^ints.  Lven 


when  Pallone's  estimated  score  effects  are 
plotted  at  100  hours  of  student  contact  time 
(tacitly  treating  Pallone's  course  in  isolation 
from  other  verbal  preparation  likely  accru- 
ing fjroni  full-time  sch^l  attendance),  the 
respective  regression  lines  are  still  quite  com- 
parable to  those  shown  in  Figure  2:  For  43 
score-effect  points.  V  =  3.'618  + 
14.l66a7').  (A^  =  23,  r  =  .62),  and  for 
68  score-effect  points.  V  ^  -4.973  + 
I6.05m7').  (A  =  2a,  r  =  .59).  These  equa- 
tions yield  estimates  of  31  and  35  points, 
respectively,  for  the  benchmark  of  300  hours 
of  St uderi t__c:onUicl  tinie^ .  jslcvexXheIess»_if 
plotted  at  100  hours,  these  data  points  for 
Pallone's  long-term  program  arc  quite  de- 
viant, particularly  the  larger  value  of  68 
points,  but  the  reported  score  effect  for  Pal- 
lone's summer  pilot  program  appears  to  be 
aberrant  in  this  logarithmic  formulation  for 
an>  plausible  range  of  adjustments  for  ex 
penenlial  growth  or  any  plausible  range  of 
student  contact  time.  In  sum,  the  logarith- 
mic regression  system  relating  SAT  V  score 
effect  to  log  contact  time  based  on  1 7  data 
points  appears  to  be  quite  robust  under  the 
addition  of  the  noisier  values  available  from 
a  half-dozen  other  studies  all  of  whicli  are 
questionable  for  one  reason  or  another. 

The  solid  line  in  Figure  3  is  the  regression 
of  SAT  M  score  effect  on  student  contact 
time  in  log  hours  based  on  14  data  points 
(see  Table  3);  its  equation  is  A/  - 
-  14.072  +  26.646A(r).  (;V=14,  r=.91). 
The  dashed  regression  line  in  figure  3  is 
based  on  the  1 1  data  points  toward  the  low 
end  of  the  time  scale,  omitting  the  values  for 
Marron*s  (1965)  three  Math  groups,  its 
equation  is  A/  ^  7.9m  20.775a  T). 
(A  -  II.  r  .51).  In  contr.ist  to  the  marked 
discrepancy  in  regression  lines  obtained  when 
a  linear  fit  in  real  time  was  attempted  for 
14  and  1 1  points,  these  two  regression  lines 
in  log  time  are  very  similar  to  each  other 
although  they  are  not  quite  as  consonant  as 
the  corresponding  lines  in  the  Verbal  data, 
as  might  be  expected  because  of  the  smaller 
samples  of  data  pomts.  For  example,  the 
predicted  SAT  M  effect  corresponding  to 
300  hours  of  student  contact  time  (2.477  log 
hours)  IS  52  points  by  the  first  equation  and 
44  points  by  the  second,  an  8  point  differ- 
ence, vvhicli  IS  a  far  cry  from  the  166-point  ^ 
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discrepancy  in  the  same  300-hour  estimates 
based  on  a  linear  fit  in  real  time  to  14  and 
11  data  points.  The  one  circle  in  Figure  3 
represents  the  Roberts  and  Oppcnheim 
(1966)  data,  which  can  be  seen  to  be  quite 
consistent  with  these  logarithmic  regres- 
sions, the  regression  equation  including  this 
additional  data  pqint  is  A/"  -12.451 + 
25.7637.(7'),  {N  =  15,  r  -  .91).  Agjin,  ac 
cording  to  these  logarithmic  functions,  an 
estimated  zero  SAT-M  score  effect  is  ob- 
tained at  around  3  hours  or  somewhat  less, 
indicating  that  the  threshold  of  coaching 
effort  needed  for  positive  .^core  effects,  if 
such  be  Its  import,  is  roughly  comparable  for 
Verbal  and  Math  although  the  slope  of  the 
Math  function  is  more  than  half  again  as 
steep  as  that  of  the  Verbal  function. 

In  regard  to  appraising  the  goodness^f  fit 
'  of  the  data  points  to  the  proposed  logarith- 
mic model,  it  can  be  seen  in  Figures  1  and 
2  that  the  largest  residuals  for  SAT-V  are 
associated  with  Marron's  (1965)  Groups  1 
and  4,  with  Stroud's  (1980)  estimate  for 
FTC  (19*79)  School  A,  and  with  three  of  the 
five  j^uspect  studies.  This  is  attested  to  by 
noting  that  the  root-mean-square  residual 
for  22  data  points  is  10.9,  which  is  reduced 
to  10.5  by  eliminating  the  five  suspect  stud- 


ies, further  reduced  to  8.4  by  dropping  Mar- 
ron's four  groups,  and  still  further  reduced 
to  6.6  by  substituting  Rock's  (1980)  FTC 
School  A  estimate  for  Stroud's.  The  good- 
ness of  fit  for  SAT-M  as  revealed  in  Figure 
3  is  even,  better.  The  root-mean-.square  re- 
sidual for  14  data  points  is  7.3  whereas  that 
for  1 1  data  points  is  7.6.  Although  it  would 
be  desirable  to  evaluate  the  size  of  residuals 
in  relation  to  the  standard  error  of  their  as- 
sociated score-effect  estimate,  many  of  the 
studies  did  not  report  standard  errors,  nor 
could  they  be  readily  calculated  from  the 
information  given.  Nonetheless,  there  was 
some  indication  that  deviations  from  the 
model  were  at  least  partially  a  function  of 
sampling  ?rror  because  the  larger  residuals 
tended  to  be  associated  with  studies  having 
smaller  sample  sizes.  The  rank-order  cor- 
relation between  the  absolute  value  of  SAT- 
V  residuals  and  the  size  of  their  correspond- 
ing treatment-group  sample  was  -.30  for  the 
regression  model  based  on  17  studies  (still 
using  Rock's  estimate),  whereas  the  rank* 
order  correlation  for  SAT-M  residuals  based 
on  14  studies  was  -.56.  Although  the  former 
coefficient  is  not  statistically  significant,  the 
latter  value  is.  Overall,  then,  the  proposed 
logarithmic  model,  however  adventitious  it 
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may  appear  al  hrsl  glance,  uffcr^  a  plausible 
hypoihcMs  fur  the  rclaliunship  bciwccn  in- 
creasing student  cuntact  time  and  increasing 
scure  effects  in  programs  uf  cuathing  and 
instruction  for  the  SAT. 

Tu  recapitulate  brief1>,  substantial  rank- 
order  correlation^  were  nuted  between  SAT 
.scoie  effects  in  toathingstudiesand  the  level 
uf  ;^tuder»t  contact  time  entailed  in  each 
coaching  program  (sv^  Table  3).  This  reg- 
ularity of  munutonn,  relatiunship  appears 
nut  tu  be  linear,  huwcver,  but  appruximately 
logarithmic,  at  least  within  the  limitatiuns 
of  the  fragmentary  data,.  If  this  :»uggestcd 
logarithmic  relatiunship  has  i»ubstante,  then 
each  additional  increase  in  SAT  stores  as- 
sociated with  coaching  may  require  geo- 
metricall>  increasing  amounts  of  student 
cuntatt  time  and  ul  all  the  curricular  effurt 
that  contact  time  may  be  prox^for.  for  ex- 
ample, accurding  tu  the  logarithmic  function 
for  SAT-V  based  un  17  data  points,  an  av- 
erage score  increase  of  10  points  un  a  200- 
to  800-point  scale  would  be  expected  to  be 
associated  with  approximately  12  hours  of 
slwlcnt  contact  time  in  a  Verbal  cuuching 
program,  but  20  score  points  wuwld  require 
57  hours.  30  score  points  would  require  260 
hours,  and  for  40  SAT-V  score  points  a  totals 
uf  1,183  hours  wuuld  be  required  (althuugh 
the  latter  extrapolation  is  far  beyond  the 
range  uf  the  data).  Similarly,  for  the  SAT- 
M  functtun  ba^cd  un  14  data  points.  An  av- 
crage  scurc  increase  uf  10  points  Wuuld  be 
expected  to  be  associated  with  approxi- 
mately S  huurs  of  student  contact  time,  but 
20  scurc  points  wuuld  require  19  huurs,  30 
score  points  would  require  45  hours,  and  to 
attain  40  SAT-M  Acurc  points  wuuld  require 
a  total  of  107  hours.  The  fact  that  Math 
entaiLs  IcssMudcnt  cuntact  time  t^^an  Verbal 
lur  a  given  amuunt  of  score  increase  is  con- 
sistent once  again  with  the  cxpectatiun  that 
Math,  being  mure  curriculum  related  than 
Verbal,  sHuuld  be  relatively  mure  responsive 
tu  instructional  intervention* 

It  must  be  emphasi/cd  that  these  func- 
tions apply  to  existing  data  and  that  the 
available  Mudies  all  invulvcd  students  whu 
to  a  large  degree  were  mutivatcd  iu  increase 
their  test  scurcs  through  cuaching  ur  special 
preparation.  Such  mutivated  students  are 


likel>  tu  have  been  highly  task  oriented,  and 
under  such  circumstances  it  is  not  unreason- 
,tble  that  student  contact  time  should  be  di- 
rectly related  to  average  test  score  increases 
We  have  also  cautioned  that  increases  in 
student  contact  time  are  confounded  in  these 
studies  with  increasing  curriculum  emphases 
un  content  knowledge  and  skill  development, 
so  thai  other  program  characteristics  ♦hat 
contact  time  may  be  proxy  for  should  also 
be  taken  into  account  in  interpreting  the  re- 
lationship and  in  shaping  expectations  In- 
deed, the  tei  ms  lime  and  method  wctq  paired 
in  the  title  of  this  article  partly  to  underscore 
that  student  contact  time  and  aspects  of 
coaching  method  are  confounded  in  the 
available  coaching  studies  and  partly  to 
highlight  the  importance  of  recurrent  flaws 
tn  experimental  method  that  serve  to  obscure 
ihe  functional  role  of  contact  t^hic  in  un- 
derstanding coaching  effects  Speaking  of 
methodological  Haws^  we  must  finally  also 
consider  the  possible  role  of  selection  bias 
in  interpreting  the  basis  of  the  observed  re- 
lationship, because  man)  of  the  longer-term 
programs  such  as  the  preparatory  schools 
in  Marron*s  (1965)  stud>  and  the  commcr 
cial  coaching  schools  in  the  IT^C  (1979) 
stud>  were  not  onl>  associated  with  larger 
score  effects  but  were  also  highl>  subject  to 
self-selection  bias. 

With  these  caveats  in  mind,  it  appears 
likely  that  improvement  of  the  comprehen- 
sion and  reasoning  skills  measured  by  the 
SAT,  when  it  occurs,  is  a  functioir  of  the 
time  and  effort  expended  and  that, each  ad- 
ditional score  increase  may  require  increas- 
ing amounts  of  time  and  effort,  probably 
geometrically  increasing  amounts  If  this  is 
the  case,  the  time  rcquircd'^to  achfcvc  av- 
erage score  increases  much  greater  than  20 
to  30  points  (on  a  200-  to  800-point  sfalc) 
rapidly  approaches  that  of  full-time  school- 
ing, especially  in  Verbal,  hence  it  quickly 
becomes  unfeasible  to  augment  the  already 
fulf-timc  requirements  of  secondary  school 
with  sufficient  additional  contact  time  de- 
voted to  coaching  to  obtain  large  improve- 
ments  in  comprehension  and  reasoning  skills 
over  those  afforded  by  a  high  school  edu- 
cation. As  a  consequence,  the  soundest  long- 
range  mode  of  preparation  for  the  SAT 
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would  appear, 10  \k  a  secondary  school  pro- 
gram thai  ini9graics  ihc  dcvelopmcni  of 
thought  with  the  development  of  knowledge 
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Iiy^ieni8t 8  Association  ••i  f.    i».  DtpuiyM^«r,  Mrr^Af/wt 


November  25,  1981 


HonorabJLe  Carl  D.  Perkins 

Chairma^ 
Subcojwnittee  on  Elementary, 

Secondary  and  Vocational  Education 
2365  ^layburn  Building 
Washington,  D.C.  20515 

Dear  Mr.  Perkins: 

At  this  time,  the  Association  is  not  in  favor  of  federal  leaislation 
to  regulate  the  testing  industry.    There  is  still  no  evide»?c5  that 
such  legislation  is  needed.    The  Association  feels  that  the  results 
.  of  the  Naticfnal  Academy  of  Sciences  study  on  standardized  testing, 
soon  to  be  released,  should  be  carefully  assessed  by  the  subcommittee 
prj-or  to  recommending  enactment  of  federal  legislation.    The  Assoc- 
iation believes  that  much  more  evidence  favoring  the  need  for  federal 
regulation  of  the  testing  industry  should  be  compiled  than  the  sub- 
committee has-  already  included  in  the  hearings  r-^cord.  , 

Recent  testimony  presented  to  the  subcommittee  reinforces  the  view 
that  the  threat  of  possible  regulationTias  already  impacted  on  ^he 
testing  industry  and  currentJ^y,  disclosure  of  test* information  to 
students  and  parents  is  already  occurring  on  a  voluntary  basis. 
Educati9nal  Testing  Service  (the  giant  in  the  field)  has  reversed 
itself  and  is  complying  with  provisions  of  the  legislation  on  its 
own  initiatives.    The  law  school  association  has. set  a  full-disclosure^  C^^^' 
policy  foi^  the  LSAT*s,  etc.     In  addition  to  the  voluntary  actions 
taken  by  some  of  the  majors  in  the- business ,  the  climate  in  Congress 
and  th$  Ej^ecutive  Branch  of  the  federal  government  is  clearly  anti- 
regulat(>ry.    In  short,  it  is  our  view  that  the  real  or  remote 
possibility  of  iederal  regulation  has  already  produced  reforms  in 
the  testing  industry  of  a  substantive  nature,  to  the  point  that 
enactment  of  a  Truth-in-Testing  law  now  seems  redundant.  Xjjfe 
abs'ence  of  scheduled  FTC  witnesses^  on  the  second  day  (November  5) 
of  the  recent  hearings  was  probajjly  not  irfadvertant.  i 
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The  Dental  Hygiene  Aptitude  Test  is  the  only  currently  available  , 
instrument  that  is  specifically  designed  for  applicants  seeking 
admission  to  dental  hygiene  schools.    This  test  provides  informa- 
tion to  the  applicant  on  his  or  her  standing  compared  to  others 
With  comparable  educ^rtion.    Evidence  shows  that  this  type  of  inf cr- 
emation is  useful  to  admissions  officers. 

If  this  proposed  legislation  is  enacted,  the  Dental  Hygiene  Aptitude 
Test  would  be  adversely  affected,  since  the  cost  of  developing  new 
examinations  each  year  would  be  prohibitive  and  diminish  its 
desirability  to  institutions  and  to  prospective  dental  hygiene 
students.    To  preverse  the  integrity  of  the  test,  at  least  three 
test  forms  would  have  to  be  developed  annually.    Costs  would  triple 
m  order  to:    maintain  a  suitable  size  item  pool,  cover  cost?  for 
extra  printing,  ship  addi^tional  test*  booklets  and  construct  new 
subtests.    These  costs,  of  course,  would  have  to  be  passed  along 
to  the  consumer;  i.e.,  high  school  graduates  applying  for  admission 
to  dental  hygiene  schools.  .v_  ^ 

The  DHAT  scores  are  no^Sthe  only  criteria  used  by  institutions  m 
admissions  screening.    Pej:sonal  interviews,  grade  point  average, 
other  test  scores,  and  life  experiences  are  also  part  of  the 
selection  process.    The  DHAT  can  offer  on  applicant  who  has  long 
been  out  of  school  information  on  the  likelihood  of  academic 
success;  it  can  also  identify  individuals  who  may  require 
scholastj-c  remediation.     It  is  obvious  that  the  DHAT  can  be 
a  useful  admissions  tool. 

'The  Association  believes  that  any  legislation  at  this  point  would 
be  detrimental  to  the  DHAT  and  to  the  colleges  that  use  tnis  ^ 
instrument  as  an  initial  screening  devisee.    The  gain  in  predicting 
academic  success,  as  compared  to  selection  of  students  at  random, 
is  large  enough  to  warrant  its  us^.     At  this  point,  the  Associaticr. 
believes  that  the  pro-regulation  side  of  the  debate  has  failed  to 
make  a  convincing  ^case  for  regulating  an  industry  which  maintains 
the  highest  standards  of  professional  integrity  in  the  public 
interest.  ^  *  ^  ^ 

Sincerley, 

,  "  Kathleen  D.  Smith,  RDH,  MS 

^    .  President,  ADHA 

* 

cc:    Subcommittee  on  Elementary,  Secondary  and  Vocational  Education 
ADHA  Board  of  Trustees 
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O.  J.  Vin<ciVcM«R.  ^m. 


Deceaber  3»  1981 


Honorable  Clement  S.  Z«blockl 

2183  Rayburn  House  Office  Bulldlnf  ^  - 

Washington,  D.C.  20515 

Dear  Representative  Zablockl: 

Xt  vould  be  appreciated  If  the' enclosed  letter  werfe  forvarded 

to  tbe  cocnittce  that  Is  considering  "truth  in  testing"  legislation 

Vours  truly, 


Joe  Baer 

Director  of  Guidance 


Jdido 
Enclosure 
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N  S  Kfcjfi,  fititiiftl 

D  J.  V4fid«V<l<Jtn,i<ijrf/i'» 


Deceaber  3»  1981 


The  College  Board 

888  Seventh  Avenue 

Sew  York»  Ncv  York  10019 


Cenclccen:  ©  > 

The  Guidance  Oepartncnc  st  South  Milvaukee  Senior  Hlsh  School  is 
deeply  disturbed  by  the  trend  to  coach  students  lor  the  S.A.T*  Vhcn 
the  College  Board  Itself  outlines  a  six  weeks  course  for  counselors 
to  coach  students^  the  situation  is  out  of  hand.    Ho  outside  agency  has 
the  right  to  tcU  counselors  how  to  use  their  tlnc»  and  if  our  students 
•re  going  to  cocpetc»  it  appears  we  nust  scare  coaching.    Many  schools* 
particularly  large  City  schools,  wUl  not  be  able  to  provide  counselor 
tltte  to  provide  such  courses.    Again  we  "hurt"  our  minorities.  Your 
latest  st«ti»tlcs  show  that  S.A.T.  scores  did  not  decline  last  year 
for  the  first  tlse  sinc«  1968.    How  nuch  of  this  statlstlcsl  change 
is  due  to  coaching?  * 

Another  disturbing  trend  In  the  College  Board  progr«a  is  the  ten- 
dency to  test  studentfi  at  the  tenth  grade  level  for  the  ?SAT/K>1SQT  and 
at  toth  the  eleventh  and  twelth  grade  for  the  S.A.T.   The  increasing 
costs  snd  tlvfcvjpressure.  on  students  to  take  tests  for  practice  are 
very  negative  fjictors.    For  years  we  believed  College  Bogrd  when  they 
_«tat«d-.that"Coachlng^-«nd  practice  did  not  significantly  influence  test 
scores.    New  Cbllege  Hoird  advocates  coaching  and  tests  for  practice. 


We  have  always  supported  the  College  Board  and  Its  testing  prograa 
In  the  past.    This  is  no  longer  true  and  wc  now  believe  that  if  this 
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trend  tovard  coAchin^  continues,  perhaps  we  should  elininatc  ccsdng 
a»  one  of  the  criteria  for  collc&e  adnissions  since  not  all  stvdcntt 
will  be  coached  or  taVft  practice  tests. 
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Eunice  Hahn 
Counselor 


Alan  Kansl» 

Counselor 


Your*  truly, 

Joe  Boer  * 
Director  of  Guidance 
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Wallace  Svanson 
Counselor 
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Ann  Fritts,  President  National  Association  of  College  Adnlsslons  Counselors 
Kathy  Bourne,  Fresldcnt,  Uitconsln  Association  of  Secondary  School  and 

College  Admissions  Counselors 
Senator  Uillian  Proxnirc 
Senator  Robert  Kasten 
Representative  Ocaent  Zablockl 
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